[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:19:45.982676  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:44377
I20260709 12:19:45.984220  6874 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:19:45.985349  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:46.002887  6883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.002946  6881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:46.003131  6880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.241149  6882 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1237 milliseconds
I20260709 12:19:47.241268  6874 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:19:47.242609  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:47.242866  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.243086  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599587243062 us; error 0 us; skew 500 ppm
I20260709 12:19:47.243922  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.249918  6874 webserver.cc:533] Webserver started at http://127.6.182.190:43591/ using document root <none> and password file <none>
I20260709 12:19:47.250870  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.251127  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.251628  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.257718  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "8e6ebfec586749ddbca2317816a21e97"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.265763  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:19:47.271041  6889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.272262  6874 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:19:47.272689  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "8e6ebfec586749ddbca2317816a21e97"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.273097  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.334373  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.336021  6874 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:19:47.336501  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.414278  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:44377
I20260709 12:19:47.414326  6940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:44377 every 8 connection(s)
I20260709 12:19:47.422917  6941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.444864  6941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: Bootstrap starting.
I20260709 12:19:47.450944  6941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.452977  6941 log.cc:826] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: Log is configured to *not* fsync() on all Append() calls
I20260709 12:19:47.457906  6941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: No bootstrap required, opened a new log
I20260709 12:19:47.479069  6941 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER }
I20260709 12:19:47.479657  6941 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.479961  6941 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e6ebfec586749ddbca2317816a21e97, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.481128  6941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER }
I20260709 12:19:47.481678  6941 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:47.481989  6941 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:47.482353  6941 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.486696  6941 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER }
I20260709 12:19:47.487530  6941 leader_election.cc:304] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e6ebfec586749ddbca2317816a21e97; no voters: 
I20260709 12:19:47.489418  6941 leader_election.cc:290] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:47.489935  6944 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.492921  6944 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 1 LEADER]: Becoming Leader. State: Replica: 8e6ebfec586749ddbca2317816a21e97, State: Running, Role: LEADER
I20260709 12:19:47.493821  6944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER }
I20260709 12:19:47.494675  6941 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:47.507805  6946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e6ebfec586749ddbca2317816a21e97. Latest consensus state: current_term: 1 leader_uuid: "8e6ebfec586749ddbca2317816a21e97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER } }
I20260709 12:19:47.508157  6945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e6ebfec586749ddbca2317816a21e97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e6ebfec586749ddbca2317816a21e97" member_type: VOTER } }
I20260709 12:19:47.508810  6946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:47.508810  6945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:47.512795  6955 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:47.525362  6955 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:47.528153  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:47.544009  6955 catalog_manager.cc:1383] Generated new cluster ID: 13406be05d914b2c952855bd500d21ce
I20260709 12:19:47.544344  6955 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:47.569136  6955 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:47.570917  6955 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:47.591194  6955 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: Generated new TSK 0
I20260709 12:19:47.592450  6955 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:47.660239  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:47.670759  6964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.672048  6965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.675330  6967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.676818  6874 server_base.cc:1061] running on GCE node
I20260709 12:19:47.677861  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:47.678164  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.678428  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599587678408 us; error 0 us; skew 500 ppm
I20260709 12:19:47.679333  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.683874  6874 webserver.cc:533] Webserver started at http://127.6.182.129:34693/ using document root <none> and password file <none>
I20260709 12:19:47.684695  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.684974  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.685364  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.687037  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "a1e863a2230e4fe79cc07fef58224f10"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.694967  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.007s
I20260709 12:19:47.700835  6972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.701912  6874 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:19:47.702286  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "a1e863a2230e4fe79cc07fef58224f10"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.702718  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.738178  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.740191  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.743366  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:47.749724  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:47.750093  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.750452  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:47.750773  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.852694  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:38087
I20260709 12:19:47.852823  7034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:38087 every 8 connection(s)
I20260709 12:19:47.861383  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:47.875101  7039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.876765  7040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.888468  6874 server_base.cc:1061] running on GCE node
W20260709 12:19:47.890197  7042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.891537  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:47.891886  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.892177  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599587892156 us; error 0 us; skew 500 ppm
I20260709 12:19:47.893031  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.895331  7035 heartbeater.cc:344] Connected to a master server at 127.6.182.190:44377
I20260709 12:19:47.895869  7035 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:47.897213  7035 heartbeater.cc:507] Master 127.6.182.190:44377 requested a full tablet report, sending...
I20260709 12:19:47.899171  6874 webserver.cc:533] Webserver started at http://127.6.182.130:33771/ using document root <none> and password file <none>
I20260709 12:19:47.899811  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.900087  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.900419  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.901186  6906 ts_manager.cc:194] Registered new tserver with Master: a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087)
I20260709 12:19:47.902015  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "4237bc43193843ec9b979941d42a8ef6"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.904400  6906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44436
I20260709 12:19:47.909953  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:47.914767  7047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.916060  6874 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:47.916373  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "4237bc43193843ec9b979941d42a8ef6"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-lgtn"
I20260709 12:19:47.916707  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.931124  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.932404  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.935078  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:47.938153  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:47.938328  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.938624  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:47.938766  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.038128  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:37709
I20260709 12:19:48.038331  7110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:37709 every 8 connection(s)
I20260709 12:19:48.047348  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:48.056972  7114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.060308  7111 heartbeater.cc:344] Connected to a master server at 127.6.182.190:44377
I20260709 12:19:48.060858  7111 heartbeater.cc:461] Registering TS with master...
W20260709 12:19:48.061167  7115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.062036  7111 heartbeater.cc:507] Master 127.6.182.190:44377 requested a full tablet report, sending...
I20260709 12:19:48.064714  6906 ts_manager.cc:194] Registered new tserver with Master: 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
W20260709 12:19:48.064724  7117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.066571  6906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44438
I20260709 12:19:48.066651  6874 server_base.cc:1061] running on GCE node
I20260709 12:19:48.067708  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:48.067946  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:48.068181  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599588068160 us; error 0 us; skew 500 ppm
I20260709 12:19:48.068802  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:48.071657  6874 webserver.cc:533] Webserver started at http://127.6.182.131:35631/ using document root <none> and password file <none>
I20260709 12:19:48.072163  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:48.072381  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:48.072710  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:48.073760  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "23227d866f6a46ef860b1d6477ab10fb"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-lgtn"
I20260709 12:19:48.078459  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:48.082026  7122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.082890  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:19:48.083230  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "23227d866f6a46ef860b1d6477ab10fb"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-lgtn"
I20260709 12:19:48.083582  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:48.114526  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:48.116173  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:48.117909  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:48.120788  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:48.121105  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.121418  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:48.121634  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.218573  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:42839
I20260709 12:19:48.219239  7184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:42839 every 8 connection(s)
I20260709 12:19:48.237375  7185 heartbeater.cc:344] Connected to a master server at 127.6.182.190:44377
I20260709 12:19:48.237850  7185 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:48.238862  7185 heartbeater.cc:507] Master 127.6.182.190:44377 requested a full tablet report, sending...
I20260709 12:19:48.241163  6906 ts_manager.cc:194] Registered new tserver with Master: 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:48.241945  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017727274s
I20260709 12:19:48.242558  6906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44454
I20260709 12:19:48.298533  6906 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44460:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:48.302649  6906 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:48.437198  7075 tablet_service.cc:1511] Processing CreateTablet for tablet 59712c2eb557496b94dda1e2000ca268 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:48.437938  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:48.439013  7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59712c2eb557496b94dda1e2000ca268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.439689  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.441982  7074 tablet_service.cc:1511] Processing CreateTablet for tablet 4e59822f776b4925a249e0cd1b51c97b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:48.443444  7074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e59822f776b4925a249e0cd1b51c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.449571  7072 tablet_service.cc:1511] Processing CreateTablet for tablet daeb8f26b40d4152819e29cd3c969027 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:48.449822  7071 tablet_service.cc:1511] Processing CreateTablet for tablet a957ce44e27646b89bb4775820ba22d5 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:48.451223  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb8f26b40d4152819e29cd3c969027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.454478  7071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957ce44e27646b89bb4775820ba22d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.463397  7070 tablet_service.cc:1511] Processing CreateTablet for tablet e3970471e32e41eda7b03833d187a42b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:48.465118  7070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3970471e32e41eda7b03833d187a42b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.466145  7203 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:48.475822  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 59712c2eb557496b94dda1e2000ca268 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:48.475983  7149 tablet_service.cc:1511] Processing CreateTablet for tablet 4e59822f776b4925a249e0cd1b51c97b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:48.477669  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59712c2eb557496b94dda1e2000ca268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.477432  7148 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:48.478377  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e59822f776b4925a249e0cd1b51c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.480103  7146 tablet_service.cc:1511] Processing CreateTablet for tablet a957ce44e27646b89bb4775820ba22d5 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:48.481611  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957ce44e27646b89bb4775820ba22d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.482216  7147 tablet_service.cc:1511] Processing CreateTablet for tablet daeb8f26b40d4152819e29cd3c969027 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:48.483801  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb8f26b40d4152819e29cd3c969027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.488214  7145 tablet_service.cc:1511] Processing CreateTablet for tablet e3970471e32e41eda7b03833d187a42b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:48.489738  7145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3970471e32e41eda7b03833d187a42b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.491906  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.494165  7144 tablet_service.cc:1511] Processing CreateTablet for tablet 6b179857ac674094b5c1daf045cfad56 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:48.491925  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 6b179857ac674094b5c1daf045cfad56 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:48.495738  7144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b179857ac674094b5c1daf045cfad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.496111  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b179857ac674094b5c1daf045cfad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.503859  7204 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
W20260709 12:19:48.516865  6954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:48.531010  7000 tablet_service.cc:1511] Processing CreateTablet for tablet 59712c2eb557496b94dda1e2000ca268 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:48.536804  6997 tablet_service.cc:1511] Processing CreateTablet for tablet daeb8f26b40d4152819e29cd3c969027 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:48.541976  6999 tablet_service.cc:1511] Processing CreateTablet for tablet 4e59822f776b4925a249e0cd1b51c97b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:48.544724  6996 tablet_service.cc:1511] Processing CreateTablet for tablet a957ce44e27646b89bb4775820ba22d5 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:48.547999  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59712c2eb557496b94dda1e2000ca268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.544711  6998 tablet_service.cc:1511] Processing CreateTablet for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:48.556078  6999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e59822f776b4925a249e0cd1b51c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.557997  6994 tablet_service.cc:1511] Processing CreateTablet for tablet 6b179857ac674094b5c1daf045cfad56 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:48.560818  6998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dcf2de2a42f4eb2a6f3b2c3d4d10860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.557140  6995 tablet_service.cc:1511] Processing CreateTablet for tablet e3970471e32e41eda7b03833d187a42b (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:48.565801  6993 tablet_service.cc:1511] Processing CreateTablet for tablet 5af75c170b704f5cb078c1cc2ad8bf1e (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:48.570839  6996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957ce44e27646b89bb4775820ba22d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.574754  7203 tablet_bootstrap.cc:654] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.599453  7204 tablet_bootstrap.cc:654] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.597602  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daeb8f26b40d4152819e29cd3c969027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.603703  6994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b179857ac674094b5c1daf045cfad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.610158  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 5af75c170b704f5cb078c1cc2ad8bf1e (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:48.614248  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af75c170b704f5cb078c1cc2ad8bf1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.617692  6993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af75c170b704f5cb078c1cc2ad8bf1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.626353  6995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3970471e32e41eda7b03833d187a42b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.622550  7146 tablet_service.cc:1511] Processing CreateTablet for tablet 5af75c170b704f5cb078c1cc2ad8bf1e (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:48.633023  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af75c170b704f5cb078c1cc2ad8bf1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.636891  6992 tablet_service.cc:1511] Processing CreateTablet for tablet 8e426de0ec3444d49fc5846d940bee83 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:48.638257  7203 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:48.639148  6992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e426de0ec3444d49fc5846d940bee83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.638804  7203 ts_tablet_manager.cc:1403] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.008s
I20260709 12:19:48.643553  7204 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:48.644088  7204 ts_tablet_manager.cc:1403] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.000s
I20260709 12:19:48.649326  7203 raft_consensus.cc:359] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.657162  7203 raft_consensus.cc:385] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.667829  7203 raft_consensus.cc:740] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.668963  7203 consensus_queue.cc:260] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.664855  7204 raft_consensus.cc:359] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.675554  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 8e426de0ec3444d49fc5846d940bee83 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:48.672297  7204 raft_consensus.cc:385] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.676815  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e426de0ec3444d49fc5846d940bee83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.676932  7204 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.677736  7204 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.681563  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 8e426de0ec3444d49fc5846d940bee83 (DEFAULT_TABLE table=test-workload [id=8410f218f732499ca40e52d209334ea7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:48.690466  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e426de0ec3444d49fc5846d940bee83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.718163  7203 ts_tablet_manager.cc:1434] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.076s	user 0.023s	sys 0.016s
I20260709 12:19:48.719105  7111 heartbeater.cc:499] Master 127.6.182.190:44377 was elected leader, sending a full tablet report...
I20260709 12:19:48.719439  7203 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:48.736342  7203 tablet_bootstrap.cc:654] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.740108  7208 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:48.744189  7185 heartbeater.cc:499] Master 127.6.182.190:44377 was elected leader, sending a full tablet report...
I20260709 12:19:48.759511  7204 ts_tablet_manager.cc:1434] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.115s	user 0.014s	sys 0.000s
I20260709 12:19:48.761564  7204 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:48.761181  7203 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:48.765144  7203 ts_tablet_manager.cc:1403] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.003s
I20260709 12:19:48.767187  7208 tablet_bootstrap.cc:654] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.771713  7203 raft_consensus.cc:359] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.772648  7203 raft_consensus.cc:385] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.773002  7203 raft_consensus.cc:740] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.773878  7203 consensus_queue.cc:260] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.774889  7204 tablet_bootstrap.cc:654] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.776908  7203 ts_tablet_manager.cc:1434] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:19:48.778249  7203 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:48.790876  7203 tablet_bootstrap.cc:654] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.794694  7208 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:48.795172  7208 ts_tablet_manager.cc:1403] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.014s
W20260709 12:19:48.797001  7112 tablet.cc:2406] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:48.801028  7204 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:48.800570  7208 raft_consensus.cc:359] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.801420  7208 raft_consensus.cc:385] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.801550  7204 ts_tablet_manager.cc:1403] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.041s	user 0.002s	sys 0.013s
I20260709 12:19:48.801777  7208 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.802758  7208 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.805028  7204 raft_consensus.cc:359] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.806051  7204 raft_consensus.cc:385] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.806504  7204 raft_consensus.cc:740] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.807569  7204 consensus_queue.cc:260] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.810992  7209 raft_consensus.cc:493] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.811619  7209 raft_consensus.cc:515] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.813261  7208 ts_tablet_manager.cc:1434] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:19:48.814553  7208 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:48.816953  7035 heartbeater.cc:499] Master 127.6.182.190:44377 was elected leader, sending a full tablet report...
I20260709 12:19:48.823927  7208 tablet_bootstrap.cc:654] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.827595  7209 leader_election.cc:290] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:48.838320  7208 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:48.838887  7208 ts_tablet_manager.cc:1403] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:19:48.839123  7209 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.839628  7209 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.842119  7209 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:48.843853  7204 ts_tablet_manager.cc:1434] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 12:19:48.852716  7204 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:48.854991  7208 raft_consensus.cc:359] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.856016  7208 raft_consensus.cc:385] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.856395  7208 raft_consensus.cc:740] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.858374  7208 consensus_queue.cc:260] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.861009  7208 ts_tablet_manager.cc:1434] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.009s
I20260709 12:19:48.862005  7208 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:48.866083  7207 raft_consensus.cc:493] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.866649  7207 raft_consensus.cc:515] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.867369  7203 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:48.872682  7203 ts_tablet_manager.cc:1403] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.095s	user 0.028s	sys 0.029s
I20260709 12:19:48.876792  7203 raft_consensus.cc:359] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.877619  7203 raft_consensus.cc:385] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.878072  7203 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.878909  7203 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.882261  7208 tablet_bootstrap.cc:654] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.885399  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:48.886590  7010 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:48.888753  7204 tablet_bootstrap.cc:654] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.888641  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:48.889714  7009 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:48.891844  7123 leader_election.cc:304] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:48.894073  7123 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:48.897842  7207 leader_election.cc:290] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:48.898473  7203 ts_tablet_manager.cc:1434] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 12:19:48.899117  7209 raft_consensus.cc:2804] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.899679  7209 raft_consensus.cc:493] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.900197  7209 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.911927  7204 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:48.913463  7203 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:48.913398  7224 raft_consensus.cc:2804] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.913975  7224 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.914366  7224 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.921119  7203 tablet_bootstrap.cc:654] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.912438  7204 ts_tablet_manager.cc:1403] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 12:19:48.927621  7208 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:48.929193  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:48.929934  7208 ts_tablet_manager.cc:1403] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.018s
W20260709 12:19:48.931540  7048 leader_election.cc:343] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.927459  7209 raft_consensus.cc:515] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.933879  7208 raft_consensus.cc:359] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.934703  7208 raft_consensus.cc:385] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.934614  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:48.935135  7208 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.935580  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:48.932518  7204 raft_consensus.cc:359] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.936939  7204 raft_consensus.cc:385] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.937376  7204 raft_consensus.cc:740] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.937522  7208 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.937666  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:48.938323  7204 consensus_queue.cc:260] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.940065  7208 ts_tablet_manager.cc:1434] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:19:48.941504  7208 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:48.938728  7009 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.948668  7208 tablet_bootstrap.cc:654] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:48.950652  7123 leader_election.cc:343] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:48.957320  7123 leader_election.cc:343] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.960289  7208 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:48.961035  7208 ts_tablet_manager.cc:1403] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:19:48.963295  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:48.964159  7208 raft_consensus.cc:359] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.965150  7208 raft_consensus.cc:385] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.965540  7208 raft_consensus.cc:740] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.966377  7208 consensus_queue.cc:260] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.969095  7208 ts_tablet_manager.cc:1434] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:48.970271  7208 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
W20260709 12:19:48.973313  7050 leader_election.cc:343] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.973980  7050 leader_election.cc:304] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6; no voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:48.975283  7221 raft_consensus.cc:2749] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.978534  7208 tablet_bootstrap.cc:654] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.990325  7214 raft_consensus.cc:493] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.991011  7214 raft_consensus.cc:515] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:48.991878  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
W20260709 12:19:48.993785  7123 leader_election.cc:343] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.994724  7214 leader_election.cc:290] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.003870  7209 leader_election.cc:290] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:49.008616  7209 raft_consensus.cc:493] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.009119  7209 raft_consensus.cc:515] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.011394  7209 leader_election.cc:290] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:49.007717  7208 tablet_bootstrap.cc:492] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:49.014264  7208 ts_tablet_manager.cc:1403] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.003s
I20260709 12:19:49.014690  7224 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.022476  7208 raft_consensus.cc:359] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.023681  7208 raft_consensus.cc:385] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.024562  7208 raft_consensus.cc:740] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.027030  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.029865  7009 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
I20260709 12:19:49.031389  7204 ts_tablet_manager.cc:1434] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.102s	user 0.019s	sys 0.028s
I20260709 12:19:49.031335  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.032145  7085 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:49.032480  7224 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:49.033744  7214 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.034298  7214 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.036459  7214 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.036979  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:49.034767  7208 consensus_queue.cc:260] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.037737  7008 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.038105  7010 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:49.042470  7208 ts_tablet_manager.cc:1434] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:19:49.043617  7208 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:49.049698  7203 tablet_bootstrap.cc:492] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.050283  7203 ts_tablet_manager.cc:1403] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.058s
I20260709 12:19:49.051179  7008 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
I20260709 12:19:49.051651  7123 leader_election.cc:304] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:49.053227  7227 raft_consensus.cc:2804] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.053632  7227 raft_consensus.cc:493] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.053961  7227 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.053788  7203 raft_consensus.cc:359] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.054709  7203 raft_consensus.cc:385] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.055078  7203 raft_consensus.cc:740] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.056517  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.059158  7208 tablet_bootstrap.cc:654] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.061378  7227 raft_consensus.cc:515] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.062525  7123 leader_election.cc:304] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:49.062408  7203 consensus_queue.cc:260] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.063648  7204 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.070079  7221 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.066663  7203 ts_tablet_manager.cc:1434] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:19:49.067209  7224 raft_consensus.cc:2804] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.068006  7123 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.070860  7224 raft_consensus.cc:697] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:49.070616  7221 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.073364  7232 raft_consensus.cc:2804] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:49.074357  7123 leader_election.cc:343] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.074771  7232 raft_consensus.cc:697] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:49.074626  7224 consensus_queue.cc:237] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.075409  7203 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:49.076182  7232 consensus_queue.cc:237] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.079428  7221 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.083003  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
W20260709 12:19:49.085071  7050 leader_election.cc:343] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.088861  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.089596  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
W20260709 12:19:49.090137  7048 leader_election.cc:343] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.090157  7010 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.090577  7048 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6; no voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:49.096109  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.096449  7221 raft_consensus.cc:2749] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.098179  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.099454  7227 leader_election.cc:290] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:49.099472  7085 raft_consensus.cc:2468] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 0.
I20260709 12:19:49.106986  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.112071  7086 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.114140  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.117300  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
W20260709 12:19:49.119262  6973 leader_election.cc:343] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.120409  6973 leader_election.cc:304] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.121625  7214 raft_consensus.cc:2804] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.122113  7214 raft_consensus.cc:493] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.122527  7214 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.132825  6905 catalog_manager.cc:5697] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 1 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.150705  7204 tablet_bootstrap.cc:654] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.150523  7214 raft_consensus.cc:515] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.151172  7208 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
W20260709 12:19:49.144568  6975 leader_election.cc:343] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.152601  7208 ts_tablet_manager.cc:1403] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.109s	user 0.022s	sys 0.015s
W20260709 12:19:49.153352  6975 leader_election.cc:343] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.156131  7208 raft_consensus.cc:359] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.154057  7010 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
I20260709 12:19:49.156920  7208 raft_consensus.cc:385] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.157235  7208 raft_consensus.cc:740] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.150054  7086 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
I20260709 12:19:49.157959  7208 consensus_queue.cc:260] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.156204  6975 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:49.158419  7123 leader_election.cc:304] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.161166  7232 raft_consensus.cc:2804] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.161867  7232 raft_consensus.cc:697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:49.163393  7203 tablet_bootstrap.cc:654] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.164251  7214 leader_election.cc:290] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.164522  7232 consensus_queue.cc:237] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.165190  7214 raft_consensus.cc:2749] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.169667  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.170271  7086 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.188088  7208 ts_tablet_manager.cc:1434] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.035s	user 0.020s	sys 0.011s
I20260709 12:19:49.189909  7204 tablet_bootstrap.cc:492] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.190096  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.190387  7204 ts_tablet_manager.cc:1403] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.014s
I20260709 12:19:49.191551  7208 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
W20260709 12:19:49.197022  6975 leader_election.cc:343] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.201810  7204 raft_consensus.cc:359] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.203215  7204 raft_consensus.cc:385] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.203567  7204 raft_consensus.cc:740] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.208527  7086 raft_consensus.cc:2468] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 1.
I20260709 12:19:49.204428  7204 consensus_queue.cc:260] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.210136  6973 leader_election.cc:304] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:49.211663  7237 raft_consensus.cc:2804] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.214666  7237 raft_consensus.cc:697] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:49.216814  7208 tablet_bootstrap.cc:654] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.219180  7237 consensus_queue.cc:237] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.223497  7203 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.223990  7203 ts_tablet_manager.cc:1403] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.153s	user 0.032s	sys 0.020s
I20260709 12:19:49.224380  7204 ts_tablet_manager.cc:1434] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:19:49.228961  7238 raft_consensus.cc:493] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.229741  7238 raft_consensus.cc:515] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.232910  7204 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.234127  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.234406  7238 leader_election.cc:290] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.236140  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.232239  7203 raft_consensus.cc:359] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.237768  7203 raft_consensus.cc:385] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.238173  7203 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
W20260709 12:19:49.237725  6975 leader_election.cc:343] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:49.239001  6973 leader_election.cc:343] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.238929  7203 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.239481  6973 leader_election.cc:304] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:49.240233  7238 raft_consensus.cc:2749] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.245893  7203 ts_tablet_manager.cc:1434] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:19:49.246996  7203 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:49.257886  7204 tablet_bootstrap.cc:654] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.263620  6905 catalog_manager.cc:5697] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 1 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.266485  6905 catalog_manager.cc:5697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 1 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.268469  7203 tablet_bootstrap.cc:654] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.269235  7208 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:49.269836  7208 ts_tablet_manager.cc:1403] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.013s
I20260709 12:19:49.276320  7208 raft_consensus.cc:359] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.277258  7208 raft_consensus.cc:385] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.277683  7208 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.278589  7208 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.279496  7203 tablet_bootstrap.cc:492] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.278561  6904 catalog_manager.cc:5697] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.280022  7203 ts_tablet_manager.cc:1403] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.004s
I20260709 12:19:49.282137  7208 ts_tablet_manager.cc:1434] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:49.283018  7204 tablet_bootstrap.cc:492] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.283324  7208 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:49.283061  7203 raft_consensus.cc:359] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.283664  7204 ts_tablet_manager.cc:1403] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 12:19:49.283917  7203 raft_consensus.cc:385] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.285553  7203 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.286453  7203 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.287622  7204 raft_consensus.cc:359] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.288578  7204 raft_consensus.cc:385] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.288729  7203 ts_tablet_manager.cc:1434] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:19:49.288975  7204 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.290041  7203 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:49.289983  7204 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.292089  7208 tablet_bootstrap.cc:654] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.292886  7204 ts_tablet_manager.cc:1434] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 12:19:49.294018  7204 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.297968  7203 tablet_bootstrap.cc:654] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.309185  7208 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:49.309772  7208 ts_tablet_manager.cc:1403] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 12:19:49.312111  7204 tablet_bootstrap.cc:654] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.316078  7203 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.316690  7203 ts_tablet_manager.cc:1403] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 12:19:49.320756  7208 raft_consensus.cc:359] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.321797  7208 raft_consensus.cc:385] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.321432  7203 raft_consensus.cc:359] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.322340  7203 raft_consensus.cc:385] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.322227  7208 raft_consensus.cc:740] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.322813  7203 raft_consensus.cc:740] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.323431  7208 consensus_queue.cc:260] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.323691  7203 consensus_queue.cc:260] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.326169  7208 ts_tablet_manager.cc:1434] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:19:49.326807  7203 ts_tablet_manager.cc:1434] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:49.327155  7208 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: Bootstrap starting.
I20260709 12:19:49.327874  7203 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:49.331359  7237 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.331919  7237 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.337481  7203 tablet_bootstrap.cc:654] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.342917  7237 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.344759  7208 tablet_bootstrap.cc:654] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.344609  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.345655  7160 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 0.
I20260709 12:19:49.347093  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.347827  7086 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 0.
I20260709 12:19:49.349807  7203 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.350301  7203 ts_tablet_manager.cc:1403] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 12:19:49.350523  6973 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.351569  7237 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.352188  7237 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.352870  7237 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.353147  7203 raft_consensus.cc:359] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.353952  7203 raft_consensus.cc:385] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.354313  7203 raft_consensus.cc:740] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.355084  7203 consensus_queue.cc:260] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.357683  7203 ts_tablet_manager.cc:1434] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:49.358840  7203 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: Bootstrap starting.
I20260709 12:19:49.375643  7204 tablet_bootstrap.cc:492] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.376253  7204 ts_tablet_manager.cc:1403] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.010s
I20260709 12:19:49.376405  7208 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: No bootstrap required, opened a new log
I20260709 12:19:49.376976  7208 ts_tablet_manager.cc:1403] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.009s
I20260709 12:19:49.365816  7237 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.379695  7203 tablet_bootstrap.cc:654] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.379937  7208 raft_consensus.cc:359] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.380950  7208 raft_consensus.cc:385] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.381340  7208 raft_consensus.cc:740] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.382144  7208 consensus_queue.cc:260] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.382884  7204 raft_consensus.cc:359] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.383777  7204 raft_consensus.cc:385] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.384230  7204 raft_consensus.cc:740] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.385337  7204 consensus_queue.cc:260] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.386493  7237 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.387740  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.388495  7204 ts_tablet_manager.cc:1434] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:19:49.393680  7086 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.394354  7204 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.388993  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.396919  7160 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.402355  7204 tablet_bootstrap.cc:654] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.406533  7160 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 1.
I20260709 12:19:49.391760  7203 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: No bootstrap required, opened a new log
I20260709 12:19:49.384428  7208 ts_tablet_manager.cc:1434] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:19:49.408004  6975 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.408946  7237 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.409483  7237 raft_consensus.cc:697] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:49.410621  7086 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 1.
I20260709 12:19:49.410352  7237 consensus_queue.cc:237] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.408263  7203 ts_tablet_manager.cc:1403] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.013s
I20260709 12:19:49.414153  7203 raft_consensus.cc:359] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.415133  7221 raft_consensus.cc:493] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.415795  7221 raft_consensus.cc:515] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.419265  7221 leader_election.cc:290] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.420017  7221 raft_consensus.cc:493] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.420609  7221 raft_consensus.cc:515] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.423112  7204 tablet_bootstrap.cc:492] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.424237  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.424563  7204 ts_tablet_manager.cc:1403] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 12:19:49.427583  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.428289  7010 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 0.
I20260709 12:19:49.428159  7204 raft_consensus.cc:359] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.427919  6903 catalog_manager.cc:5697] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.429014  7204 raft_consensus.cc:385] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.429387  7204 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.430260  7204 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.423547  7221 leader_election.cc:290] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.414885  7203 raft_consensus.cc:385] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.431537  7203 raft_consensus.cc:740] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.431540  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.432334  7160 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 0.
I20260709 12:19:49.432397  7203 consensus_queue.cc:260] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.433795  7050 leader_election.cc:304] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:49.434755  7203 ts_tablet_manager.cc:1434] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:19:49.435137  7256 raft_consensus.cc:2804] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.435542  7256 raft_consensus.cc:493] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.435899  7256 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.437289  7204 ts_tablet_manager.cc:1434] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:19:49.430869  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.438417  7204 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.438871  7010 raft_consensus.cc:2393] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4237bc43193843ec9b979941d42a8ef6 in current term 1: Already voted for candidate 23227d866f6a46ef860b1d6477ab10fb in this term.
I20260709 12:19:49.441075  7048 leader_election.cc:304] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6; no voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:49.443508  7221 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.455844  7204 tablet_bootstrap.cc:654] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.455957  7232 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.456813  7237 raft_consensus.cc:493] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.457379  7237 raft_consensus.cc:515] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.459692  7237 leader_election.cc:290] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.459986  7221 raft_consensus.cc:2749] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.460701  7221 raft_consensus.cc:493] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.461177  7221 raft_consensus.cc:515] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.456532  7232 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.463456  7221 leader_election.cc:290] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.463797  7232 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087)
I20260709 12:19:49.464871  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
W20260709 12:19:49.466391  7050 leader_election.cc:343] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.469868  7256 raft_consensus.cc:515] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.470398  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.472214  7256 leader_election.cc:290] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.472286  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.473441  7010 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:49.475674  7123 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
W20260709 12:19:49.476872  6975 leader_election.cc:343] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.477977  7227 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.479645  7232 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.480265  7232 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.480733  7232 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.486019  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.486991  7086 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 0.
I20260709 12:19:49.489111  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.490100  7159 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.498494  7086 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.509716  7227 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:49.519896  6954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:49.521057  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.522023  7009 raft_consensus.cc:2468] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 0.
I20260709 12:19:49.525133  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:49.526041  7009 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.561329  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.562471  7085 raft_consensus.cc:2468] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 0.
I20260709 12:19:49.563897  7227 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.564345  6973 leader_election.cc:304] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:49.566270  7237 raft_consensus.cc:2804] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.566913  7237 raft_consensus.cc:493] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.567502  7237 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.584097  7227 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.590087  7227 raft_consensus.cc:493] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.590682  7227 raft_consensus.cc:515] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.593611  7227 leader_election.cc:290] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:49.594547  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.607689  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6" is_pre_election: true
I20260709 12:19:49.609109  7083 raft_consensus.cc:2393] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23227d866f6a46ef860b1d6477ab10fb in current term 1: Already voted for candidate a1e863a2230e4fe79cc07fef58224f10 in this term.
I20260709 12:19:49.596593  7048 leader_election.cc:304] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:49.625874  7256 raft_consensus.cc:2804] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.626461  7256 raft_consensus.cc:493] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.626965  7256 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.631228  7009 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 1.
I20260709 12:19:49.642673  7159 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 1.
I20260709 12:19:49.640054  7123 leader_election.cc:304] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb; no voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:49.643930  7232 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.662591  7224 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.637915  7048 leader_election.cc:304] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.676420  7221 raft_consensus.cc:2804] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.651456  7237 raft_consensus.cc:515] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.685233  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.687613  7237 leader_election.cc:290] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.690748  7227 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:49.693886  7237 consensus_queue.cc:1048] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.694540  7204 tablet_bootstrap.cc:492] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.695017  7204 ts_tablet_manager.cc:1403] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.257s	user 0.095s	sys 0.116s
I20260709 12:19:49.695608  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.709360  7232 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087)
I20260709 12:19:49.679574  7256 raft_consensus.cc:515] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.718248  7204 raft_consensus.cc:359] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.719535  7204 raft_consensus.cc:385] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.719887  7204 raft_consensus.cc:740] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.691823  7221 raft_consensus.cc:697] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:49.723038  7257 raft_consensus.cc:493] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.723749  7086 raft_consensus.cc:2393] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1e863a2230e4fe79cc07fef58224f10 in current term 1: Already voted for candidate 4237bc43193843ec9b979941d42a8ef6 in this term.
I20260709 12:19:49.723629  7257 raft_consensus.cc:515] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.723971  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
W20260709 12:19:49.724282  6975 leader_election.cc:343] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.724617  7009 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.726758  7204 consensus_queue.cc:260] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.727382  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.728181  7257 leader_election.cc:290] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.729421  7010 raft_consensus.cc:2468] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 0.
I20260709 12:19:49.731006  7204 ts_tablet_manager.cc:1434] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.007s
I20260709 12:19:49.731298  7048 leader_election.cc:304] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.732069  7204 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: Bootstrap starting.
I20260709 12:19:49.732335  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:49.732661  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:49.733090  7010 raft_consensus.cc:2393] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4237bc43193843ec9b979941d42a8ef6 in current term 1: Already voted for candidate a1e863a2230e4fe79cc07fef58224f10 in this term.
I20260709 12:19:49.733248  7086 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.737058  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.738253  7009 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
W20260709 12:19:49.738519  7050 leader_election.cc:343] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.739823  7123 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:49.741132  7227 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.741626  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.739485  6973 leader_election.cc:304] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1e863a2230e4fe79cc07fef58224f10; no voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:49.742260  7160 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.742944  7204 tablet_bootstrap.cc:654] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.727892  7221 consensus_queue.cc:237] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.745565  7237 raft_consensus.cc:2749] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.741624  7227 raft_consensus.cc:697] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:49.745566  7224 raft_consensus.cc:2749] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.735893  7232 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:19:49.751072  7227 consensus_queue.cc:237] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.751583  7160 raft_consensus.cc:2468] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 1.
I20260709 12:19:49.751771  7256 leader_election.cc:290] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.759562  7086 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 1.
I20260709 12:19:49.775750  7050 leader_election.cc:304] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:49.779421  7256 raft_consensus.cc:2804] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.780092  7256 raft_consensus.cc:697] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:49.780232  7237 consensus_queue.cc:1048] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.781222  7256 consensus_queue.cc:237] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.798381  7270 raft_consensus.cc:2804] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.799037  7270 raft_consensus.cc:493] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.799520  7270 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.804973  7269 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23227d866f6a46ef860b1d6477ab10fb)
I20260709 12:19:49.805791  7269 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.841450  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10" is_pre_election: true
I20260709 12:19:49.832593  7269 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.857118  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb" is_pre_election: true
I20260709 12:19:49.860935  7050 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6; no voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:49.861893  7269 raft_consensus.cc:2749] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:49.871323  6905 catalog_manager.cc:5697] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 1 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.875190  7237 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.884130  7204 tablet_bootstrap.cc:492] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: No bootstrap required, opened a new log
I20260709 12:19:49.884599  7204 ts_tablet_manager.cc:1403] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.022s
I20260709 12:19:49.889495  7214 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.899493  7204 raft_consensus.cc:359] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.900185  7204 raft_consensus.cc:385] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.900466  7204 raft_consensus.cc:740] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.901160  7204 consensus_queue.cc:260] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.903194  7204 ts_tablet_manager.cc:1434] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.001s
I20260709 12:19:49.906464  7270 raft_consensus.cc:515] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.909207  7270 leader_election.cc:290] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:49.910240  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:49.910949  7160 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.910240  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:49.911576  7009 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.910900  6903 catalog_manager.cc:5697] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.913841  6903 catalog_manager.cc:5697] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.916126  7160 raft_consensus.cc:2468] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 1.
I20260709 12:19:49.917332  7050 leader_election.cc:304] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:49.918058  7009 raft_consensus.cc:2468] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 1.
I20260709 12:19:49.918254  7270 raft_consensus.cc:2804] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.921362  7270 raft_consensus.cc:697] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:49.922290  7270 consensus_queue.cc:237] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:49.948247  6906 catalog_manager.cc:5697] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.174573  7227 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.203004  7270 consensus_queue.cc:1048] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.211277  7267 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.219942  7160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:19:50.220724  7160 raft_consensus.cc:606] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:50.229722  7269 consensus_queue.cc:1048] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.236466  7160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:19:50.237157  7160 raft_consensus.cc:606] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:50.245946  7274 consensus_queue.cc:1048] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.248647  7274 consensus_queue.cc:1048] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.265251  7160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:19:50.265904  7160 raft_consensus.cc:606] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:50.286237  7159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:19:50.286566  7267 raft_consensus.cc:993] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.286881  7159 raft_consensus.cc:606] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:19:50.287143  7209 raft_consensus.cc:1081] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.292778  7009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35980
I20260709 12:19:50.293402  7009 raft_consensus.cc:493] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.293787  7009 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.300523  7009 raft_consensus.cc:515] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.306180  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:50.306773  7081 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.313937  7010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:35996
I20260709 12:19:50.314548  7010 raft_consensus.cc:606] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:50.315335  7081 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.316272  7009 leader_election.cc:290] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.317652  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.317864  6973 leader_election.cc:304] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:50.318256  7159 raft_consensus.cc:3055] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.318631  7159 raft_consensus.cc:740] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:50.318995  7214 raft_consensus.cc:2804] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.319465  7214 raft_consensus.cc:697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.319450  7159 consensus_queue.cc:260] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.320485  7214 consensus_queue.cc:237] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.320995  7159 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.321336  7009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:35996
I20260709 12:19:50.321893  7009 raft_consensus.cc:606] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:19:50.327844  7159 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.329473  6903 catalog_manager.cc:5697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 1 to 2, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.346678  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:56822
I20260709 12:19:50.347277  7081 raft_consensus.cc:606] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Received request to transfer leadership to TS 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:50.394317  7237 raft_consensus.cc:993] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:19:50.394786  7214 raft_consensus.cc:1081] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:19:50.396685  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56816
I20260709 12:19:50.397356  7081 raft_consensus.cc:493] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.397820  7081 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.403498  7081 raft_consensus.cc:515] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.405489  7081 leader_election.cc:290] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.406553  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.406544  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3970471e32e41eda7b03833d187a42b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:50.407294  7159 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.407312  7009 raft_consensus.cc:3055] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.407862  7009 raft_consensus.cc:740] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.408812  7009 consensus_queue.cc:260] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.410171  7009 raft_consensus.cc:3060] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.414477  7159 raft_consensus.cc:2468] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 2.
I20260709 12:19:50.415834  7050 leader_election.cc:304] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:50.416726  7274 raft_consensus.cc:2804] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.416896  7009 raft_consensus.cc:2468] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 2.
I20260709 12:19:50.417220  7274 raft_consensus.cc:697] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:50.418025  7274 consensus_queue.cc:237] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.420202  7209 raft_consensus.cc:993] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.420616  7209 raft_consensus.cc:1081] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.422251  7009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35980
I20260709 12:19:50.422719  7009 raft_consensus.cc:493] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.423039  7009 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.426867  6903 catalog_manager.cc:5697] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 1 to 2, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.427876  7009 raft_consensus.cc:515] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.430049  7009 leader_election.cc:290] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.431206  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.431792  7159 raft_consensus.cc:3055] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.432124  7159 raft_consensus.cc:740] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:50.432945  7159 consensus_queue.cc:260] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
W20260709 12:19:50.433897  7209 consensus_queue.cc:1175] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4237bc43193843ec9b979941d42a8ef6" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:19:50.434087  7159 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.435434  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:50.435968  7081 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.440902  7159 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.442173  6975 leader_election.cc:304] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:50.442644  7081 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.443040  7214 raft_consensus.cc:2804] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.443608  7214 raft_consensus.cc:697] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.444555  7214 consensus_queue.cc:237] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.451961  6903 catalog_manager.cc:5697] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 1 to 2, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.456065  7237 raft_consensus.cc:993] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:19:50.456547  7214 raft_consensus.cc:1081] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:19:50.458127  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56816
I20260709 12:19:50.458613  7081 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.458925  7081 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.463799  7081 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.465945  7081 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.466367  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:50.466621  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.467046  7009 raft_consensus.cc:3055] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.467188  7159 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.467481  7009 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.468403  7009 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.469808  7009 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.472225  7159 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 2.
I20260709 12:19:50.473241  7050 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:50.473996  7274 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.474426  7274 raft_consensus.cc:697] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:50.475142  7274 consensus_queue.cc:237] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.477689  7009 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 2.
I20260709 12:19:50.482630  7274 consensus_queue.cc:1048] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.482525  6903 catalog_manager.cc:5697] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 1 to 2, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.496322  7274 consensus_queue.cc:1048] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.505883  7274 raft_consensus.cc:993] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:50.506631  7269 raft_consensus.cc:1081] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Signalling peer 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:50.508468  7159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:36348
I20260709 12:19:50.509122  7159 raft_consensus.cc:493] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.509570  7159 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.513461  7267 raft_consensus.cc:993] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.513947  7209 raft_consensus.cc:1081] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.515754  7009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35980
I20260709 12:19:50.516361  7009 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.516528  7159 raft_consensus.cc:515] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.516860  7009 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.519224  7159 leader_election.cc:290] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 2 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:50.519948  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:50.520594  7010 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.525889  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e426de0ec3444d49fc5846d940bee83" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:50.526536  7081 raft_consensus.cc:3055] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.526859  7081 raft_consensus.cc:740] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:50.527671  7081 consensus_queue.cc:260] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.528019  7010 raft_consensus.cc:2468] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 2.
I20260709 12:19:50.529145  7081 raft_consensus.cc:3060] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.529460  7123 leader_election.cc:304] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:50.530400  7209 raft_consensus.cc:2804] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.530915  7209 raft_consensus.cc:697] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 2 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:50.531776  7209 consensus_queue.cc:237] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.536172  7081 raft_consensus.cc:2468] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 2.
I20260709 12:19:50.542165  7009 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.541713  6906 catalog_manager.cc:5697] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 1 to 2, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 2 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.544883  7009 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.545531  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:50.546141  7081 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.547914  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.548537  7159 raft_consensus.cc:3055] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.550271  7159 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:50.551102  7159 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.552296  7159 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.553026  7081 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.554232  6973 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:50.555382  7214 raft_consensus.cc:2804] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.555869  7214 raft_consensus.cc:697] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.556695  7214 consensus_queue.cc:237] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.559046  7159 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.563781  6906 catalog_manager.cc:5697] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 1 to 2, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.745050  7267 raft_consensus.cc:993] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.745496  7209 raft_consensus.cc:1081] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:19:50.747149  7009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35980
I20260709 12:19:50.747731  7009 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.748075  7009 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.752961  7009 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.754971  7009 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:19:50.757170  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:19:50.758809  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:50.759362  7083 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.757786  7159 raft_consensus.cc:3055] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.761055  7159 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:50.761909  7159 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.763108  7159 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.765873  7083 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.766907  6973 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:50.767585  7214 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.768024  7214 raft_consensus.cc:697] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:50.769184  7214 consensus_queue.cc:237] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:50.769659  7159 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:19:50.775507  6906 catalog_manager.cc:5697] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 1 to 2, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.779815  7159 raft_consensus.cc:1275] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.781451  7214 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.792090  7083 raft_consensus.cc:1275] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.794216  7214 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:50.877749  7159 raft_consensus.cc:1275] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.879076  7270 consensus_queue.cc:1048] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.886804  7009 raft_consensus.cc:1275] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.888093  7270 consensus_queue.cc:1048] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.936342  7009 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.938033  7270 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.945015  7159 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.947132  7159 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.947209  7298 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:50.948988  7270 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.961300  7083 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.962864  7214 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.008548  7083 raft_consensus.cc:1275] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.010062  7209 consensus_queue.cc:1048] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.017925  7009 raft_consensus.cc:1275] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.019654  7224 consensus_queue.cc:1048] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.041232  7083 raft_consensus.cc:1275] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.042508  7214 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.051862  7159 raft_consensus.cc:1275] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.053560  7298 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.343866  7160 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.345271  7298 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.349411  7083 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.351305  7298 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.377441  6874 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:19:53.378340  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.400223  7009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:35998
I20260709 12:19:53.400776  7009 raft_consensus.cc:606] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Received request to transfer leadership to TS 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:53.410590  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:19:53.411113  7081 raft_consensus.cc:606] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Received request to transfer leadership to TS 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:19:53.412145  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:53.412667  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:53.541180  7274 raft_consensus.cc:993] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:53.541709  7316 raft_consensus.cc:1081] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Signalling peer 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:53.543246  7160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:36348
I20260709 12:19:53.543701  7160 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:53.543955  7160 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.548772  7160 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.550357  7160 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 3 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:19:53.551375  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:53.551944  7009 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.552062  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:53.552739  7081 raft_consensus.cc:3055] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:53.553062  7081 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:19:53.553792  7081 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.554816  7081 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.556169  7009 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 3.
I20260709 12:19:53.557222  7123 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:19:53.558009  7311 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:53.559293  7311 raft_consensus.cc:697] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:53.560081  7311 consensus_queue.cc:237] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.561923  7081 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 3.
I20260709 12:19:53.571094  6906 catalog_manager.cc:5697] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 2 to 3, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 3 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.779707  7312 raft_consensus.cc:993] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:53.780071  7312 raft_consensus.cc:1081] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Signalling peer 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:19:53.781826  7160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:36362
I20260709 12:19:53.782437  7160 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:53.782827  7160 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.787791  7160 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.789368  7160 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 3 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087)
I20260709 12:19:53.790290  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:19:53.790822  7083 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.790719  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:19:53.791268  7009 raft_consensus.cc:3055] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:53.791554  7009 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:19:53.792236  7009 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.793215  7009 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:53.795409  7083 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 3.
I20260709 12:19:53.796603  7123 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:19:53.797555  7311 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:53.798105  7311 raft_consensus.cc:697] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:19:53.798223  7009 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 3.
I20260709 12:19:53.799039  7311 consensus_queue.cc:237] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:19:53.806862  6905 catalog_manager.cc:5697] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 2 to 3, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 3 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.012081  7009 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:54.013427  7311 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:54.023985  7083 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:54.025893  7311 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:54.217694  7009 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:54.219269  7311 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:54.229743  7083 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:54.231540  7311 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:54.413561  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:54.419497  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:54.419853  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:55.420713  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:55.426307  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:55.426666  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:56.427734  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:56.433250  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:56.433682  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:57.434751  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:57.439713  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:57.440145  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:58.441090  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:58.446409  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:58.446830  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:59.447860  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:59.452857  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:59.453329  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:00.454344  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:00.459522  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:00.460016  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:01.461161  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:01.466488  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:01.466876  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:02.467972  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:02.474205  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:02.474764  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:03.507454  6874 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:20:03.513051  7159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:20:03.513738  7159 raft_consensus.cc:606] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:20:03.519259  7009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:35996
I20260709 12:20:03.519788  7009 raft_consensus.cc:606] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:20:03.525502  7009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:35996
I20260709 12:20:03.525991  7009 raft_consensus.cc:606] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:20:03.531239  7009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:35996
I20260709 12:20:03.531754  7009 raft_consensus.cc:606] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:20:03.541775  7159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
mode: GRACEFUL
new_leader_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:36370
I20260709 12:20:03.542244  7159 raft_consensus.cc:606] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Received request to transfer leadership to TS 4237bc43193843ec9b979941d42a8ef6
I20260709 12:20:03.619685  7312 raft_consensus.cc:993] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.620288  7344 raft_consensus.cc:1081] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.622015  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56816
I20260709 12:20:03.622628  7081 raft_consensus.cc:493] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.622967  7081 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.627856  7081 raft_consensus.cc:515] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.629588  7081 leader_election.cc:290] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:03.630708  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:03.630704  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dcf2de2a42f4eb2a6f3b2c3d4d10860" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:03.631750  7009 raft_consensus.cc:3055] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.631779  7159 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.632258  7009 raft_consensus.cc:740] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:03.633193  7009 consensus_queue.cc:260] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.634514  7009 raft_consensus.cc:3060] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.639318  7159 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.640847  7050 leader_election.cc:304] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:20:03.641595  7009 raft_consensus.cc:2468] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.641834  7336 raft_consensus.cc:2804] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.643033  7336 raft_consensus.cc:697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:03.643949  7336 consensus_queue.cc:237] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.653888  6906 catalog_manager.cc:5697] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 2 to 3, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.713038  7312 raft_consensus.cc:993] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.713542  7344 raft_consensus.cc:1081] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.715029  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56816
I20260709 12:20:03.715531  7081 raft_consensus.cc:493] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.715893  7081 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.720575  7081 raft_consensus.cc:515] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.722182  7081 leader_election.cc:290] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:03.723371  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:03.723371  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daeb8f26b40d4152819e29cd3c969027" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:03.724231  7009 raft_consensus.cc:3055] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.724233  7159 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.724776  7009 raft_consensus.cc:740] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:03.725593  7009 consensus_queue.cc:260] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.726768  7009 raft_consensus.cc:3060] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.731317  7159 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.732528  7050 leader_election.cc:304] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:20:03.733373  7336 raft_consensus.cc:2804] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.733572  7009 raft_consensus.cc:2468] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.733886  7336 raft_consensus.cc:697] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:03.735070  7336 consensus_queue.cc:237] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.743206  6906 catalog_manager.cc:5697] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 2 to 3, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.761839  7342 raft_consensus.cc:993] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.762385  7352 raft_consensus.cc:1081] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.764109  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56812
I20260709 12:20:03.764613  7081 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.764995  7081 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.770144  7081 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.771947  7081 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 4 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:03.772897  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:03.773052  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:03.773489  7009 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.773641  7159 raft_consensus.cc:3055] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:03.774055  7159 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:20:03.774832  7159 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.776068  7159 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.779204  7009 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 4.
I20260709 12:20:03.780465  7048 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:03.781378  7336 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.781713  7159 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 4.
I20260709 12:20:03.781857  7336 raft_consensus.cc:697] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:03.782812  7336 consensus_queue.cc:237] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.789487  6906 catalog_manager.cc:5697] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 3 to 4, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.896818  7312 raft_consensus.cc:993] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.897301  7344 raft_consensus.cc:1081] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.898784  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56816
I20260709 12:20:03.899279  7081 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.899578  7081 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.904312  7081 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.906951  7081 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:03.908228  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:03.908509  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:03.908821  7159 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.909003  7009 raft_consensus.cc:3055] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.909305  7009 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:03.909991  7009 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.911023  7009 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.915097  7159 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.916158  7050 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, 4237bc43193843ec9b979941d42a8ef6; no voters: 
I20260709 12:20:03.916600  7009 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 3.
I20260709 12:20:03.916832  7336 raft_consensus.cc:2804] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.917284  7336 raft_consensus.cc:697] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:03.918164  7336 consensus_queue.cc:237] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.925076  6906 catalog_manager.cc:5697] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 2 to 3, leader changed from a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.954212  7342 raft_consensus.cc:993] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: : Instructing follower 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.954715  7352 raft_consensus.cc:1081] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Signalling peer 4237bc43193843ec9b979941d42a8ef6 to start an election
I20260709 12:20:03.956526  7081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
 from {username='slave'} at 127.0.0.1:56812
I20260709 12:20:03.957032  7081 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.957312  7081 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.961511  7081 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.963057  7081 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 4 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:03.963907  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:03.964073  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "4237bc43193843ec9b979941d42a8ef6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:03.964553  7009 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.964665  7159 raft_consensus.cc:3055] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:03.965031  7159 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:20:03.965698  7159 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.966895  7159 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.970660  7009 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 4.
I20260709 12:20:03.971735  7159 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4237bc43193843ec9b979941d42a8ef6 in term 4.
I20260709 12:20:03.971654  7048 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:03.972581  7336 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.973129  7336 raft_consensus.cc:697] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Becoming Leader. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:03.973968  7336 consensus_queue.cc:237] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:03.981101  6906 catalog_manager.cc:5697] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 reported cstate change: term changed from 3 to 4, leader changed from 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131) to 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "4237bc43193843ec9b979941d42a8ef6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.129446  7159 raft_consensus.cc:1275] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.130906  7336 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:04.141916  7009 raft_consensus.cc:1275] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.143778  7336 consensus_queue.cc:1048] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.178210  7159 raft_consensus.cc:1275] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.179486  7336 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.188791  7159 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.191478  7336 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:04.193526  7009 raft_consensus.cc:1275] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.197153  7336 consensus_queue.cc:1048] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.208447  7009 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.210649  7345 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:04.496320  7160 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.497656  7345 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:04.507040  7009 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.507625  7159 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.508527  7362 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:04.510746  7362 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.523228  7009 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Refusing update from remote peer 4237bc43193843ec9b979941d42a8ef6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.524767  7345 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:06.579851  6874 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:20:06.580720  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.588107  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:20:06.588869  7081 raft_consensus.cc:606] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Received request to transfer leadership to TS 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:20:06.591565  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:20:06.592118  7081 raft_consensus.cc:606] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:20:06.594458  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:20:06.594995  7081 raft_consensus.cc:606] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Received request to transfer leadership to TS 23227d866f6a46ef860b1d6477ab10fb
I20260709 12:20:06.597293  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:20:06.597775  7081 raft_consensus.cc:606] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:20:06.600349  7081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5"
dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
mode: GRACEFUL
new_leader_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:56830
I20260709 12:20:06.600941  7081 raft_consensus.cc:606] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Received request to transfer leadership to TS a1e863a2230e4fe79cc07fef58224f10
I20260709 12:20:06.602240  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:06.602337  7372 raft_consensus.cc:993] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:20:06.602864  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:06.603001  7336 raft_consensus.cc:1081] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Signalling peer 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:20:06.604805  7159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:36348
I20260709 12:20:06.605401  7159 raft_consensus.cc:493] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.605729  7159 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.612231  7159 raft_consensus.cc:515] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.614284  7159 leader_election.cc:290] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 4 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:20:06.615453  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:20:06.615481  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e59822f776b4925a249e0cd1b51c97b" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:06.616132  7081 raft_consensus.cc:3055] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:06.616475  7081 raft_consensus.cc:740] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:06.616515  7010 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.617381  7081 consensus_queue.cc:260] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.618588  7081 raft_consensus.cc:3060] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.622354  7010 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 4.
I20260709 12:20:06.623741  7081 raft_consensus.cc:2468] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 4.
I20260709 12:20:06.623744  7123 leader_election.cc:304] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:06.624874  7352 raft_consensus.cc:2804] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:06.625895  7352 raft_consensus.cc:697] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 4 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:20:06.626886  7352 consensus_queue.cc:237] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.634337  6905 catalog_manager.cc:5697] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 3 to 4, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 4 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.916705  7336 raft_consensus.cc:993] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:06.917317  7336 raft_consensus.cc:1081] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:06.920830  7007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35982
I20260709 12:20:06.921454  7007 raft_consensus.cc:493] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.921856  7007 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.927392  7007 raft_consensus.cc:515] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.929834  7007 leader_election.cc:290] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:06.930714  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:20:06.930805  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957ce44e27646b89bb4775820ba22d5" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:06.931324  7081 raft_consensus.cc:3055] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.931397  7159 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.931630  7081 raft_consensus.cc:740] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:06.932463  7081 consensus_queue.cc:260] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.933590  7081 raft_consensus.cc:3060] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.935973  7159 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:20:06.937148  6975 leader_election.cc:304] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:06.937932  7081 raft_consensus.cc:2468] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 2.
I20260709 12:20:06.938920  7380 raft_consensus.cc:2804] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.940153  7380 raft_consensus.cc:697] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:06.941134  7380 consensus_queue.cc:237] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:06.948769  6905 catalog_manager.cc:5697] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 1 to 2, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.998992  7379 raft_consensus.cc:993] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:06.999521  7336 raft_consensus.cc:1081] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:07.001031  7007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35982
I20260709 12:20:07.001538  7007 raft_consensus.cc:493] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.001864  7007 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.006858  7007 raft_consensus.cc:515] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.008618  7007 leader_election.cc:290] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 5 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:07.009361  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:20:07.009645  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b179857ac674094b5c1daf045cfad56" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:07.010006  7081 raft_consensus.cc:3055] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:07.010326  7159 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.010371  7081 raft_consensus.cc:740] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:07.011335  7081 consensus_queue.cc:260] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.012243  7081 raft_consensus.cc:3060] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.015021  7159 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 5.
I20260709 12:20:07.016011  6975 leader_election.cc:304] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:07.016250  7081 raft_consensus.cc:2468] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 5.
I20260709 12:20:07.016734  7380 raft_consensus.cc:2804] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:07.017180  7380 raft_consensus.cc:697] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 5 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:07.018038  7380 consensus_queue.cc:237] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.025408  6905 catalog_manager.cc:5697] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 4 to 5, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.027268  7379 raft_consensus.cc:993] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:07.027767  7336 raft_consensus.cc:1081] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Signalling peer a1e863a2230e4fe79cc07fef58224f10 to start an election
I20260709 12:20:07.029373  7007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268"
dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
 from {username='slave'} at 127.0.0.1:35982
I20260709 12:20:07.029873  7007 raft_consensus.cc:493] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.030227  7007 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.034574  7081 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.036056  7352 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:07.036720  7007 raft_consensus.cc:515] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.038866  7007 leader_election.cc:290] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 5 election: Requested vote from peers 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709), 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131:42839)
I20260709 12:20:07.039748  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:20:07.040468  7083 raft_consensus.cc:3055] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:07.040555  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59712c2eb557496b94dda1e2000ca268" candidate_uuid: "a1e863a2230e4fe79cc07fef58224f10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
I20260709 12:20:07.040875  7083 raft_consensus.cc:740] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:07.041270  7159 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.041862  7083 consensus_queue.cc:260] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.043299  7083 raft_consensus.cc:3060] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:07.050706  7083 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 5.
I20260709 12:20:07.052073  7159 raft_consensus.cc:2468] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e863a2230e4fe79cc07fef58224f10 in term 5.
I20260709 12:20:07.052205  6973 leader_election.cc:304] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4237bc43193843ec9b979941d42a8ef6, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:07.053375  7380 raft_consensus.cc:2804] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:07.053902  7380 raft_consensus.cc:697] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 5 LEADER]: Becoming Leader. State: Replica: a1e863a2230e4fe79cc07fef58224f10, State: Running, Role: LEADER
I20260709 12:20:07.054817  7380 consensus_queue.cc:237] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.055346  7007 raft_consensus.cc:1275] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.057612  7352 consensus_queue.cc:1048] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:07.066066  6906 catalog_manager.cc:5697] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 reported cstate change: term changed from 4 to 5, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "a1e863a2230e4fe79cc07fef58224f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.086184  7336 raft_consensus.cc:993] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: : Instructing follower 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:20:07.086602  7379 raft_consensus.cc:1081] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Signalling peer 23227d866f6a46ef860b1d6477ab10fb to start an election
I20260709 12:20:07.088155  7159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e"
dest_uuid: "23227d866f6a46ef860b1d6477ab10fb"
 from {username='slave'} at 127.0.0.1:36348
I20260709 12:20:07.088675  7159 raft_consensus.cc:493] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.089057  7159 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.093547  7159 raft_consensus.cc:515] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.094998  7159 leader_election.cc:290] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 2 election: Requested vote from peers a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087), 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709)
I20260709 12:20:07.095757  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1e863a2230e4fe79cc07fef58224f10"
I20260709 12:20:07.096021  7081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af75c170b704f5cb078c1cc2ad8bf1e" candidate_uuid: "23227d866f6a46ef860b1d6477ab10fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4237bc43193843ec9b979941d42a8ef6"
I20260709 12:20:07.096393  7007 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.096675  7081 raft_consensus.cc:3055] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:07.097026  7081 raft_consensus.cc:740] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4237bc43193843ec9b979941d42a8ef6, State: Running, Role: LEADER
I20260709 12:20:07.097651  7081 consensus_queue.cc:260] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.098547  7081 raft_consensus.cc:3060] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.101228  7007 raft_consensus.cc:2468] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 2.
I20260709 12:20:07.102167  7123 leader_election.cc:304] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23227d866f6a46ef860b1d6477ab10fb, a1e863a2230e4fe79cc07fef58224f10; no voters: 
I20260709 12:20:07.103065  7352 raft_consensus.cc:2804] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:07.103057  7081 raft_consensus.cc:2468] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23227d866f6a46ef860b1d6477ab10fb in term 2.
I20260709 12:20:07.103725  7352 raft_consensus.cc:697] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 2 LEADER]: Becoming Leader. State: Replica: 23227d866f6a46ef860b1d6477ab10fb, State: Running, Role: LEADER
I20260709 12:20:07.104772  7352 consensus_queue.cc:237] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } }
I20260709 12:20:07.112592  6906 catalog_manager.cc:5697] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb reported cstate change: term changed from 1 to 2, leader changed from 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130) to 23227d866f6a46ef860b1d6477ab10fb (127.6.182.131). New cstate: current_term: 2 leader_uuid: "23227d866f6a46ef860b1d6477ab10fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.348934  7081 raft_consensus.cc:1275] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.350219  7380 consensus_queue.cc:1048] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.359066  7159 raft_consensus.cc:1275] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.361137  7381 consensus_queue.cc:1048] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.471763  7081 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:07.473001  7159 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:07.473093  7392 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:07.474197  7381 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:07.483642  7160 raft_consensus.cc:1275] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:07.486649  7392 consensus_queue.cc:1048] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23227d866f6a46ef860b1d6477ab10fb" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:07.495072  7081 raft_consensus.cc:1275] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Refusing update from remote peer a1e863a2230e4fe79cc07fef58224f10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:07.499329  7396 consensus_queue.cc:1048] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:07.590734  7007 raft_consensus.cc:1275] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.592154  7399 consensus_queue.cc:1048] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e863a2230e4fe79cc07fef58224f10" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.601271  7081 raft_consensus.cc:1275] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Refusing update from remote peer 23227d866f6a46ef860b1d6477ab10fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.603329  7399 consensus_queue.cc:1048] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4237bc43193843ec9b979941d42a8ef6" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.604555  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.614210  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:07.614683  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:08.615718  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.621191  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:08.621701  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:09.622767  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:09.628398  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:09.628902  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:10.629995  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.635628  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:10.636111  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:11.637351  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:11.642603  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:11.642985  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:12.643931  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:12.649102  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:12.649457  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:13.650388  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:13.655979  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:13.656400  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:14.657771  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.665153  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:14.665697  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:15.667084  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.673401  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:15.673768  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:16.706240  6874 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:20:16.706918  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:20:16.720742  7123 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:16.726429  7123 consensus_peers.cc:597] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb -> Peer a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087): Couldn't send request to peer a1e863a2230e4fe79cc07fef58224f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.740195  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:16.741259  6874 tablet_replica.cc:333] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.742154  6874 raft_consensus.cc:2243] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.742736  6874 raft_consensus.cc:2272] T 8e426de0ec3444d49fc5846d940bee83 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.745254  6874 tablet_replica.cc:333] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.745817  6874 raft_consensus.cc:2243] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.746260  6874 raft_consensus.cc:2272] T 5af75c170b704f5cb078c1cc2ad8bf1e P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.748108  6874 tablet_replica.cc:333] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.748709  6874 raft_consensus.cc:2243] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.749171  6874 raft_consensus.cc:2272] T daeb8f26b40d4152819e29cd3c969027 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.750931  6874 tablet_replica.cc:333] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.751437  6874 raft_consensus.cc:2243] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.751870  6874 raft_consensus.cc:2272] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P a1e863a2230e4fe79cc07fef58224f10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.753602  6874 tablet_replica.cc:333] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.754094  6874 raft_consensus.cc:2243] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.754882  6874 raft_consensus.cc:2272] T 59712c2eb557496b94dda1e2000ca268 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.756839  6874 tablet_replica.cc:333] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.757380  6874 raft_consensus.cc:2243] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.758287  6874 raft_consensus.cc:2272] T a957ce44e27646b89bb4775820ba22d5 P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.759976  6874 tablet_replica.cc:333] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.760439  6874 raft_consensus.cc:2243] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:16.760681  7048 consensus_peers.cc:597] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 -> Peer a1e863a2230e4fe79cc07fef58224f10 (127.6.182.129:38087): Couldn't send request to peer a1e863a2230e4fe79cc07fef58224f10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.760895  6874 raft_consensus.cc:2272] T e3970471e32e41eda7b03833d187a42b P a1e863a2230e4fe79cc07fef58224f10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.762622  6874 tablet_replica.cc:333] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.763108  6874 raft_consensus.cc:2243] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.763875  6874 raft_consensus.cc:2272] T 6b179857ac674094b5c1daf045cfad56 P a1e863a2230e4fe79cc07fef58224f10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.765453  6874 tablet_replica.cc:333] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10: stopping tablet replica
I20260709 12:20:16.765915  6874 raft_consensus.cc:2243] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.766336  6874 raft_consensus.cc:2272] T 4e59822f776b4925a249e0cd1b51c97b P a1e863a2230e4fe79cc07fef58224f10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.855922  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
I20260709 12:20:16.875237  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
I20260709 12:20:16.904124  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:16.904976  6874 tablet_replica.cc:333] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.905646  6874 raft_consensus.cc:2243] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.906229  6874 raft_consensus.cc:2272] T 8e426de0ec3444d49fc5846d940bee83 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.908203  6874 tablet_replica.cc:333] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.908888  6874 raft_consensus.cc:2243] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.909479  6874 raft_consensus.cc:2272] T 5af75c170b704f5cb078c1cc2ad8bf1e P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.911309  6874 tablet_replica.cc:333] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.911868  6874 raft_consensus.cc:2243] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.912349  6874 raft_consensus.cc:2272] T 4e59822f776b4925a249e0cd1b51c97b P 4237bc43193843ec9b979941d42a8ef6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.914183  6874 tablet_replica.cc:333] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.914687  6874 raft_consensus.cc:2243] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.915154  6874 raft_consensus.cc:2272] T 6b179857ac674094b5c1daf045cfad56 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.917037  6874 tablet_replica.cc:333] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.917555  6874 raft_consensus.cc:2243] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.918362  6874 raft_consensus.cc:2272] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.920219  6874 tablet_replica.cc:333] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.920841  6874 raft_consensus.cc:2243] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.921681  6874 raft_consensus.cc:2272] T daeb8f26b40d4152819e29cd3c969027 P 4237bc43193843ec9b979941d42a8ef6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.923452  6874 tablet_replica.cc:333] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.924144  6874 raft_consensus.cc:2243] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.924743  6874 raft_consensus.cc:2272] T a957ce44e27646b89bb4775820ba22d5 P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.926891  6874 tablet_replica.cc:333] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.927426  6874 raft_consensus.cc:2243] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.928185  6874 raft_consensus.cc:2272] T e3970471e32e41eda7b03833d187a42b P 4237bc43193843ec9b979941d42a8ef6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.930164  6874 tablet_replica.cc:333] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6: stopping tablet replica
I20260709 12:20:16.930837  6874 raft_consensus.cc:2243] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.931304  6874 raft_consensus.cc:2272] T 59712c2eb557496b94dda1e2000ca268 P 4237bc43193843ec9b979941d42a8ef6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.961073  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
I20260709 12:20:16.979349  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:20:16.995885  7123 consensus_peers.cc:597] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb -> Peer 4237bc43193843ec9b979941d42a8ef6 (127.6.182.130:37709): Couldn't send request to peer 4237bc43193843ec9b979941d42a8ef6. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37709: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:17.009864  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:17.010910  6874 tablet_replica.cc:333] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.011647  6874 raft_consensus.cc:2243] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.012539  6874 raft_consensus.cc:2272] T 8e426de0ec3444d49fc5846d940bee83 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.014518  6874 tablet_replica.cc:333] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.015101  6874 raft_consensus.cc:2243] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.015934  6874 raft_consensus.cc:2272] T 5af75c170b704f5cb078c1cc2ad8bf1e P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.017899  6874 tablet_replica.cc:333] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.018451  6874 raft_consensus.cc:2243] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.018944  6874 raft_consensus.cc:2272] T 59712c2eb557496b94dda1e2000ca268 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.020939  6874 tablet_replica.cc:333] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.021550  6874 raft_consensus.cc:2243] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.022358  6874 raft_consensus.cc:2272] T 4e59822f776b4925a249e0cd1b51c97b P 23227d866f6a46ef860b1d6477ab10fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.024194  6874 tablet_replica.cc:333] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.024789  6874 raft_consensus.cc:2243] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.025327  6874 raft_consensus.cc:2272] T 6b179857ac674094b5c1daf045cfad56 P 23227d866f6a46ef860b1d6477ab10fb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.027001  6874 tablet_replica.cc:333] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.027554  6874 raft_consensus.cc:2243] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.028038  6874 raft_consensus.cc:2272] T daeb8f26b40d4152819e29cd3c969027 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.029794  6874 tablet_replica.cc:333] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.030310  6874 raft_consensus.cc:2243] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.030799  6874 raft_consensus.cc:2272] T 0dcf2de2a42f4eb2a6f3b2c3d4d10860 P 23227d866f6a46ef860b1d6477ab10fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.032559  6874 tablet_replica.cc:333] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.033102  6874 raft_consensus.cc:2243] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.033535  6874 raft_consensus.cc:2272] T a957ce44e27646b89bb4775820ba22d5 P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.035202  6874 tablet_replica.cc:333] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb: stopping tablet replica
I20260709 12:20:17.035682  6874 raft_consensus.cc:2243] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.036139  6874 raft_consensus.cc:2272] T e3970471e32e41eda7b03833d187a42b P 23227d866f6a46ef860b1d6477ab10fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.065814  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:20:17.087035  6874 master.cc:562] Master@127.6.182.190:44377 shutting down...
I20260709 12:20:17.235869  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.236572  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.237004  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8e6ebfec586749ddbca2317816a21e97: stopping tablet replica
I20260709 12:20:17.257092  6874 master.cc:584] Master@127.6.182.190:44377 shutdown complete.
23227d866f6a46ef860b1d6477ab10fb  1
4237bc43193843ec9b979941d42a8ef6  4
a1e863a2230e4fe79cc07fef58224f10  4
23227d866f6a46ef860b1d6477ab10fb  3
4237bc43193843ec9b979941d42a8ef6  3
a1e863a2230e4fe79cc07fef58224f10  3
23227d866f6a46ef860b1d6477ab10fb  1
4237bc43193843ec9b979941d42a8ef6  8
a1e863a2230e4fe79cc07fef58224f10  0
23227d866f6a46ef860b1d6477ab10fb  3
4237bc43193843ec9b979941d42a8ef6  3
a1e863a2230e4fe79cc07fef58224f10  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31321 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:20:17.301599  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:41955
I20260709 12:20:17.302772  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.308702  7416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.308821  7417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.310704  7419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.311417  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:17.312443  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.312913  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.313097  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599617313057 us; error 0 us; skew 500 ppm
I20260709 12:20:17.313666  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.316723  6874 webserver.cc:533] Webserver started at http://127.6.182.190:40419/ using document root <none> and password file <none>
I20260709 12:20:17.317265  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.317463  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.317801  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.319056  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "1b891824287644fa87a570ffba5ff98c"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.324307  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:20:17.327765  7424 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.328565  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:17.328866  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "1b891824287644fa87a570ffba5ff98c"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.329155  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.345993  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.347177  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.386296  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:41955
I20260709 12:20:17.386402  7476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:41955 every 8 connection(s)
I20260709 12:20:17.390215  7477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.399761  7477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c: Bootstrap starting.
I20260709 12:20:17.404281  7477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:17.408810  7477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c: No bootstrap required, opened a new log
I20260709 12:20:17.411010  7477 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER }
I20260709 12:20:17.411458  7477 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:17.411640  7477 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b891824287644fa87a570ffba5ff98c, State: Initialized, Role: FOLLOWER
I20260709 12:20:17.412220  7477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER }
I20260709 12:20:17.412739  7477 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:17.412990  7477 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:17.413271  7477 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:17.417250  7477 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER }
I20260709 12:20:17.417800  7477 leader_election.cc:304] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b891824287644fa87a570ffba5ff98c; no voters: 
I20260709 12:20:17.418908  7477 leader_election.cc:290] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:17.419346  7480 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:17.420684  7480 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 1 LEADER]: Becoming Leader. State: Replica: 1b891824287644fa87a570ffba5ff98c, State: Running, Role: LEADER
I20260709 12:20:17.421411  7480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER }
I20260709 12:20:17.421929  7477 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:17.427243  7482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b891824287644fa87a570ffba5ff98c. Latest consensus state: current_term: 1 leader_uuid: "1b891824287644fa87a570ffba5ff98c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER } }
I20260709 12:20:17.427454  7481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b891824287644fa87a570ffba5ff98c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b891824287644fa87a570ffba5ff98c" member_type: VOTER } }
I20260709 12:20:17.428194  7482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:17.428335  7481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:17.431640  7488 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:17.437352  7488 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:17.439388  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:17.446758  7488 catalog_manager.cc:1383] Generated new cluster ID: 80941f14a7584fb39a848eb9d2b0ff28
I20260709 12:20:17.447079  7488 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:17.464354  7488 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:17.465802  7488 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:17.482614  7488 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c: Generated new TSK 0
I20260709 12:20:17.483245  7488 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:17.506004  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.511816  7498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.513159  7499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.515199  6874 server_base.cc:1061] running on GCE node
W20260709 12:20:17.515853  7501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.517083  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.517266  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.517385  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599617517374 us; error 0 us; skew 500 ppm
I20260709 12:20:17.517864  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.520246  6874 webserver.cc:533] Webserver started at http://127.6.182.129:42849/ using document root <none> and password file <none>
I20260709 12:20:17.520759  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.520920  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.521139  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.522118  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "f8f799046a1f4e40ae4e33d13af83953"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.526805  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:17.529954  7506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.530783  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:17.531080  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "f8f799046a1f4e40ae4e33d13af83953"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.531369  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.564582  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.565980  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.567699  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.570215  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.570451  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.570730  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.570945  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.615255  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:39597
I20260709 12:20:17.615355  7569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:39597 every 8 connection(s)
I20260709 12:20:17.620551  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.628194  7574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.630736  7575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.633056  7577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.633231  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:17.634729  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.634967  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.635164  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599617635145 us; error 0 us; skew 500 ppm
I20260709 12:20:17.635707  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.638154  7570 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41955
I20260709 12:20:17.638551  7570 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.639346  7570 heartbeater.cc:507] Master 127.6.182.190:41955 requested a full tablet report, sending...
I20260709 12:20:17.640466  6874 webserver.cc:533] Webserver started at http://127.6.182.130:41637/ using document root <none> and password file <none>
I20260709 12:20:17.641166  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.641404  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.641749  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.641870  7441 ts_manager.cc:194] Registered new tserver with Master: f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:17.643337  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "8b027e982ddc4e5da07185c4fb573a41"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.644342  7441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52580
I20260709 12:20:17.648389  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:20:17.651886  7582 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.652767  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:17.653018  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "8b027e982ddc4e5da07185c4fb573a41"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.653255  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.676047  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.677363  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.678776  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.681061  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.681238  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.681535  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.681702  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.722355  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:38113
I20260709 12:20:17.722563  7644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:38113 every 8 connection(s)
I20260709 12:20:17.727273  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.734236  7648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.735544  7649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.738919  6874 server_base.cc:1061] running on GCE node
W20260709 12:20:17.739719  7652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.740726  7645 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41955
I20260709 12:20:17.740803  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.741104  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.741199  7645 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.741321  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599617741300 us; error 0 us; skew 500 ppm
I20260709 12:20:17.742110  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.742110  7645 heartbeater.cc:507] Master 127.6.182.190:41955 requested a full tablet report, sending...
I20260709 12:20:17.744880  7441 ts_manager.cc:194] Registered new tserver with Master: 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:17.746721  7441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52586
I20260709 12:20:17.755278  6874 webserver.cc:533] Webserver started at http://127.6.182.131:38809/ using document root <none> and password file <none>
I20260709 12:20:17.755992  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.756219  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.756524  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.757721  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "9077d758a024412c81e46e6e70b1776b"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.762115  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:17.765548  7656 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.766390  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:17.766739  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "9077d758a024412c81e46e6e70b1776b"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-lgtn"
I20260709 12:20:17.767040  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.779604  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.780844  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.782326  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.784533  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.784777  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.785032  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.785225  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.826126  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:40469
I20260709 12:20:17.826242  7719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:40469 every 8 connection(s)
I20260709 12:20:17.841463  7720 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41955
I20260709 12:20:17.841898  7720 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.842708  7720 heartbeater.cc:507] Master 127.6.182.190:41955 requested a full tablet report, sending...
I20260709 12:20:17.844938  7441 ts_manager.cc:194] Registered new tserver with Master: 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:17.846066  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016062594s
I20260709 12:20:17.846755  7441 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52602
I20260709 12:20:17.873507  7441 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:17.876513  7441 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:17.955664  7610 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3bdc5a251640e983b1173e37916e71 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:17.956055  7609 tablet_service.cc:1511] Processing CreateTablet for tablet ace18299ed794156a8a117ae7c498749 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:17.957405  7610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3bdc5a251640e983b1173e37916e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.958746  7608 tablet_service.cc:1511] Processing CreateTablet for tablet 689ea4d4885a4e5297ce8d23ff73fe62 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:17.960134  7608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ea4d4885a4e5297ce8d23ff73fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.965626  7607 tablet_service.cc:1511] Processing CreateTablet for tablet b4c5ea23ca3543e4bff5af29c9da3b0e (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:17.967041  7607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c5ea23ca3543e4bff5af29c9da3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.969866  7606 tablet_service.cc:1511] Processing CreateTablet for tablet 633856abb5bb40deb84581cff8dc3ad0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:17.971267  7606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633856abb5bb40deb84581cff8dc3ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.973515  7605 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd967393ef54cb783caf8d6c5959eec (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:17.975930  7533 tablet_service.cc:1511] Processing CreateTablet for tablet ace18299ed794156a8a117ae7c498749 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:17.978582  7532 tablet_service.cc:1511] Processing CreateTablet for tablet 689ea4d4885a4e5297ce8d23ff73fe62 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:17.979897  7532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ea4d4885a4e5297ce8d23ff73fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.981767  7527 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4741cce620414184bf42800bb2f7e7 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:17.982380  7603 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4741cce620414184bf42800bb2f7e7 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:17.982177  7604 tablet_service.cc:1511] Processing CreateTablet for tablet 768e8150c17b4f9eb9e33ad38f137271 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:17.984266  7530 tablet_service.cc:1511] Processing CreateTablet for tablet 633856abb5bb40deb84581cff8dc3ad0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:17.986688  7527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4741cce620414184bf42800bb2f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.986392  7534 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3bdc5a251640e983b1173e37916e71 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:17.986564  7528 tablet_service.cc:1511] Processing CreateTablet for tablet 768e8150c17b4f9eb9e33ad38f137271 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:17.987787  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3bdc5a251640e983b1173e37916e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.986399  7531 tablet_service.cc:1511] Processing CreateTablet for tablet b4c5ea23ca3543e4bff5af29c9da3b0e (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:17.989266  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace18299ed794156a8a117ae7c498749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.987541  7529 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd967393ef54cb783caf8d6c5959eec (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:17.990532  7605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd967393ef54cb783caf8d6c5959eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.990864  7531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c5ea23ca3543e4bff5af29c9da3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.994074  7609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace18299ed794156a8a117ae7c498749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.997031  7529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd967393ef54cb783caf8d6c5959eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.001072  7530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633856abb5bb40deb84581cff8dc3ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.005039  7604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768e8150c17b4f9eb9e33ad38f137271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.009050  7603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4741cce620414184bf42800bb2f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.017040  7528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768e8150c17b4f9eb9e33ad38f137271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.021468  7526 tablet_service.cc:1511] Processing CreateTablet for tablet 82f1b8f3553f4b4a81a19e5600a251c0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:18.023317  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f1b8f3553f4b4a81a19e5600a251c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.024422  7677 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4741cce620414184bf42800bb2f7e7 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:18.025974  7677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4741cce620414184bf42800bb2f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.031379  7679 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd967393ef54cb783caf8d6c5959eec (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:18.031891  7680 tablet_service.cc:1511] Processing CreateTablet for tablet 633856abb5bb40deb84581cff8dc3ad0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:18.034082  7678 tablet_service.cc:1511] Processing CreateTablet for tablet 768e8150c17b4f9eb9e33ad38f137271 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:18.035149  7681 tablet_service.cc:1511] Processing CreateTablet for tablet b4c5ea23ca3543e4bff5af29c9da3b0e (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:18.035656  7678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768e8150c17b4f9eb9e33ad38f137271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.041922  7681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c5ea23ca3543e4bff5af29c9da3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.045094  7679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd967393ef54cb783caf8d6c5959eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.037987  7683 tablet_service.cc:1511] Processing CreateTablet for tablet ace18299ed794156a8a117ae7c498749 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:18.049481  7680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633856abb5bb40deb84581cff8dc3ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.039019  7682 tablet_service.cc:1511] Processing CreateTablet for tablet 689ea4d4885a4e5297ce8d23ff73fe62 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:18.040524  7684 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3bdc5a251640e983b1173e37916e71 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:18.078606  7602 tablet_service.cc:1511] Processing CreateTablet for tablet 82f1b8f3553f4b4a81a19e5600a251c0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:18.082090  7602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f1b8f3553f4b4a81a19e5600a251c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.081948  7676 tablet_service.cc:1511] Processing CreateTablet for tablet 82f1b8f3553f4b4a81a19e5600a251c0 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:18.094509  7735 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.056558  7683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace18299ed794156a8a117ae7c498749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.094511  7675 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:18.098348  7607 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:18.099613  7607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.106190  7530 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29 (DEFAULT_TABLE table=test-workload [id=6db5b481f49143628d9deebc3fdf7b32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:18.107553  7530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.119468  7736 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.129067  7682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ea4d4885a4e5297ce8d23ff73fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.132344  7676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f1b8f3553f4b4a81a19e5600a251c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.133077  7675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc9821e8cf543b1a9fe5f3e2037cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.140466  7684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3bdc5a251640e983b1173e37916e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.141315  7735 tablet_bootstrap.cc:654] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.173559  7738 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.186367  7736 tablet_bootstrap.cc:654] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.192569  7738 tablet_bootstrap.cc:654] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.224921  7735 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.225499  7735 ts_tablet_manager.cc:1403] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.131s	user 0.033s	sys 0.048s
I20260709 12:20:18.228789  7735 raft_consensus.cc:359] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.229554  7735 raft_consensus.cc:385] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.229889  7735 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.234238  7736 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.234735  7736 ts_tablet_manager.cc:1403] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.116s	user 0.004s	sys 0.010s
I20260709 12:20:18.230741  7735 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.246524  7736 raft_consensus.cc:359] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.249765  7736 raft_consensus.cc:385] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.250090  7736 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.251008  7736 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.254011  7570 heartbeater.cc:499] Master 127.6.182.190:41955 was elected leader, sending a full tablet report...
I20260709 12:20:18.254623  7736 ts_tablet_manager.cc:1434] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:20:18.254915  7738 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.254981  7735 ts_tablet_manager.cc:1434] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 12:20:18.255530  7738 ts_tablet_manager.cc:1403] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.012s
I20260709 12:20:18.255678  7736 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.256036  7735 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.256940  7645 heartbeater.cc:499] Master 127.6.182.190:41955 was elected leader, sending a full tablet report...
I20260709 12:20:18.262923  7735 tablet_bootstrap.cc:654] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.263245  7738 raft_consensus.cc:359] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.264087  7738 raft_consensus.cc:385] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.264415  7738 raft_consensus.cc:740] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.265455  7738 consensus_queue.cc:260] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.267446  7736 tablet_bootstrap.cc:654] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.275401  7738 ts_tablet_manager.cc:1434] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 12:20:18.275615  7720 heartbeater.cc:499] Master 127.6.182.190:41955 was elected leader, sending a full tablet report...
I20260709 12:20:18.276803  7738 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.285746  7738 tablet_bootstrap.cc:654] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.287424  7736 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.288018  7736 ts_tablet_manager.cc:1403] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:20:18.291392  7736 raft_consensus.cc:359] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.292232  7736 raft_consensus.cc:385] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.292613  7736 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.293704  7736 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.296350  7736 ts_tablet_manager.cc:1434] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:20:18.297442  7736 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.304502  7736 tablet_bootstrap.cc:654] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.310791  7738 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.311444  7738 ts_tablet_manager.cc:1403] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.012s
I20260709 12:20:18.311586  7736 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.312098  7736 ts_tablet_manager.cc:1403] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 12:20:18.315315  7738 raft_consensus.cc:359] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.316280  7738 raft_consensus.cc:385] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.316555  7738 raft_consensus.cc:740] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.317342  7738 consensus_queue.cc:260] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.317698  7736 raft_consensus.cc:359] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.318357  7736 raft_consensus.cc:385] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.318508  7735 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.318682  7736 raft_consensus.cc:740] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.319100  7735 ts_tablet_manager.cc:1403] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.032s
I20260709 12:20:18.319475  7738 ts_tablet_manager.cc:1434] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:18.319442  7736 consensus_queue.cc:260] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.320576  7738 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.324268  7736 ts_tablet_manager.cc:1434] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:20:18.324358  7735 raft_consensus.cc:359] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.325223  7735 raft_consensus.cc:385] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.325425  7736 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.325564  7735 raft_consensus.cc:740] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.326705  7735 consensus_queue.cc:260] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.327348  7738 tablet_bootstrap.cc:654] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.329160  7735 ts_tablet_manager.cc:1434] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:20:18.330164  7735 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.337422  7735 tablet_bootstrap.cc:654] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.350035  7736 tablet_bootstrap.cc:654] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.355501  7744 raft_consensus.cc:493] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.355748  7735 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.355805  7738 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.356377  7738 ts_tablet_manager.cc:1403] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.023s
I20260709 12:20:18.356391  7735 ts_tablet_manager.cc:1403] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 12:20:18.356117  7744 raft_consensus.cc:515] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.358681  7738 raft_consensus.cc:359] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.359431  7738 raft_consensus.cc:385] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.359105  7744 leader_election.cc:290] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.360185  7742 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.359917  7738 raft_consensus.cc:740] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.360945  7742 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.364848  7735 raft_consensus.cc:359] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.366607  7735 raft_consensus.cc:385] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.367009  7735 raft_consensus.cc:740] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.366407  7738 consensus_queue.cc:260] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.367841  7736 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.368399  7736 ts_tablet_manager.cc:1403] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 12:20:18.367954  7735 consensus_queue.cc:260] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.373196  7736 raft_consensus.cc:359] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.374008  7736 raft_consensus.cc:385] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.374364  7736 raft_consensus.cc:740] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.375301  7736 consensus_queue.cc:260] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.376735  7742 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.379027  7738 ts_tablet_manager.cc:1434] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:20:18.380779  7735 ts_tablet_manager.cc:1434] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.008s
I20260709 12:20:18.389469  7738 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.390867  7735 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.401090  7744 raft_consensus.cc:493] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.401822  7744 raft_consensus.cc:515] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.404745  7744 leader_election.cc:290] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.408957  7735 tablet_bootstrap.cc:654] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.409051  7738 tablet_bootstrap.cc:654] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.423870  7738 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.424747  7738 ts_tablet_manager.cc:1403] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.004s
I20260709 12:20:18.429771  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.430799  7620 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 0.
I20260709 12:20:18.432472  7738 raft_consensus.cc:359] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.432971  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.433416  7738 raft_consensus.cc:385] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.433900  7738 raft_consensus.cc:740] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
W20260709 12:20:18.434345  7490 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:18.434883  7738 consensus_queue.cc:260] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.435463  7660 leader_election.cc:304] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:18.438964  7744 raft_consensus.cc:2804] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.439087  7738 ts_tablet_manager.cc:1434] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:20:18.439378  7744 raft_consensus.cc:493] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.439927  7744 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.442142  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.443956  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.451598  7744 raft_consensus.cc:515] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.453970  7738 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
W20260709 12:20:18.440016  7660 leader_election.cc:343] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:18.461287  7660 leader_election.cc:343] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.461892  7736 ts_tablet_manager.cc:1434] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.093s	user 0.038s	sys 0.049s
I20260709 12:20:18.463790  7744 leader_election.cc:290] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.463853  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.467490  7738 tablet_bootstrap.cc:654] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:18.467535  7510 leader_election.cc:343] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:18.464571  7660 leader_election.cc:343] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.468677  7660 leader_election.cc:304] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b; no voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:18.470290  7736 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.471683  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:18.472479  7620 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.476833  7744 raft_consensus.cc:2749] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.478842  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.479246  7736 tablet_bootstrap.cc:654] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.480505  7738 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.481164  7738 ts_tablet_manager.cc:1403] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.015s
W20260709 12:20:18.485270  7660 leader_election.cc:343] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.487645  7738 raft_consensus.cc:359] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.488360  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.488670  7738 raft_consensus.cc:385] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.489179  7738 raft_consensus.cc:740] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
W20260709 12:20:18.490327  7508 leader_election.cc:343] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.490243  7738 consensus_queue.cc:260] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.490895  7508 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.491875  7754 raft_consensus.cc:2749] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.491549  7620 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 1.
I20260709 12:20:18.493736  7660 leader_election.cc:304] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:18.494624  7744 raft_consensus.cc:2804] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.496129  7744 raft_consensus.cc:697] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:18.498242  7735 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.497473  7744 consensus_queue.cc:237] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.498744  7735 ts_tablet_manager.cc:1403] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.108s	user 0.027s	sys 0.036s
I20260709 12:20:18.494166  7738 ts_tablet_manager.cc:1434] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:20:18.501794  7738 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.501369  7735 raft_consensus.cc:359] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.503075  7735 raft_consensus.cc:385] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.503410  7735 raft_consensus.cc:740] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.504336  7735 consensus_queue.cc:260] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.505167  7736 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.505843  7736 ts_tablet_manager.cc:1403] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.003s
I20260709 12:20:18.510051  7738 tablet_bootstrap.cc:654] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.509981  7736 raft_consensus.cc:359] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.510974  7736 raft_consensus.cc:385] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.511349  7736 raft_consensus.cc:740] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.512324  7754 raft_consensus.cc:493] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.512925  7754 raft_consensus.cc:515] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.514591  7735 ts_tablet_manager.cc:1434] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:20:18.515515  7754 leader_election.cc:290] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.516803  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace18299ed794156a8a117ae7c498749" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.516757  7736 consensus_queue.cc:260] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
W20260709 12:20:18.518467  7508 leader_election.cc:343] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.518111  7438 catalog_manager.cc:5697] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.521560  7736 ts_tablet_manager.cc:1434] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:20:18.522768  7736 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.523854  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace18299ed794156a8a117ae7c498749" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.524748  7620 raft_consensus.cc:2468] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 0.
I20260709 12:20:18.526141  7510 leader_election.cc:304] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.527449  7754 raft_consensus.cc:2804] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.527894  7754 raft_consensus.cc:493] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.528271  7754 raft_consensus.cc:3060] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.530027  7735 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.538779  7754 raft_consensus.cc:515] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.540547  7741 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.541273  7741 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.541887  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace18299ed794156a8a117ae7c498749" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:18.542620  7620 raft_consensus.cc:3060] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.545730  7741 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.548106  7738 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.554087  7738 ts_tablet_manager.cc:1403] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.053s	user 0.028s	sys 0.015s
I20260709 12:20:18.550994  7741 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.555327  7741 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.557749  7738 raft_consensus.cc:359] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.557756  7741 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469), f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:18.552134  7735 tablet_bootstrap.cc:654] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.558672  7738 raft_consensus.cc:385] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.550022  7736 tablet_bootstrap.cc:654] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.558182  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace18299ed794156a8a117ae7c498749" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
W20260709 12:20:18.560990  7508 leader_election.cc:343] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.553165  7620 raft_consensus.cc:2468] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:18.559562  7738 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.561612  7754 leader_election.cc:290] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.563004  7510 leader_election.cc:304] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.563057  7738 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.564687  7754 raft_consensus.cc:2804] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.567842  7738 ts_tablet_manager.cc:1434] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 12:20:18.566284  7754 raft_consensus.cc:697] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:18.569543  7744 raft_consensus.cc:493] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.570420  7738 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.569906  7754 consensus_queue.cc:237] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.570081  7744 raft_consensus.cc:515] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.572865  7736 tablet_bootstrap.cc:492] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.573022  7744 leader_election.cc:290] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.573565  7736 ts_tablet_manager.cc:1403] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 12:20:18.575474  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.576193  7544 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 0.
I20260709 12:20:18.577281  7736 raft_consensus.cc:359] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.577885  7660 leader_election.cc:304] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:18.578915  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.579185  7736 raft_consensus.cc:385] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.579615  7744 raft_consensus.cc:2804] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.580173  7744 raft_consensus.cc:493] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.580394  7660 leader_election.cc:343] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.580595  7744 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.582541  7735 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.583292  7735 ts_tablet_manager.cc:1403] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.002s
I20260709 12:20:18.578392  7738 tablet_bootstrap.cc:654] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.579665  7736 raft_consensus.cc:740] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.589182  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.590157  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.590337  7736 consensus_queue.cc:260] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
W20260709 12:20:18.591077  7586 leader_election.cc:343] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.590979  7543 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 0.
I20260709 12:20:18.592025  7761 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.588493  7744 raft_consensus.cc:515] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.594065  7761 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.595392  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.595633  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.596122  7695 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 0.
I20260709 12:20:18.596459  7744 leader_election.cc:290] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.598402  7761 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
W20260709 12:20:18.598843  7584 leader_election.cc:343] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.599754  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:18.600143  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.600790  7544 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.601645  7584 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:18.598456  7735 raft_consensus.cc:359] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.603036  7735 raft_consensus.cc:385] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.603449  7735 raft_consensus.cc:740] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.604445  7735 consensus_queue.cc:260] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.604796  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.605491  7741 raft_consensus.cc:2804] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.606598  7741 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.607023  7741 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.607558  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.607636  7586 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
W20260709 12:20:18.610778  7660 leader_election.cc:343] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:18.617730  7660 leader_election.cc:343] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.618291  7544 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 1.
I20260709 12:20:18.618994  7738 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.620095  7660 leader_election.cc:304] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:18.621156  7761 raft_consensus.cc:2804] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.621912  7761 raft_consensus.cc:697] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:18.622074  7438 catalog_manager.cc:5697] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.623937  7738 ts_tablet_manager.cc:1403] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.009s
I20260709 12:20:18.623384  7761 consensus_queue.cc:237] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.629041  7741 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.629899  7773 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.630405  7619 raft_consensus.cc:2393] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9077d758a024412c81e46e6e70b1776b in current term 1: Already voted for candidate 8b027e982ddc4e5da07185c4fb573a41 in this term.
I20260709 12:20:18.628707  7736 ts_tablet_manager.cc:1434] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.004s
I20260709 12:20:18.632419  7735 ts_tablet_manager.cc:1434] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.049s	user 0.023s	sys 0.007s
I20260709 12:20:18.633564  7735 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.634094  7736 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.639348  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:18.640106  7695 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.641055  7735 tablet_bootstrap.cc:654] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.635645  7660 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b; no voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:18.648743  7741 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.630324  7773 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.628271  7738 raft_consensus.cc:359] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.652992  7738 raft_consensus.cc:385] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.653311  7738 raft_consensus.cc:740] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.651571  7773 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.656041  7695 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 1.
I20260709 12:20:18.654359  7738 consensus_queue.cc:260] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.656608  7744 raft_consensus.cc:2749] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:18.658391  7586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:39597, user_credentials={real_user=slave}} blocked reactor thread for 50877.3us
I20260709 12:20:18.663378  7584 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:18.664464  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.664566  7774 raft_consensus.cc:2804] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.665904  7738 ts_tablet_manager.cc:1434] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:20:18.666438  7736 tablet_bootstrap.cc:654] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.666383  7774 raft_consensus.cc:697] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:18.667057  7738 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.667503  7774 consensus_queue.cc:237] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
W20260709 12:20:18.668533  7586 leader_election.cc:343] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.674175  7738 tablet_bootstrap.cc:654] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.678592  7773 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.677440  7735 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.681915  7754 raft_consensus.cc:493] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.682101  7735 ts_tablet_manager.cc:1403] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.015s
I20260709 12:20:18.684695  7773 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Requested vote from peers 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469), f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:18.683014  7754 raft_consensus.cc:515] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.686311  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
W20260709 12:20:18.688203  7584 leader_election.cc:343] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.686241  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.688764  7754 leader_election.cc:290] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.689327  7544 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.688323  7438 catalog_manager.cc:5697] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.691982  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.692140  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.692598  7619 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 0.
W20260709 12:20:18.693986  7508 leader_election.cc:343] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.697268  7735 raft_consensus.cc:359] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.698082  7735 raft_consensus.cc:385] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.698427  7735 raft_consensus.cc:740] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.699365  7735 consensus_queue.cc:260] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.701740  7735 ts_tablet_manager.cc:1434] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:20:18.702478  7510 leader_election.cc:304] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.702782  7735 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.702728  7544 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 1.
I20260709 12:20:18.703401  7754 raft_consensus.cc:2804] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.703766  7754 raft_consensus.cc:493] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.704015  7742 raft_consensus.cc:493] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.703927  7586 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.704725  7742 raft_consensus.cc:515] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.706717  7742 leader_election.cc:290] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.707245  7773 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.707370  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.707769  7773 raft_consensus.cc:697] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:18.708171  7619 raft_consensus.cc:2393] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8f799046a1f4e40ae4e33d13af83953 in current term 1: Already voted for candidate 9077d758a024412c81e46e6e70b1776b in this term.
I20260709 12:20:18.708616  7773 consensus_queue.cc:237] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.704146  7754 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.710201  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.710757  7735 tablet_bootstrap.cc:654] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.707886  7440 catalog_manager.cc:5697] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.712600  7508 leader_election.cc:304] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:18.714567  7742 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.717772  7736 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.718791  7736 ts_tablet_manager.cc:1403] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.003s
I20260709 12:20:18.723402  7736 raft_consensus.cc:359] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.724035  7736 raft_consensus.cc:385] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.726631  7754 raft_consensus.cc:515] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.730175  7738 tablet_bootstrap.cc:492] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.727244  7736 raft_consensus.cc:740] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.728153  7761 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.730449  7742 raft_consensus.cc:2749] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.730640  7738 ts_tablet_manager.cc:1403] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.020s
I20260709 12:20:18.730852  7761 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.733144  7761 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.733547  7738 raft_consensus.cc:359] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.734222  7738 raft_consensus.cc:385] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.734519  7738 raft_consensus.cc:740] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.734757  7440 catalog_manager.cc:5697] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.735313  7738 consensus_queue.cc:260] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.735613  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.736558  7754 leader_election.cc:290] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.735816  7735 tablet_bootstrap.cc:492] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
W20260709 12:20:18.737138  7660 leader_election.cc:343] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.737219  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.737937  7735 ts_tablet_manager.cc:1403] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.006s
I20260709 12:20:18.737999  7544 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 0.
I20260709 12:20:18.738129  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:18.732791  7736 consensus_queue.cc:260] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.739351  7660 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:18.740016  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:18.740494  7761 raft_consensus.cc:2804] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.740816  7736 ts_tablet_manager.cc:1434] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:20:18.740931  7761 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.742887  7761 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.743479  7736 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.738801  7619 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.741437  7695 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.750927  7736 tablet_bootstrap.cc:654] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.751839  7695 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:18.753168  7508 leader_election.cc:304] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:18.754082  7754 raft_consensus.cc:2804] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.754562  7754 raft_consensus.cc:697] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:18.755398  7754 consensus_queue.cc:237] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.741743  7735 raft_consensus.cc:359] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.756613  7735 raft_consensus.cc:385] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.757066  7735 raft_consensus.cc:740] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.759240  7744 raft_consensus.cc:493] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.759850  7744 raft_consensus.cc:515] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.762045  7744 leader_election.cc:290] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.761559  7735 consensus_queue.cc:260] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.762760  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.764199  7735 ts_tablet_manager.cc:1434] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
W20260709 12:20:18.764596  7660 leader_election.cc:343] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.764285  7761 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.765345  7735 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.766396  7761 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:18.767208  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:18.769209  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.769387  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:18.769798  7544 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:18.770756  7660 leader_election.cc:343] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.771179  7660 leader_election.cc:304] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b; no voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953
W20260709 12:20:18.772322  7660 leader_election.cc:343] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.773006  7761 raft_consensus.cc:2749] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.774677  7619 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:18.776077  7738 ts_tablet_manager.cc:1434] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:20:18.776849  7738 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.779053  7736 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.779515  7736 ts_tablet_manager.cc:1403] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.007s
I20260709 12:20:18.782236  7736 raft_consensus.cc:359] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.782943  7736 raft_consensus.cc:385] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.783212  7736 raft_consensus.cc:740] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.783967  7736 consensus_queue.cc:260] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.785285  7735 tablet_bootstrap.cc:654] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.786280  7736 ts_tablet_manager.cc:1434] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:18.787184  7736 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.783972  7439 catalog_manager.cc:5697] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.789001  7754 raft_consensus.cc:493] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.789707  7738 tablet_bootstrap.cc:654] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.789456  7754 raft_consensus.cc:515] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.791766  7754 leader_election.cc:290] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.792899  7736 tablet_bootstrap.cc:654] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.793854  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.794677  7695 raft_consensus.cc:2468] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 0.
I20260709 12:20:18.796311  7508 leader_election.cc:304] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:18.799244  7544 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 1.
I20260709 12:20:18.799971  7754 raft_consensus.cc:2804] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.800513  7754 raft_consensus.cc:493] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.801052  7754 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.800793  7660 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:18.802192  7761 raft_consensus.cc:2804] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.802976  7761 raft_consensus.cc:697] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:18.804032  7761 consensus_queue.cc:237] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.818030  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
W20260709 12:20:18.825050  7510 leader_election.cc:343] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.829061  7736 tablet_bootstrap.cc:492] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.829524  7736 ts_tablet_manager.cc:1403] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.020s
I20260709 12:20:18.831918  7736 raft_consensus.cc:359] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.832602  7736 raft_consensus.cc:385] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.832957  7736 raft_consensus.cc:740] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.833891  7736 consensus_queue.cc:260] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.833400  7754 raft_consensus.cc:515] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.839118  7736 ts_tablet_manager.cc:1434] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 12:20:18.839818  7721 tablet.cc:2406] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:18.840106  7736 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: Bootstrap starting.
I20260709 12:20:18.840143  7439 catalog_manager.cc:5697] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.845923  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
W20260709 12:20:18.847414  7510 leader_election.cc:343] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.849661  7738 tablet_bootstrap.cc:492] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.850152  7738 ts_tablet_manager.cc:1403] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.006s
I20260709 12:20:18.850522  7736 tablet_bootstrap.cc:654] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.853109  7738 raft_consensus.cc:359] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.853813  7738 raft_consensus.cc:385] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.854066  7738 raft_consensus.cc:740] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.854774  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:18.855381  7695 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.855127  7738 consensus_queue.cc:260] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.857996  7735 tablet_bootstrap.cc:492] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.858057  7738 ts_tablet_manager.cc:1434] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:18.858522  7735 ts_tablet_manager.cc:1403] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.093s	user 0.025s	sys 0.017s
I20260709 12:20:18.855804  7736 tablet_bootstrap.cc:492] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: No bootstrap required, opened a new log
I20260709 12:20:18.859061  7738 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: Bootstrap starting.
I20260709 12:20:18.859325  7736 ts_tablet_manager.cc:1403] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 12:20:18.859786  7754 leader_election.cc:290] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.864019  7736 raft_consensus.cc:359] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.864733  7736 raft_consensus.cc:385] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.865010  7736 raft_consensus.cc:740] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.865247  7738 tablet_bootstrap.cc:654] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.865741  7736 consensus_queue.cc:260] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.865690  7695 raft_consensus.cc:2468] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:18.867492  7508 leader_election.cc:304] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:18.868103  7736 ts_tablet_manager.cc:1434] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:18.868780  7754 raft_consensus.cc:2804] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.868597  7735 raft_consensus.cc:359] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.869341  7735 raft_consensus.cc:385] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.869544  7754 raft_consensus.cc:697] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:18.869640  7735 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.870375  7735 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.870487  7754 consensus_queue.cc:237] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.871604  7774 raft_consensus.cc:493] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.872064  7774 raft_consensus.cc:515] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.874521  7774 leader_election.cc:290] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.876618  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.876827  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.877311  7544 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 0.
I20260709 12:20:18.877465  7695 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 0.
I20260709 12:20:18.878719  7584 leader_election.cc:304] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:18.879858  7774 raft_consensus.cc:2804] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.880172  7774 raft_consensus.cc:493] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.880465  7774 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.880903  7738 tablet_bootstrap.cc:492] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: No bootstrap required, opened a new log
I20260709 12:20:18.881237  7738 ts_tablet_manager.cc:1403] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:20:18.883517  7738 raft_consensus.cc:359] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.884174  7738 raft_consensus.cc:385] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.884436  7738 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.885169  7738 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:18.887157  7735 ts_tablet_manager.cc:1434] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.006s
I20260709 12:20:18.887265  7738 ts_tablet_manager.cc:1434] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:18.888298  7735 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.891793  7774 raft_consensus.cc:515] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.891867  7439 catalog_manager.cc:5697] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.894791  7735 tablet_bootstrap.cc:654] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.895005  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:18.895292  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:18.895663  7544 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.895910  7695 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.903230  7544 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 1.
I20260709 12:20:18.904600  7586 leader_election.cc:304] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:18.904767  7774 leader_election.cc:290] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.905580  7774 raft_consensus.cc:2804] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.908670  7774 raft_consensus.cc:697] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:18.909888  7774 consensus_queue.cc:237] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.912583  7695 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 1.
I20260709 12:20:18.913607  7735 tablet_bootstrap.cc:492] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.914134  7735 ts_tablet_manager.cc:1403] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.013s
I20260709 12:20:18.917856  7761 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:18.917479  7735 raft_consensus.cc:359] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.918479  7735 raft_consensus.cc:385] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.918799  7735 raft_consensus.cc:740] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.919549  7735 consensus_queue.cc:260] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.921679  7735 ts_tablet_manager.cc:1434] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:18.922696  7735 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: Bootstrap starting.
I20260709 12:20:18.929391  7735 tablet_bootstrap.cc:654] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.928930  7439 catalog_manager.cc:5697] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.944340  7735 tablet_bootstrap.cc:492] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: No bootstrap required, opened a new log
I20260709 12:20:18.944772  7774 raft_consensus.cc:493] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.945204  7735 ts_tablet_manager.cc:1403] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 12:20:18.945283  7774 raft_consensus.cc:515] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.945551  7761 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:18.947429  7774 leader_election.cc:290] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:18.947877  7735 raft_consensus.cc:359] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.948617  7735 raft_consensus.cc:385] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.949035  7735 raft_consensus.cc:740] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.949764  7735 consensus_queue.cc:260] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:18.950892  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:18.951293  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:18.951680  7695 raft_consensus.cc:2393] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b027e982ddc4e5da07185c4fb573a41 in current term 1: Already voted for candidate f8f799046a1f4e40ae4e33d13af83953 in this term.
I20260709 12:20:18.952183  7735 ts_tablet_manager.cc:1434] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:18.953073  7584 leader_election.cc:304] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41; no voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:18.953820  7774 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.959265  7774 raft_consensus.cc:2749] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.028102  7695 raft_consensus.cc:3060] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.029768  7754 consensus_queue.cc:1048] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.035614  7754 consensus_queue.cc:1048] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.054680  7797 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.065485  7619 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.073230  7744 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.116814  7744 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.116793  7801 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.117594  7744 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:19.117722  7774 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.117715  7801 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.119851  7744 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:19.120872  7801 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.120930  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:19.121392  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:19.122279  7695 raft_consensus.cc:2393] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8f799046a1f4e40ae4e33d13af83953 in current term 1: Already voted for candidate 8b027e982ddc4e5da07185c4fb573a41 in this term.
I20260709 12:20:19.122143  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:19.122181  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:19.124001  7510 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8f799046a1f4e40ae4e33d13af83953; no voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:19.124646  7660 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b; no voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.124821  7754 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.125799  7744 raft_consensus.cc:2749] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.133435  7754 raft_consensus.cc:2749] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.133724  7695 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.144134  7806 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.146049  7806 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.158936  7773 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.209658  7754 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.220145  7801 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.268959  7801 raft_consensus.cc:493] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.269472  7801 raft_consensus.cc:515] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.271176  7801 leader_election.cc:290] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.272167  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:19.272059  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41" is_pre_election: true
I20260709 12:20:19.272866  7695 raft_consensus.cc:2468] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 0.
I20260709 12:20:19.272943  7619 raft_consensus.cc:2468] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 0.
I20260709 12:20:19.273998  7508 leader_election.cc:304] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.274715  7801 raft_consensus.cc:2804] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.275094  7801 raft_consensus.cc:493] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.275415  7801 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.276808  7773 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.277329  7773 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.280157  7619 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.280140  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f799046a1f4e40ae4e33d13af83953" is_pre_election: true
I20260709 12:20:19.281143  7544 raft_consensus.cc:2393] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b027e982ddc4e5da07185c4fb573a41 in current term 1: Already voted for candidate 9077d758a024412c81e46e6e70b1776b in this term.
I20260709 12:20:19.281747  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b" is_pre_election: true
I20260709 12:20:19.281965  7801 raft_consensus.cc:515] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.281103  7773 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.283262  7584 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41; no voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.284083  7801 leader_election.cc:290] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.284919  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.285403  7620 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.287411  7773 raft_consensus.cc:2749] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.288518  7744 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.289183  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.289937  7695 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.290875  7620 raft_consensus.cc:2468] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:19.292063  7510 leader_election.cc:304] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.292991  7801 raft_consensus.cc:2804] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.293715  7801 raft_consensus.cc:697] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.294544  7801 consensus_queue.cc:237] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.297612  7695 raft_consensus.cc:2468] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 1.
I20260709 12:20:19.304178  7797 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.313442  7438 catalog_manager.cc:5697] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.330977  7773 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.338140  7620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:37194
I20260709 12:20:19.338860  7620 raft_consensus.cc:606] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.345037  7806 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.346441  7742 consensus_queue.cc:1048] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.362519  7620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:37194
I20260709 12:20:19.363153  7620 raft_consensus.cc:606] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.375671  7754 consensus_queue.cc:1048] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.384058  7695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:53428
I20260709 12:20:19.384599  7695 raft_consensus.cc:606] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.390309  7695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:53428
I20260709 12:20:19.390801  7695 raft_consensus.cc:606] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:19.395582  7695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
mode: GRACEFUL
new_leader_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:53428
I20260709 12:20:19.396121  7695 raft_consensus.cc:606] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Received request to transfer leadership to TS 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:19.408826  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:40168
I20260709 12:20:19.409358  7544 raft_consensus.cc:606] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Received request to transfer leadership to TS 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:19.417548  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:40168
I20260709 12:20:19.418116  7544 raft_consensus.cc:606] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Received request to transfer leadership to TS 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:19.422863  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:40168
I20260709 12:20:19.423416  7544 raft_consensus.cc:606] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Received request to transfer leadership to TS 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:19.501814  7797 raft_consensus.cc:993] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: : Instructing follower 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.502364  7761 raft_consensus.cc:1081] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Signalling peer 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.503986  7620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:37178
I20260709 12:20:19.504580  7620 raft_consensus.cc:493] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.505018  7620 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.510517  7620 raft_consensus.cc:515] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.512081  7620 leader_election.cc:290] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.512962  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:19.513191  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.513631  7544 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.513702  7695 raft_consensus.cc:3055] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.514087  7695 raft_consensus.cc:740] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:19.514873  7695 consensus_queue.cc:260] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.515975  7695 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.519413  7544 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 2.
I20260709 12:20:19.520779  7586 leader_election.cc:304] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.521584  7806 raft_consensus.cc:2804] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.521749  7695 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 2.
I20260709 12:20:19.521986  7806 raft_consensus.cc:697] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:19.522859  7806 consensus_queue.cc:237] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.529138  7441 catalog_manager.cc:5697] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 1 to 2, leader changed from 9077d758a024412c81e46e6e70b1776b (127.6.182.131) to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.539040  7744 raft_consensus.cc:993] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.539531  7761 raft_consensus.cc:1081] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.541121  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40146
I20260709 12:20:19.541678  7544 raft_consensus.cc:493] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.542029  7544 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.547297  7544 raft_consensus.cc:515] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.549418  7544 leader_election.cc:290] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.550390  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.550683  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.551110  7620 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.551362  7695 raft_consensus.cc:3055] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.551752  7695 raft_consensus.cc:740] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:19.552518  7695 consensus_queue.cc:260] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.553587  7695 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.556566  7620 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.557839  7510 leader_election.cc:304] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.558609  7754 raft_consensus.cc:2804] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.559039  7695 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.559118  7754 raft_consensus.cc:697] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.560127  7754 consensus_queue.cc:237] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.567366  7441 catalog_manager.cc:5697] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 1 to 2, leader changed from 9077d758a024412c81e46e6e70b1776b (127.6.182.131) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.689291  7744 raft_consensus.cc:993] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.689766  7761 raft_consensus.cc:1081] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.691438  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40146
I20260709 12:20:19.692008  7544 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.692337  7544 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.697068  7544 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.698711  7544 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.699661  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.699790  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.700354  7620 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.700439  7695 raft_consensus.cc:3055] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.700819  7695 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:19.701519  7695 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.702415  7695 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.707340  7620 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.708647  7510 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.709112  7695 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.709632  7754 raft_consensus.cc:2804] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.710145  7754 raft_consensus.cc:697] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.711302  7754 consensus_queue.cc:237] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.718652  7441 catalog_manager.cc:5697] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 1 to 2, leader changed from 9077d758a024412c81e46e6e70b1776b (127.6.182.131) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.722251  7806 raft_consensus.cc:993] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.722802  7773 raft_consensus.cc:1081] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.724615  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40162
I20260709 12:20:19.725688  7544 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.726620  7544 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.729453  7741 raft_consensus.cc:993] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.729933  7773 raft_consensus.cc:1081] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:19.731796  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40162
I20260709 12:20:19.732419  7543 raft_consensus.cc:493] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.732954  7543 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.736115  7544 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:19.738591  7544 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.739216  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.739833  7620 raft_consensus.cc:3055] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.740170  7620 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:19.740428  7543 raft_consensus.cc:515] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.740998  7620 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:19.741822  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.742336  7620 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.742411  7695 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.744191  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.744794  7619 raft_consensus.cc:3055] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.744839  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.745182  7619 raft_consensus.cc:740] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:19.745527  7694 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.746055  7619 consensus_queue.cc:260] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.747632  7619 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.750512  7620 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.753417  7694 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.753875  7695 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.754258  7543 leader_election.cc:290] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.754844  7508 leader_election.cc:304] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.755767  7619 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:19.755802  7754 raft_consensus.cc:2804] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.756433  7754 raft_consensus.cc:697] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.754232  7510 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:19.757529  7754 consensus_queue.cc:237] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.758440  7801 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.758994  7801 raft_consensus.cc:697] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.759792  7801 consensus_queue.cc:237] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:19.762084  7742 consensus_queue.cc:1048] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.766489  7440 catalog_manager.cc:5697] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 1 to 2, leader changed from 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.770033  7742 raft_consensus.cc:993] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.770473  7742 raft_consensus.cc:1081] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Signalling peer 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.773432  7620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:37168
I20260709 12:20:19.774228  7620 raft_consensus.cc:493] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.775017  7620 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.779042  7754 consensus_queue.cc:1048] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.781431  7620 raft_consensus.cc:515] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.784343  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:19.785048  7543 raft_consensus.cc:3055] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.785385  7543 raft_consensus.cc:740] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.785246  7440 catalog_manager.cc:5697] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 1 to 2, leader changed from 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.787318  7543 consensus_queue.cc:260] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.787779  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f1b8f3553f4b4a81a19e5600a251c0" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.788295  7543 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.792687  7620 leader_election.cc:290] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.793992  7543 raft_consensus.cc:2468] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 2.
I20260709 12:20:19.795173  7586 leader_election.cc:304] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:19.796209  7773 raft_consensus.cc:2804] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.796706  7773 raft_consensus.cc:697] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:19.797508  7773 consensus_queue.cc:237] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.805447  7742 raft_consensus.cc:993] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:19.805929  7742 raft_consensus.cc:1081] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Signalling peer 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:19.808939  7695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:53420
I20260709 12:20:19.809598  7695 raft_consensus.cc:493] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.810032  7695 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.809685  7440 catalog_manager.cc:5697] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 1 to 2, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.815431  7695 raft_consensus.cc:515] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.816993  7695 leader_election.cc:290] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 2 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:19.818313  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:19.818288  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc9821e8cf543b1a9fe5f3e2037cc29" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:19.819046  7543 raft_consensus.cc:3055] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.819099  7620 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.819523  7543 raft_consensus.cc:740] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.820489  7543 consensus_queue.cc:260] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.821715  7543 raft_consensus.cc:3060] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.826488  7620 raft_consensus.cc:2468] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 2.
I20260709 12:20:19.827709  7660 leader_election.cc:304] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:19.828559  7761 raft_consensus.cc:2804] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.828775  7543 raft_consensus.cc:2468] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 2.
I20260709 12:20:19.829054  7761 raft_consensus.cc:697] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 2 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:19.829924  7761 consensus_queue.cc:237] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.835965  7742 raft_consensus.cc:993] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.836434  7754 raft_consensus.cc:1081] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Signalling peer 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:19.837006  7440 catalog_manager.cc:5697] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 1 to 2, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 2 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.838203  7620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:37168
I20260709 12:20:19.838757  7620 raft_consensus.cc:493] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.839461  7620 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.845072  7620 raft_consensus.cc:515] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.846788  7620 leader_election.cc:290] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:19.847878  7695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:19.848318  7695 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.848747  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:19.849303  7543 raft_consensus.cc:3055] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.849578  7543 raft_consensus.cc:740] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:19.850273  7543 consensus_queue.cc:260] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.851280  7543 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.852826  7695 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 2.
I20260709 12:20:19.853735  7584 leader_election.cc:304] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:19.854413  7806 raft_consensus.cc:2804] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.854820  7806 raft_consensus.cc:697] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:19.855511  7806 consensus_queue.cc:237] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:19.856427  7543 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 2.
I20260709 12:20:19.861573  7440 catalog_manager.cc:5697] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 1 to 2, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.940587  7695 raft_consensus.cc:1275] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.942135  7806 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.949635  7543 raft_consensus.cc:1275] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.951335  7773 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.118854  7695 raft_consensus.cc:1275] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.120144  7754 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.130479  7620 raft_consensus.cc:1275] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.132108  7801 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.148810  7695 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.150080  7801 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.159514  7620 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.161144  7801 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.213464  7620 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.214711  7801 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.222358  7695 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.223598  7754 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.289387  7695 raft_consensus.cc:1275] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.290795  7773 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.296841  7543 raft_consensus.cc:1275] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.298719  7806 consensus_queue.cc:1048] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.300172  7543 raft_consensus.cc:1275] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.300772  7695 raft_consensus.cc:1275] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.302289  7831 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.304872  7754 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.315128  7695 raft_consensus.cc:3060] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.322526  7695 raft_consensus.cc:1275] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.323796  7620 raft_consensus.cc:1275] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.324173  7831 consensus_queue.cc:1048] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.325662  7801 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.372243  7544 raft_consensus.cc:1275] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.373659  7761 consensus_queue.cc:1048] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.383432  7620 raft_consensus.cc:1275] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.385069  7761 consensus_queue.cc:1048] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.455992  6874 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:20:22.456682  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:22.472458  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:22.473057  7543 raft_consensus.cc:606] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Received request to transfer leadership to TS 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:22.475587  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:22.476161  7543 raft_consensus.cc:606] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Received request to transfer leadership to TS 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:22.477341  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:22.477945  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:22.856141  7754 raft_consensus.cc:993] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:22.856658  7842 raft_consensus.cc:1081] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Signalling peer 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:22.858095  7695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:53420
I20260709 12:20:22.858487  7695 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.858713  7695 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.862795  7695 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:22.864084  7695 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:22.865015  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:22.865254  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:22.865625  7543 raft_consensus.cc:3055] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:22.865720  7620 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.865983  7543 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:22.866755  7543 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:22.867894  7543 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.872049  7620 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:22.873332  7660 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:22.874032  7838 raft_consensus.cc:2804] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:22.874145  7543 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:22.875100  7838 raft_consensus.cc:697] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:22.876461  7838 consensus_queue.cc:237] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:22.886098  7440 catalog_manager.cc:5697] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 2 to 3, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 3 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.899099  7754 raft_consensus.cc:993] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:22.899539  7842 raft_consensus.cc:1081] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Signalling peer 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:22.901144  7695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:53420
I20260709 12:20:22.901564  7695 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.901834  7695 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.906009  7695 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:22.907308  7695 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:22.908144  7620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:22.908428  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:22.908695  7620 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.909049  7543 raft_consensus.cc:3055] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:22.909327  7543 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:22.910008  7543 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:22.910894  7543 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.912864  7620 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:22.913774  7660 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:22.914438  7838 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:22.914844  7838 raft_consensus.cc:697] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:22.915597  7838 consensus_queue.cc:237] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:22.916064  7543 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:22.922233  7440 catalog_manager.cc:5697] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 2 to 3, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 3 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.380609  7543 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.382196  7838 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.393144  7620 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.394942  7838 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.408336  7543 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.409828  7844 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.420519  7620 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.421998  7838 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.478972  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:23.484617  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:23.485118  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:24.486176  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:24.491701  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:24.492156  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:25.493247  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:25.498787  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:25.499251  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:26.500475  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.506641  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:26.507138  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:27.508249  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.515350  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:27.515782  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:28.516713  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:28.522302  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:28.522709  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:29.523669  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.530576  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:29.531092  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:30.532276  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.538678  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:30.539196  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:31.540151  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.546555  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:31.547108  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:32.579114  6874 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:20:32.584342  7695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:53428
I20260709 12:20:32.585358  7695 raft_consensus.cc:606] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:32.600257  7694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:53428
I20260709 12:20:32.600893  7694 raft_consensus.cc:606] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:32.606066  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:37194
I20260709 12:20:32.606675  7619 raft_consensus.cc:606] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:32.612115  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:37194
I20260709 12:20:32.612619  7619 raft_consensus.cc:606] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:32.617561  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
mode: GRACEFUL
new_leader_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:37194
I20260709 12:20:32.618040  7619 raft_consensus.cc:606] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Received request to transfer leadership to TS f8f799046a1f4e40ae4e33d13af83953
I20260709 12:20:32.702150  7873 raft_consensus.cc:993] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.702600  7873 raft_consensus.cc:1081] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.704098  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40162
I20260709 12:20:32.704519  7543 raft_consensus.cc:493] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.704797  7543 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.710167  7543 raft_consensus.cc:515] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.711892  7543 leader_election.cc:290] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 3 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:32.712930  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:32.713488  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd967393ef54cb783caf8d6c5959eec" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:32.713609  7619 raft_consensus.cc:3055] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:32.714021  7619 raft_consensus.cc:740] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:32.714039  7694 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.714942  7619 consensus_queue.cc:260] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.716039  7619 raft_consensus.cc:3060] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.719571  7694 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 3.
I20260709 12:20:32.721033  7508 leader_election.cc:304] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:32.721581  7619 raft_consensus.cc:2468] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 3.
I20260709 12:20:32.721937  7872 raft_consensus.cc:2804] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:32.723076  7872 raft_consensus.cc:697] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 3 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:32.724113  7872 consensus_queue.cc:237] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.731415  7439 catalog_manager.cc:5697] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 2 to 3, leader changed from 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.745220  7880 raft_consensus.cc:993] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.745846  7859 raft_consensus.cc:1081] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.747360  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40146
I20260709 12:20:32.747813  7543 raft_consensus.cc:493] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.748096  7543 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.753116  7543 raft_consensus.cc:515] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.754936  7543 leader_election.cc:290] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 4 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:32.755589  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:32.756165  7619 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.756112  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633856abb5bb40deb84581cff8dc3ad0" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:32.756839  7694 raft_consensus.cc:3055] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:32.757112  7694 raft_consensus.cc:740] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:32.757926  7694 consensus_queue.cc:260] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.758976  7694 raft_consensus.cc:3060] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.761221  7619 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 4.
I20260709 12:20:32.762301  7510 leader_election.cc:304] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:32.762964  7872 raft_consensus.cc:2804] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:32.763355  7872 raft_consensus.cc:697] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:32.764281  7872 consensus_queue.cc:237] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.764748  7694 raft_consensus.cc:2468] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 4.
I20260709 12:20:32.770747  7439 catalog_manager.cc:5697] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 3 to 4, leader changed from 9077d758a024412c81e46e6e70b1776b (127.6.182.131) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.835366  7871 raft_consensus.cc:993] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.835911  7873 raft_consensus.cc:1081] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.837467  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40162
I20260709 12:20:32.837939  7543 raft_consensus.cc:493] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.838280  7543 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.842662  7543 raft_consensus.cc:515] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.844096  7543 leader_election.cc:290] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 3 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:32.844947  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:32.845216  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "768e8150c17b4f9eb9e33ad38f137271" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:32.845481  7619 raft_consensus.cc:3055] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:32.845768  7694 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.845806  7619 raft_consensus.cc:740] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:32.846782  7619 consensus_queue.cc:260] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.847836  7619 raft_consensus.cc:3060] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:32.850883  7694 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 3.
I20260709 12:20:32.852509  7508 leader_election.cc:304] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:32.853334  7872 raft_consensus.cc:2804] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:32.853166  7619 raft_consensus.cc:2468] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 3.
I20260709 12:20:32.854070  7872 raft_consensus.cc:697] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 3 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:32.855124  7872 consensus_queue.cc:237] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:32.863108  7439 catalog_manager.cc:5697] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 2 to 3, leader changed from 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.878093  7880 raft_consensus.cc:993] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.878584  7859 raft_consensus.cc:1081] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:32.879994  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40146
I20260709 12:20:32.880441  7543 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.880820  7543 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.885592  7543 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:32.887135  7543 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 4 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:32.887914  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:32.888191  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:32.888466  7619 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.888813  7694 raft_consensus.cc:3055] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:32.889110  7694 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:32.889806  7694 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:32.890772  7694 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:32.893158  7619 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 4.
I20260709 12:20:32.894174  7510 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:32.894860  7872 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:32.895341  7872 raft_consensus.cc:697] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:32.896220  7872 consensus_queue.cc:237] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:32.897190  7694 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 4.
I20260709 12:20:32.903827  7439 catalog_manager.cc:5697] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 3 to 4, leader changed from 9077d758a024412c81e46e6e70b1776b (127.6.182.131) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.069927  7871 raft_consensus.cc:993] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: : Instructing follower f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:33.070374  7873 raft_consensus.cc:1081] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Signalling peer f8f799046a1f4e40ae4e33d13af83953 to start an election
I20260709 12:20:33.071918  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
 from {username='slave'} at 127.0.0.1:40162
I20260709 12:20:33.072425  7543 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.072767  7543 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.077410  7543 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:33.078995  7543 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:33.079757  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:33.080128  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "f8f799046a1f4e40ae4e33d13af83953" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:33.080279  7619 raft_consensus.cc:3055] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:33.080711  7619 raft_consensus.cc:740] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:33.080713  7694 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.081632  7619 consensus_queue.cc:260] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:33.082643  7619 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.085980  7694 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:33.087165  7619 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f799046a1f4e40ae4e33d13af83953 in term 2.
I20260709 12:20:33.087074  7508 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:33.088363  7874 raft_consensus.cc:2804] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:33.088936  7874 raft_consensus.cc:697] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Leader. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:33.089840  7874 consensus_queue.cc:237] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:33.096868  7439 catalog_manager.cc:5697] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 reported cstate change: term changed from 1 to 2, leader changed from 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130) to f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "f8f799046a1f4e40ae4e33d13af83953" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.195765  7694 raft_consensus.cc:1275] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:33.197248  7874 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.205742  7619 raft_consensus.cc:1275] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:33.207629  7874 consensus_queue.cc:1048] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.318393  7619 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.319540  7872 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.328116  7694 raft_consensus.cc:1275] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.330225  7888 consensus_queue.cc:1048] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.377799  7619 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.377799  7694 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:33.379379  7874 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.380010  7888 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.389823  7695 raft_consensus.cc:1275] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:33.391283  7888 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.404888  7619 raft_consensus.cc:1275] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:33.406404  7888 consensus_queue.cc:1048] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.520864  7619 raft_consensus.cc:1275] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.522089  7888 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:33.532930  7694 raft_consensus.cc:1275] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Refusing update from remote peer f8f799046a1f4e40ae4e33d13af83953: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.534336  7872 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:35.656147  6874 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:20:35.656813  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.664055  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:35.664570  7543 raft_consensus.cc:606] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Received request to transfer leadership to TS 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:35.667169  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:35.667665  7543 raft_consensus.cc:606] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Received request to transfer leadership to TS 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:35.669826  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:35.670241  7543 raft_consensus.cc:606] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Received request to transfer leadership to TS 9077d758a024412c81e46e6e70b1776b
I20260709 12:20:35.672317  7543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e"
dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
mode: GRACEFUL
new_leader_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:40180
I20260709 12:20:35.672755  7543 raft_consensus.cc:606] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Received request to transfer leadership to TS 8b027e982ddc4e5da07185c4fb573a41
I20260709 12:20:35.673712  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:35.674201  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:35.889484  7901 raft_consensus.cc:993] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:35.889941  7902 raft_consensus.cc:1081] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Signalling peer 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:35.891340  7694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:53420
I20260709 12:20:35.891803  7694 raft_consensus.cc:493] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.892051  7694 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:35.896113  7694 raft_consensus.cc:515] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:35.897933  7694 leader_election.cc:290] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 5 election: Requested vote from peers 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113), f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597)
I20260709 12:20:35.898847  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:35.899142  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3bdc5a251640e983b1173e37916e71" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:35.899430  7619 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:35.899662  7543 raft_consensus.cc:3055] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:35.899966  7543 raft_consensus.cc:740] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:35.900545  7543 consensus_queue.cc:260] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:35.901418  7543 raft_consensus.cc:3060] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:35.904186  7619 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 5.
I20260709 12:20:35.905413  7660 leader_election.cc:304] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:35.905603  7543 raft_consensus.cc:2468] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 5.
I20260709 12:20:35.906105  7859 raft_consensus.cc:2804] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:35.907183  7859 raft_consensus.cc:697] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 5 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:35.907910  7859 consensus_queue.cc:237] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } }
I20260709 12:20:35.914803  7438 catalog_manager.cc:5697] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 4 to 5, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 5 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.925179  7901 raft_consensus.cc:993] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:35.925689  7901 raft_consensus.cc:1081] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Signalling peer 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:35.927285  7619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:37168
I20260709 12:20:35.927717  7619 raft_consensus.cc:493] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.928005  7619 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.932518  7619 raft_consensus.cc:515] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.934757  7619 leader_election.cc:290] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 3 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:35.935441  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:35.935803  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c5ea23ca3543e4bff5af29c9da3b0e" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:35.936028  7543 raft_consensus.cc:3055] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.936296  7694 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.936321  7543 raft_consensus.cc:740] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:35.937187  7543 consensus_queue.cc:260] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.938267  7543 raft_consensus.cc:3060] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.942559  7694 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 3.
I20260709 12:20:35.943743  7584 leader_election.cc:304] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, 9077d758a024412c81e46e6e70b1776b; no voters: 
I20260709 12:20:35.944057  7543 raft_consensus.cc:2468] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 3.
I20260709 12:20:35.944612  7873 raft_consensus.cc:2804] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.946097  7873 raft_consensus.cc:697] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 3 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:35.947041  7873 consensus_queue.cc:237] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.947588  7902 raft_consensus.cc:993] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:35.948017  7901 raft_consensus.cc:1081] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Signalling peer 9077d758a024412c81e46e6e70b1776b to start an election
I20260709 12:20:35.949373  7694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7"
dest_uuid: "9077d758a024412c81e46e6e70b1776b"
 from {username='slave'} at 127.0.0.1:53420
I20260709 12:20:35.949791  7694 raft_consensus.cc:493] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.950187  7694 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.955104  7902 raft_consensus.cc:993] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: : Instructing follower 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:35.955622  7901 raft_consensus.cc:1081] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Signalling peer 8b027e982ddc4e5da07185c4fb573a41 to start an election
I20260709 12:20:35.955024  7438 catalog_manager.cc:5697] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 2 to 3, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.956482  7694 raft_consensus.cc:515] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.957039  7619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62"
dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
 from {username='slave'} at 127.0.0.1:37168
I20260709 12:20:35.957547  7619 raft_consensus.cc:493] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.957845  7619 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.958477  7694 leader_election.cc:290] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113)
I20260709 12:20:35.959407  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:35.959937  7543 raft_consensus.cc:3055] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.960230  7543 raft_consensus.cc:740] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:35.960903  7543 consensus_queue.cc:260] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.961979  7543 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.964780  7619 raft_consensus.cc:515] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.966499  7619 leader_election.cc:290] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 3 election: Requested vote from peers f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597), 9077d758a024412c81e46e6e70b1776b (127.6.182.131:40469)
I20260709 12:20:35.967269  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8f799046a1f4e40ae4e33d13af83953"
I20260709 12:20:35.967491  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4741cce620414184bf42800bb2f7e7" candidate_uuid: "9077d758a024412c81e46e6e70b1776b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b027e982ddc4e5da07185c4fb573a41"
I20260709 12:20:35.967918  7544 raft_consensus.cc:3055] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.968020  7619 raft_consensus.cc:3060] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.968349  7544 raft_consensus.cc:740] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8f799046a1f4e40ae4e33d13af83953, State: Running, Role: LEADER
I20260709 12:20:35.968681  7694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ea4d4885a4e5297ce8d23ff73fe62" candidate_uuid: "8b027e982ddc4e5da07185c4fb573a41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9077d758a024412c81e46e6e70b1776b"
I20260709 12:20:35.969322  7694 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.969318  7544 consensus_queue.cc:260] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.970608  7543 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:35.970824  7544 raft_consensus.cc:3060] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.971681  7660 leader_election.cc:304] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9077d758a024412c81e46e6e70b1776b, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:35.972373  7859 raft_consensus.cc:2804] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.972783  7859 raft_consensus.cc:697] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Becoming Leader. State: Replica: 9077d758a024412c81e46e6e70b1776b, State: Running, Role: LEADER
I20260709 12:20:35.973512  7859 consensus_queue.cc:237] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.975183  7619 raft_consensus.cc:2468] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9077d758a024412c81e46e6e70b1776b in term 3.
I20260709 12:20:35.978160  7544 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 3.
I20260709 12:20:35.979254  7586 leader_election.cc:304] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b027e982ddc4e5da07185c4fb573a41, f8f799046a1f4e40ae4e33d13af83953; no voters: 
I20260709 12:20:35.980010  7873 raft_consensus.cc:2804] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.980489  7873 raft_consensus.cc:697] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 LEADER]: Becoming Leader. State: Replica: 8b027e982ddc4e5da07185c4fb573a41, State: Running, Role: LEADER
I20260709 12:20:35.981407  7873 consensus_queue.cc:237] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } }
I20260709 12:20:35.983206  7694 raft_consensus.cc:2468] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b027e982ddc4e5da07185c4fb573a41 in term 3.
I20260709 12:20:35.988260  7438 catalog_manager.cc:5697] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b reported cstate change: term changed from 2 to 3, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 9077d758a024412c81e46e6e70b1776b (127.6.182.131). New cstate: current_term: 3 leader_uuid: "9077d758a024412c81e46e6e70b1776b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.989585  7440 catalog_manager.cc:5697] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 reported cstate change: term changed from 2 to 3, leader changed from f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129) to 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "8b027e982ddc4e5da07185c4fb573a41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.409875  7619 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 5 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:36.411811  7859 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:36.425367  7544 raft_consensus.cc:1275] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 5 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:36.425359  7694 raft_consensus.cc:1275] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.428042  7544 raft_consensus.cc:1275] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.427906  7859 consensus_queue.cc:1048] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.428341  7873 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.429850  7909 consensus_queue.cc:1048] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.444581  7542 raft_consensus.cc:1275] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.452301  7903 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.473773  7619 raft_consensus.cc:1275] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Refusing update from remote peer 9077d758a024412c81e46e6e70b1776b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.476322  7859 consensus_queue.cc:1048] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b027e982ddc4e5da07185c4fb573a41" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 38113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.535096  7543 raft_consensus.cc:1275] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.536235  7909 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8f799046a1f4e40ae4e33d13af83953" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.549660  7694 raft_consensus.cc:1275] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Refusing update from remote peer 8b027e982ddc4e5da07185c4fb573a41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:36.551335  7925 consensus_queue.cc:1048] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9077d758a024412c81e46e6e70b1776b" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.675343  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.681473  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:36.681897  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.682966  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.688642  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:37.689040  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:38.690014  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.695658  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:38.696151  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:39.697190  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:39.702848  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:39.703263  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:40.704272  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:40.712119  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:40.712782  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:41.714017  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:41.719448  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:41.719995  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:42.721138  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.727273  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:42.727698  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:43.728705  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.734681  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:43.735066  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.735893  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.741971  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.742347  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:45.774747  6874 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:20:45.775230  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:20:45.804913  7660 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:20:45.809194  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:20:45.809890  7660 consensus_peers.cc:597] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b -> Peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Couldn't send request to peer f8f799046a1f4e40ae4e33d13af83953. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.810105  6874 tablet_replica.cc:333] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.810963  6874 raft_consensus.cc:2243] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.811376  6874 raft_consensus.cc:2272] T 689ea4d4885a4e5297ce8d23ff73fe62 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.813215  6874 tablet_replica.cc:333] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.813709  6874 raft_consensus.cc:2243] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.814143  6874 raft_consensus.cc:2272] T 82f1b8f3553f4b4a81a19e5600a251c0 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.815904  6874 tablet_replica.cc:333] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.816381  6874 raft_consensus.cc:2243] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.816812  6874 raft_consensus.cc:2272] T 2c4741cce620414184bf42800bb2f7e7 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.818410  6874 tablet_replica.cc:333] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.818871  6874 raft_consensus.cc:2243] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.819219  6874 raft_consensus.cc:2272] T b4c5ea23ca3543e4bff5af29c9da3b0e P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.820930  6874 tablet_replica.cc:333] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.821363  6874 raft_consensus.cc:2243] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.822094  6874 raft_consensus.cc:2272] T 9dd967393ef54cb783caf8d6c5959eec P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.823817  6874 tablet_replica.cc:333] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.824252  6874 raft_consensus.cc:2243] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.825049  6874 raft_consensus.cc:2272] T ace18299ed794156a8a117ae7c498749 P f8f799046a1f4e40ae4e33d13af83953 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.826673  6874 tablet_replica.cc:333] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.827176  6874 raft_consensus.cc:2243] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.827965  6874 raft_consensus.cc:2272] T 768e8150c17b4f9eb9e33ad38f137271 P f8f799046a1f4e40ae4e33d13af83953 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.830008  6874 tablet_replica.cc:333] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.830678  6874 raft_consensus.cc:2243] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.831453  6874 raft_consensus.cc:2272] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P f8f799046a1f4e40ae4e33d13af83953 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.834214  6874 tablet_replica.cc:333] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
W20260709 12:20:45.834726  7586 consensus_peers.cc:597] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 -> Peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Couldn't send request to peer f8f799046a1f4e40ae4e33d13af83953. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.834959  6874 raft_consensus.cc:2243] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.835817  6874 raft_consensus.cc:2272] T 633856abb5bb40deb84581cff8dc3ad0 P f8f799046a1f4e40ae4e33d13af83953 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.837682  6874 tablet_replica.cc:333] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953: stopping tablet replica
I20260709 12:20:45.838111  6874 raft_consensus.cc:2243] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.838497  6874 raft_consensus.cc:2272] T 7c3bdc5a251640e983b1173e37916e71 P f8f799046a1f4e40ae4e33d13af83953 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.871305  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
I20260709 12:20:45.892982  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:20:45.904371  7660 consensus_peers.cc:597] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b -> Peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Couldn't send request to peer f8f799046a1f4e40ae4e33d13af83953. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:45.926441  7660 consensus_peers.cc:597] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b -> Peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Couldn't send request to peer 8b027e982ddc4e5da07185c4fb573a41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.931671  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:45.932468  6874 tablet_replica.cc:333] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.933243  6874 raft_consensus.cc:2243] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.934203  6874 raft_consensus.cc:2272] T 82f1b8f3553f4b4a81a19e5600a251c0 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.936355  6874 tablet_replica.cc:333] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.937047  6874 raft_consensus.cc:2243] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.937593  6874 raft_consensus.cc:2272] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 8b027e982ddc4e5da07185c4fb573a41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.939471  6874 tablet_replica.cc:333] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.940059  6874 raft_consensus.cc:2243] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.940521  6874 raft_consensus.cc:2272] T 633856abb5bb40deb84581cff8dc3ad0 P 8b027e982ddc4e5da07185c4fb573a41 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.942692  6874 tablet_replica.cc:333] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.943264  6874 raft_consensus.cc:2243] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.944149  6874 raft_consensus.cc:2272] T 689ea4d4885a4e5297ce8d23ff73fe62 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.946261  6874 tablet_replica.cc:333] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.946851  6874 raft_consensus.cc:2243] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.947387  6874 raft_consensus.cc:2272] T 9dd967393ef54cb783caf8d6c5959eec P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.949600  6874 tablet_replica.cc:333] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.950397  6874 raft_consensus.cc:2243] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.951058  6874 raft_consensus.cc:2272] T 2c4741cce620414184bf42800bb2f7e7 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.953879  6874 tablet_replica.cc:333] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
W20260709 12:20:45.954555  7660 consensus_peers.cc:597] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b -> Peer f8f799046a1f4e40ae4e33d13af83953 (127.6.182.129:39597): Couldn't send request to peer f8f799046a1f4e40ae4e33d13af83953. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.954692  6874 raft_consensus.cc:2243] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.955628  6874 raft_consensus.cc:2272] T b4c5ea23ca3543e4bff5af29c9da3b0e P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.957522  6874 tablet_replica.cc:333] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.958089  6874 raft_consensus.cc:2243] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.958509  6874 raft_consensus.cc:2272] T ace18299ed794156a8a117ae7c498749 P 8b027e982ddc4e5da07185c4fb573a41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.960320  6874 tablet_replica.cc:333] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.960918  6874 raft_consensus.cc:2243] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.961354  6874 raft_consensus.cc:2272] T 768e8150c17b4f9eb9e33ad38f137271 P 8b027e982ddc4e5da07185c4fb573a41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.963112  6874 tablet_replica.cc:333] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41: stopping tablet replica
I20260709 12:20:45.963582  6874 raft_consensus.cc:2243] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.964012  6874 raft_consensus.cc:2272] T 7c3bdc5a251640e983b1173e37916e71 P 8b027e982ddc4e5da07185c4fb573a41 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.996709  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
I20260709 12:20:46.018344  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:20:46.042637  7660 consensus_peers.cc:597] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b -> Peer 8b027e982ddc4e5da07185c4fb573a41 (127.6.182.130:38113): Couldn't send request to peer 8b027e982ddc4e5da07185c4fb573a41. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:38113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:46.052238  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:46.052938  6874 tablet_replica.cc:333] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.053553  6874 raft_consensus.cc:2243] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:20:46.054314  6874 raft_consensus.cc:2272] T 7c3bdc5a251640e983b1173e37916e71 P 9077d758a024412c81e46e6e70b1776b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.056080  6874 tablet_replica.cc:333] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.056545  6874 raft_consensus.cc:2243] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.057000  6874 raft_consensus.cc:2272] T 768e8150c17b4f9eb9e33ad38f137271 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.058570  6874 tablet_replica.cc:333] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.059020  6874 raft_consensus.cc:2243] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:46.059744  6874 raft_consensus.cc:2272] T 1fc9821e8cf543b1a9fe5f3e2037cc29 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.061318  6874 tablet_replica.cc:333] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.061772  6874 raft_consensus.cc:2243] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.062134  6874 raft_consensus.cc:2272] T 633856abb5bb40deb84581cff8dc3ad0 P 9077d758a024412c81e46e6e70b1776b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.063655  6874 tablet_replica.cc:333] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.064088  6874 raft_consensus.cc:2243] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.064440  6874 raft_consensus.cc:2272] T 82f1b8f3553f4b4a81a19e5600a251c0 P 9077d758a024412c81e46e6e70b1776b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.066047  6874 tablet_replica.cc:333] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.066488  6874 raft_consensus.cc:2243] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.066805  6874 raft_consensus.cc:2272] T ace18299ed794156a8a117ae7c498749 P 9077d758a024412c81e46e6e70b1776b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.068516  6874 tablet_replica.cc:333] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.069088  6874 raft_consensus.cc:2243] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.069633  6874 raft_consensus.cc:2272] T 9dd967393ef54cb783caf8d6c5959eec P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.071687  6874 tablet_replica.cc:333] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.072314  6874 raft_consensus.cc:2243] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.072845  6874 raft_consensus.cc:2272] T b4c5ea23ca3543e4bff5af29c9da3b0e P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.074504  6874 tablet_replica.cc:333] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.075003  6874 raft_consensus.cc:2243] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:46.075750  6874 raft_consensus.cc:2272] T 2c4741cce620414184bf42800bb2f7e7 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.077325  6874 tablet_replica.cc:333] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b: stopping tablet replica
I20260709 12:20:46.077814  6874 raft_consensus.cc:2243] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:46.078226  6874 raft_consensus.cc:2272] T 689ea4d4885a4e5297ce8d23ff73fe62 P 9077d758a024412c81e46e6e70b1776b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.106665  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:20:46.126132  6874 master.cc:562] Master@127.6.182.190:41955 shutting down...
I20260709 12:20:46.152103  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:46.152722  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.153019  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1b891824287644fa87a570ffba5ff98c: stopping tablet replica
I20260709 12:20:46.172796  6874 master.cc:584] Master@127.6.182.190:41955 shutdown complete.
8b027e982ddc4e5da07185c4fb573a41  4
9077d758a024412c81e46e6e70b1776b  1
f8f799046a1f4e40ae4e33d13af83953  5
8b027e982ddc4e5da07185c4fb573a41  4
9077d758a024412c81e46e6e70b1776b  3
f8f799046a1f4e40ae4e33d13af83953  3
8b027e982ddc4e5da07185c4fb573a41  1
9077d758a024412c81e46e6e70b1776b  1
f8f799046a1f4e40ae4e33d13af83953  8
8b027e982ddc4e5da07185c4fb573a41  3
9077d758a024412c81e46e6e70b1776b  3
f8f799046a1f4e40ae4e33d13af83953  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28924 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:20:46.226454  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:33539
I20260709 12:20:46.227646  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.233875  7942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.233975  7943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.235769  7945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.237182  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:46.238170  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.238368  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.238513  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599646238500 us; error 0 us; skew 500 ppm
I20260709 12:20:46.239079  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.241684  6874 webserver.cc:533] Webserver started at http://127.6.182.190:34103/ using document root <none> and password file <none>
I20260709 12:20:46.242161  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.242319  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.242560  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.243952  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "d9f88eae4422483fae5be30b0540c616"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.249193  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:20:46.253257  7950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.253991  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:20:46.254299  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "d9f88eae4422483fae5be30b0540c616"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.254585  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.269253  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.270685  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.311508  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:33539
I20260709 12:20:46.311604  8001 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:33539 every 8 connection(s)
I20260709 12:20:46.315548  8002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.325601  8002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Bootstrap starting.
I20260709 12:20:46.330358  8002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.334615  8002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: No bootstrap required, opened a new log
I20260709 12:20:46.337002  8002 raft_consensus.cc:359] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER }
I20260709 12:20:46.337514  8002 raft_consensus.cc:385] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.337764  8002 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f88eae4422483fae5be30b0540c616, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.338433  8002 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER }
I20260709 12:20:46.338922  8002 raft_consensus.cc:399] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:46.339164  8002 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:46.339462  8002 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:46.344897  8002 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER }
I20260709 12:20:46.345434  8002 leader_election.cc:304] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9f88eae4422483fae5be30b0540c616; no voters: 
I20260709 12:20:46.346570  8002 leader_election.cc:290] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:46.347077  8005 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:46.348555  8005 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 1 LEADER]: Becoming Leader. State: Replica: d9f88eae4422483fae5be30b0540c616, State: Running, Role: LEADER
I20260709 12:20:46.349534  8002 sys_catalog.cc:565] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:46.349387  8005 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER }
I20260709 12:20:46.356808  8006 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9f88eae4422483fae5be30b0540c616" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER } }
I20260709 12:20:46.357412  8006 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:46.357059  8007 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9f88eae4422483fae5be30b0540c616. Latest consensus state: current_term: 1 leader_uuid: "d9f88eae4422483fae5be30b0540c616" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f88eae4422483fae5be30b0540c616" member_type: VOTER } }
I20260709 12:20:46.357852  8007 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:46.359850  8012 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:46.366103  8012 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:46.368294  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:46.376044  8012 catalog_manager.cc:1383] Generated new cluster ID: 4fcd5fc2918441ecafdc95f2fcb6cb87
I20260709 12:20:46.376389  8012 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:46.397497  8012 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:46.398886  8012 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:46.414013  8012 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Generated new TSK 0
I20260709 12:20:46.414666  8012 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:46.434990  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.441390  8023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.442535  8024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.444562  8026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.445188  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:46.446226  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.446461  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.446698  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599646446681 us; error 0 us; skew 500 ppm
I20260709 12:20:46.447311  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.449954  6874 webserver.cc:533] Webserver started at http://127.6.182.129:39751/ using document root <none> and password file <none>
I20260709 12:20:46.450495  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.450718  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.451045  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.452443  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "3d67d00ae45b444cbe343726df1760e8"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.457388  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:46.460834  8032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.461673  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:46.461962  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "3d67d00ae45b444cbe343726df1760e8"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.462289  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.480089  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.481469  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.483052  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.485467  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.485702  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.485967  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.486161  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.532397  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:34867
I20260709 12:20:46.532519  8094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:34867 every 8 connection(s)
I20260709 12:20:46.537714  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.545933  8099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.546999  8100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.549126  8102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.550197  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:46.551304  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.551514  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.551637  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599646551626 us; error 0 us; skew 500 ppm
I20260709 12:20:46.552106  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.555366  6874 webserver.cc:533] Webserver started at http://127.6.182.130:33145/ using document root <none> and password file <none>
I20260709 12:20:46.555999  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.556267  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.556579  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.556809  8095 heartbeater.cc:344] Connected to a master server at 127.6.182.190:33539
I20260709 12:20:46.557245  8095 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.558014  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "92362bf8983f4a71a3511e987a2c6578"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.558096  8095 heartbeater.cc:507] Master 127.6.182.190:33539 requested a full tablet report, sending...
I20260709 12:20:46.560488  7967 ts_manager.cc:194] Registered new tserver with Master: 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:20:46.562638  7967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42556
I20260709 12:20:46.563162  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:46.567485  8107 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.568315  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:20:46.568617  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "92362bf8983f4a71a3511e987a2c6578"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.568955  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.585379  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.586599  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.588109  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.590618  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.590849  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.591125  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.591303  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.632083  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:37085
I20260709 12:20:46.632191  8170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:37085 every 8 connection(s)
I20260709 12:20:46.637076  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.644694  8174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.646093  8175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.648981  8177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.649732  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:46.650679  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.650955  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.651046  8171 heartbeater.cc:344] Connected to a master server at 127.6.182.190:33539
I20260709 12:20:46.651244  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599646651223 us; error 0 us; skew 500 ppm
I20260709 12:20:46.651535  8171 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.652019  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.652282  8171 heartbeater.cc:507] Master 127.6.182.190:33539 requested a full tablet report, sending...
I20260709 12:20:46.654590  7967 ts_manager.cc:194] Registered new tserver with Master: 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:46.654729  6874 webserver.cc:533] Webserver started at http://127.6.182.131:37245/ using document root <none> and password file <none>
I20260709 12:20:46.655319  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.655544  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.655814  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.656243  7967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42564
I20260709 12:20:46.657425  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "0c70d5020db543caa986f80b0adaa8d2"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.663604  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:46.667738  8182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.668514  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:46.668866  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "0c70d5020db543caa986f80b0adaa8d2"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-lgtn"
I20260709 12:20:46.669169  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.689396  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.690670  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.692198  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.694485  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.694713  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.694957  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.695129  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.736232  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:41179
I20260709 12:20:46.736347  8244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:41179 every 8 connection(s)
I20260709 12:20:46.751413  8245 heartbeater.cc:344] Connected to a master server at 127.6.182.190:33539
I20260709 12:20:46.751873  8245 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.752732  8245 heartbeater.cc:507] Master 127.6.182.190:33539 requested a full tablet report, sending...
I20260709 12:20:46.754990  7967 ts_manager.cc:194] Registered new tserver with Master: 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:46.755599  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016077033s
I20260709 12:20:46.756829  7967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42580
I20260709 12:20:46.785048  7967 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42586:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:46.791217  7967 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:47.001907  8136 tablet_service.cc:1511] Processing CreateTablet for tablet c0351f909341497abfdf11bbc6fd51e0 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:47.002669  8135 tablet_service.cc:1511] Processing CreateTablet for tablet df7583ede5b943628d7b1b33336c660a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:47.003016  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 2937575a0ea644128c0e2d4ba3aab05e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:47.003520  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0351f909341497abfdf11bbc6fd51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.004456  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2937575a0ea644128c0e2d4ba3aab05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.005653  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7583ede5b943628d7b1b33336c660a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.006680  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 423b8f313a0947a3a2819068b1105a8e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:47.008119  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b8f313a0947a3a2819068b1105a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.008831  8209 tablet_service.cc:1511] Processing CreateTablet for tablet df7583ede5b943628d7b1b33336c660a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:47.010185  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7583ede5b943628d7b1b33336c660a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.010528  8060 tablet_service.cc:1511] Processing CreateTablet for tablet c0351f909341497abfdf11bbc6fd51e0 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:47.011904  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0351f909341497abfdf11bbc6fd51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.011619  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 423b8f313a0947a3a2819068b1105a8e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:47.012214  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 2937575a0ea644128c0e2d4ba3aab05e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:47.012939  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b8f313a0947a3a2819068b1105a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.013617  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2937575a0ea644128c0e2d4ba3aab05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.014014  8059 tablet_service.cc:1511] Processing CreateTablet for tablet df7583ede5b943628d7b1b33336c660a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:47.015401  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7583ede5b943628d7b1b33336c660a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.017879  8210 tablet_service.cc:1511] Processing CreateTablet for tablet c0351f909341497abfdf11bbc6fd51e0 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:47.019212  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0351f909341497abfdf11bbc6fd51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.017906  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 2937575a0ea644128c0e2d4ba3aab05e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:47.020730  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2937575a0ea644128c0e2d4ba3aab05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.047961  8056 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18c688c54647cc96908c6b4eb6a80b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:47.049924  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18c688c54647cc96908c6b4eb6a80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.053671  8132 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18c688c54647cc96908c6b4eb6a80b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:47.055563  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18c688c54647cc96908c6b4eb6a80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.044962  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 423b8f313a0947a3a2819068b1105a8e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:47.063555  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b8f313a0947a3a2819068b1105a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.069041  8210 tablet_service.cc:1511] Processing CreateTablet for tablet 2f18c688c54647cc96908c6b4eb6a80b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:47.070338  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18c688c54647cc96908c6b4eb6a80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.079911  8262 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:47.093046  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 627e9613a1ca4f19a4b790eac7fbbf2a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:47.094477  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627e9613a1ca4f19a4b790eac7fbbf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.096750  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 627e9613a1ca4f19a4b790eac7fbbf2a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:47.098038  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627e9613a1ca4f19a4b790eac7fbbf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.108398  8261 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:47.116504  8206 tablet_service.cc:1511] Processing CreateTablet for tablet e200bb1befd04bcf9b902618b83b1f88 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:47.116864  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 627e9613a1ca4f19a4b790eac7fbbf2a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:47.117964  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e200bb1befd04bcf9b902618b83b1f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.118057  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627e9613a1ca4f19a4b790eac7fbbf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.121891  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7fc19421924a9a9d7c350bf097e173 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:47.123086  8261 tablet_bootstrap.cc:654] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.123266  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7fc19421924a9a9d7c350bf097e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.124022  8058 tablet_service.cc:1511] Processing CreateTablet for tablet e200bb1befd04bcf9b902618b83b1f88 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:47.127652  8135 tablet_service.cc:1511] Processing CreateTablet for tablet e200bb1befd04bcf9b902618b83b1f88 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:47.129513  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7fc19421924a9a9d7c350bf097e173 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:47.132158  8054 tablet_service.cc:1511] Processing CreateTablet for tablet f7490a68a6eb4ff18f8111dadec3d794 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:47.134655  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e200bb1befd04bcf9b902618b83b1f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.134728  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7fc19421924a9a9d7c350bf097e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.137001  8131 tablet_service.cc:1511] Processing CreateTablet for tablet f7490a68a6eb4ff18f8111dadec3d794 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:47.142513  8059 tablet_service.cc:1511] Processing CreateTablet for tablet ab203f6136b5456cacf2c4f8c664004b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:47.144203  8208 tablet_service.cc:1511] Processing CreateTablet for tablet f7490a68a6eb4ff18f8111dadec3d794 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:47.146435  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7490a68a6eb4ff18f8111dadec3d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.148655  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7fc19421924a9a9d7c350bf097e173 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:47.149669  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7490a68a6eb4ff18f8111dadec3d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.147526  8262 tablet_bootstrap.cc:654] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.157032  8056 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:47.158577  8209 tablet_service.cc:1511] Processing CreateTablet for tablet ab203f6136b5456cacf2c4f8c664004b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:47.158854  8136 tablet_service.cc:1511] Processing CreateTablet for tablet ab203f6136b5456cacf2c4f8c664004b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:47.161072  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab203f6136b5456cacf2c4f8c664004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.161145  8130 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:47.159252  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e200bb1befd04bcf9b902618b83b1f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.164201  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7fc19421924a9a9d7c350bf097e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.169037  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.170873  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab203f6136b5456cacf2c4f8c664004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.189263  8263 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:47.191829  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:47.193251  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.199738  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.202585  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7490a68a6eb4ff18f8111dadec3d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.204813  8060 tablet_service.cc:1511] Processing CreateTablet for tablet c6f5552bf1b244738e961ee3f9a8554b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:47.206123  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f5552bf1b244738e961ee3f9a8554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.205929  8132 tablet_service.cc:1511] Processing CreateTablet for tablet c6f5552bf1b244738e961ee3f9a8554b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:47.207219  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f5552bf1b244738e961ee3f9a8554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.209007  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab203f6136b5456cacf2c4f8c664004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.211143  8261 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:47.211625  8261 ts_tablet_manager.cc:1403] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.013s
I20260709 12:20:47.214699  8261 raft_consensus.cc:359] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.215394  8261 raft_consensus.cc:385] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.215691  8261 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.218762  8262 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:47.219218  8262 ts_tablet_manager.cc:1403] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.000s
I20260709 12:20:47.222153  8262 raft_consensus.cc:359] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.222527  8205 tablet_service.cc:1511] Processing CreateTablet for tablet c6f5552bf1b244738e961ee3f9a8554b (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:47.223875  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f5552bf1b244738e961ee3f9a8554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.222894  8262 raft_consensus.cc:385] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.231604  8262 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.216434  8261 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.232968  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 9a48757da78d43b99132b4e9a4da86c5 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:47.234443  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a48757da78d43b99132b4e9a4da86c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.241027  8262 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.253695  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 9a48757da78d43b99132b4e9a4da86c5 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:47.256210  8210 tablet_service.cc:1511] Processing CreateTablet for tablet 9a48757da78d43b99132b4e9a4da86c5 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:47.257225  8262 ts_tablet_manager.cc:1434] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 12:20:47.257711  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a48757da78d43b99132b4e9a4da86c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.257740  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a48757da78d43b99132b4e9a4da86c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.257994  8171 heartbeater.cc:499] Master 127.6.182.190:33539 was elected leader, sending a full tablet report...
I20260709 12:20:47.267423  8245 heartbeater.cc:499] Master 127.6.182.190:33539 was elected leader, sending a full tablet report...
I20260709 12:20:47.267621  8261 ts_tablet_manager.cc:1434] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.056s	user 0.016s	sys 0.012s
I20260709 12:20:47.268698  8261 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:47.270177  8132 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:47.272923  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.280941  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:47.282647  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.285552  8261 tablet_bootstrap.cc:654] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.290237  8263 tablet_bootstrap.cc:654] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.310631  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:47.312835  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.314127  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 4cee9f5adec64ff983b1c5510d0979af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:47.314149  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 4cee9f5adec64ff983b1c5510d0979af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:47.317250  8056 tablet_service.cc:1511] Processing CreateTablet for tablet c14c286147e549768b521ff92a61fec9 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:47.314149  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 4cee9f5adec64ff983b1c5510d0979af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:47.318486  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cee9f5adec64ff983b1c5510d0979af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.318487  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14c286147e549768b521ff92a61fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.321372  8132 tablet_service.cc:1511] Processing CreateTablet for tablet c14c286147e549768b521ff92a61fec9 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:47.322579  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14c286147e549768b521ff92a61fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.326653  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cee9f5adec64ff983b1c5510d0979af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.328730  8262 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:47.329020  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cee9f5adec64ff983b1c5510d0979af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.339040  8262 tablet_bootstrap.cc:654] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.346854  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 20d361a1924b450abb7d5c5dee1414ab (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:47.348179  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d361a1924b450abb7d5c5dee1414ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.351759  8205 tablet_service.cc:1511] Processing CreateTablet for tablet c14c286147e549768b521ff92a61fec9 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:47.353039  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14c286147e549768b521ff92a61fec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.353665  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 20d361a1924b450abb7d5c5dee1414ab (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:47.354949  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d361a1924b450abb7d5c5dee1414ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.357678  8130 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd78a3bdb9948dd8d81b02f2028748e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:47.358934  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd78a3bdb9948dd8d81b02f2028748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.359843  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 20d361a1924b450abb7d5c5dee1414ab (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:47.361215  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d361a1924b450abb7d5c5dee1414ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.361625  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd78a3bdb9948dd8d81b02f2028748e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:47.362861  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd78a3bdb9948dd8d81b02f2028748e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:47.366816  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:47.366575  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd78a3bdb9948dd8d81b02f2028748e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:47.368016  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd78a3bdb9948dd8d81b02f2028748e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.374197  8263 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:47.374718  8263 ts_tablet_manager.cc:1403] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.000s
I20260709 12:20:47.385785  8263 raft_consensus.cc:359] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.387305  8263 raft_consensus.cc:385] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.387636  8263 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.388494  8263 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.396672  8261 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:47.397212  8261 ts_tablet_manager.cc:1403] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.023s
I20260709 12:20:47.399299  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.400712  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.401801  8261 raft_consensus.cc:359] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.402557  8261 raft_consensus.cc:385] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.402838  8261 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.404724  8132 tablet_service.cc:1511] Processing CreateTablet for tablet 4e65d7e0170f493eaf2756b296fa073c (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.405854  8204 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.407228  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.413784  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 4e65d7e0170f493eaf2756b296fa073c (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.409879  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.415159  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e65d7e0170f493eaf2756b296fa073c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.415364  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e65d7e0170f493eaf2756b296fa073c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.420986  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.426141  8056 tablet_service.cc:1511] Processing CreateTablet for tablet 4e65d7e0170f493eaf2756b296fa073c (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.427445  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e65d7e0170f493eaf2756b296fa073c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.432332  8203 tablet_service.cc:1511] Processing CreateTablet for tablet dbbb2d697a734b0baef1073024333311 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.433800  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbb2d697a734b0baef1073024333311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.435913  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 1037a99772cf4ae487cf4f6c27f6d4af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:47.437378  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1037a99772cf4ae487cf4f6c27f6d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.437848  8057 tablet_service.cc:1511] Processing CreateTablet for tablet dbbb2d697a734b0baef1073024333311 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.438740  8136 tablet_service.cc:1511] Processing CreateTablet for tablet dbbb2d697a734b0baef1073024333311 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.439173  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbb2d697a734b0baef1073024333311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.439958  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbb2d697a734b0baef1073024333311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.444115  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 1037a99772cf4ae487cf4f6c27f6d4af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:47.446928  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1037a99772cf4ae487cf4f6c27f6d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.448729  8262 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:47.449314  8262 ts_tablet_manager.cc:1403] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.006s
I20260709 12:20:47.449350  8267 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.449973  8267 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.462569  8267 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.453209  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 1037a99772cf4ae487cf4f6c27f6d4af (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:47.462416  8261 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.473708  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1037a99772cf4ae487cf4f6c27f6d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.473836  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe588c3d3ed44709862cae072b8e205 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.475701  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe588c3d3ed44709862cae072b8e205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.482028  8262 raft_consensus.cc:359] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.482772  8262 raft_consensus.cc:385] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.483078  8262 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.483827  8262 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.494536  8261 ts_tablet_manager.cc:1434] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 12:20:47.495883  8263 ts_tablet_manager.cc:1434] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.005s
I20260709 12:20:47.496791  8095 heartbeater.cc:499] Master 127.6.182.190:33539 was elected leader, sending a full tablet report...
I20260709 12:20:47.505086  8263 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:47.495872  8261 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:47.527729  8129 tablet_service.cc:1511] Processing CreateTablet for tablet 96d399d9899c495382a6ba72d8479a9d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.529156  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d399d9899c495382a6ba72d8479a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.538341  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe588c3d3ed44709862cae072b8e205 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.539657  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe588c3d3ed44709862cae072b8e205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.541146  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe588c3d3ed44709862cae072b8e205 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.542164  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe588c3d3ed44709862cae072b8e205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.535066  8261 tablet_bootstrap.cc:654] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.547905  8263 tablet_bootstrap.cc:654] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.553578  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 96d399d9899c495382a6ba72d8479a9d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.554958  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d399d9899c495382a6ba72d8479a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.567623  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:47.570683  8110 leader_election.cc:343] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.573247  8058 tablet_service.cc:1511] Processing CreateTablet for tablet eef17f41a1d74cc39da4096cfd1d9edd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.576062  8130 tablet_service.cc:1511] Processing CreateTablet for tablet eef17f41a1d74cc39da4096cfd1d9edd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.577984  8262 ts_tablet_manager.cc:1434] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.000s
I20260709 12:20:47.578366  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 72a3a306870b4fb1b1c3a1860a643731 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:47.579639  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 96d399d9899c495382a6ba72d8479a9d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.583917  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:47.584693  8271 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.589979  8271 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.585427  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef17f41a1d74cc39da4096cfd1d9edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.590072  8208 tablet_service.cc:1511] Processing CreateTablet for tablet eef17f41a1d74cc39da4096cfd1d9edd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.593017  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 72a3a306870b4fb1b1c3a1860a643731 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 12:20:47.593462  8109 leader_election.cc:343] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.593473  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef17f41a1d74cc39da4096cfd1d9edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.594278  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a3a306870b4fb1b1c3a1860a643731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.594111  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:47.595242  8267 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.585719  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef17f41a1d74cc39da4096cfd1d9edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.602584  8261 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:47.603078  8261 ts_tablet_manager.cc:1403] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.004s
I20260709 12:20:47.603710  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a3a306870b4fb1b1c3a1860a643731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.599586  8271 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.606238  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d399d9899c495382a6ba72d8479a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.608029  8261 raft_consensus.cc:359] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.612911  8261 raft_consensus.cc:385] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.613348  8261 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.618137  8266 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.618824  8266 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.623245  8266 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:47.629513  8262 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:47.619226  8261 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.642418  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 72a3a306870b4fb1b1c3a1860a643731 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:47.644300  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a3a306870b4fb1b1c3a1860a643731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.660216  8263 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:47.660676  8261 ts_tablet_manager.cc:1434] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.004s
I20260709 12:20:47.660869  8263 ts_tablet_manager.cc:1403] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.014s
I20260709 12:20:47.661737  8261 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:47.663761  8262 tablet_bootstrap.cc:654] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.667922  8056 tablet_service.cc:1511] Processing CreateTablet for tablet e23d9238fead43a79238d40702153004 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.670509  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 52f19ea14efe485bb7af9f0baee00fdb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.671478  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23d9238fead43a79238d40702153004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.672192  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f19ea14efe485bb7af9f0baee00fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.671868  8263 raft_consensus.cc:359] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.672734  8263 raft_consensus.cc:385] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.673067  8263 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.673851  8263 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.677452  8266 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.677974  8266 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.678746  8206 tablet_service.cc:1511] Processing CreateTablet for tablet e23d9238fead43a79238d40702153004 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.680178  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23d9238fead43a79238d40702153004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.680286  8266 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:20:47.691203  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 52f19ea14efe485bb7af9f0baee00fdb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.692524  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f19ea14efe485bb7af9f0baee00fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.697721  8130 tablet_service.cc:1511] Processing CreateTablet for tablet e23d9238fead43a79238d40702153004 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.698648  8261 tablet_bootstrap.cc:654] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.699105  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23d9238fead43a79238d40702153004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.702378  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 52f19ea14efe485bb7af9f0baee00fdb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.703768  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f19ea14efe485bb7af9f0baee00fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.711035  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:47.713430  8036 leader_election.cc:343] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.716344  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:47.717114  8220 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:47.719415  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:47.720709  8271 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.721078  8271 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.721429  8271 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.722620  8263 ts_tablet_manager.cc:1434] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:20:47.725684  8263 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:47.728168  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:47.729049  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:47.732892  8186 leader_election.cc:343] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.734828  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:47.735890  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:47.738178  8184 leader_election.cc:343] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.738648  8184 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:47.738787  8060 tablet_service.cc:1511] Processing CreateTablet for tablet d03e6a3f73454ce8a6a8e18e83852297 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.739320  8266 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.740480  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03e6a3f73454ce8a6a8e18e83852297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.740724  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31800511c940e48a418a30b32976fd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 12:20:47.742015  8186 leader_election.cc:343] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.742385  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31800511c940e48a418a30b32976fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.753649  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31800511c940e48a418a30b32976fd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:47.755057  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31800511c940e48a418a30b32976fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.755975  8129 tablet_service.cc:1511] Processing CreateTablet for tablet d03e6a3f73454ce8a6a8e18e83852297 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.757334  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03e6a3f73454ce8a6a8e18e83852297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.752140  8271 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.764384  8070 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:47.764652  8209 tablet_service.cc:1511] Processing CreateTablet for tablet d03e6a3f73454ce8a6a8e18e83852297 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.765110  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:47.766952  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:47.767349  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03e6a3f73454ce8a6a8e18e83852297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.768057  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 5a31800511c940e48a418a30b32976fd (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 12:20:47.768651  8036 leader_election.cc:343] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.769238  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:47.782210  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a31800511c940e48a418a30b32976fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.763808  8271 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.767036  8220 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.779707  8263 tablet_bootstrap.cc:654] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.787271  8131 tablet_service.cc:1511] Processing CreateTablet for tablet c4ed3b4d69eb4982923a37293db3b766 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.788028  8261 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:47.791697  8206 tablet_service.cc:1511] Processing CreateTablet for tablet c4ed3b4d69eb4982923a37293db3b766 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.793905  8057 tablet_service.cc:1511] Processing CreateTablet for tablet c4ed3b4d69eb4982923a37293db3b766 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.796978  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ed3b4d69eb4982923a37293db3b766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.797683  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ed3b4d69eb4982923a37293db3b766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.794880  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ed3b4d69eb4982923a37293db3b766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.795317  8220 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:47.809265  8266 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.795670  8262 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:47.812160  8262 ts_tablet_manager.cc:1403] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.006s
I20260709 12:20:47.811995  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 5f036b82035545a1beb20d54efe5a550 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.813454  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f036b82035545a1beb20d54efe5a550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.816474  8129 tablet_service.cc:1511] Processing CreateTablet for tablet 5f036b82035545a1beb20d54efe5a550 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.818017  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f036b82035545a1beb20d54efe5a550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.817847  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 5f036b82035545a1beb20d54efe5a550 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.818527  8267 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.819192  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f036b82035545a1beb20d54efe5a550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.819024  8267 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.820529  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 273de299acf94214b44aab4591da9b3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.821375  8267 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.821913  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273de299acf94214b44aab4591da9b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.822893  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 273de299acf94214b44aab4591da9b3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.824255  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273de299acf94214b44aab4591da9b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.796097  8261 ts_tablet_manager.cc:1403] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.013s
I20260709 12:20:47.829645  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:47.830279  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:47.830983  8271 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.832566  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:47.833515  8070 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:47.836462  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:47.837419  8267 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.837263  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 273de299acf94214b44aab4591da9b3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.837822  8267 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.838234  8267 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.838697  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273de299acf94214b44aab4591da9b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.827989  8261 raft_consensus.cc:359] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.840619  8261 raft_consensus.cc:385] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.841035  8261 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.815476  8262 raft_consensus.cc:359] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.843547  8262 raft_consensus.cc:385] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.843942  8262 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.857460  8262 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.859311  8261 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.864969  8219 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:47.865661  8056 tablet_service.cc:1511] Processing CreateTablet for tablet afe51432fd48472eb0166224a6ee8797 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.869673  8204 tablet_service.cc:1511] Processing CreateTablet for tablet afe51432fd48472eb0166224a6ee8797 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.870203  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe51432fd48472eb0166224a6ee8797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.871129  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe51432fd48472eb0166224a6ee8797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.885764  8210 tablet_service.cc:1511] Processing CreateTablet for tablet d5979a1457c14f8297c9143773c4d85d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.887327  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5979a1457c14f8297c9143773c4d85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.889068  8263 tablet_bootstrap.cc:492] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:47.890391  8263 ts_tablet_manager.cc:1403] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.006s
I20260709 12:20:47.891070  8059 tablet_service.cc:1511] Processing CreateTablet for tablet d5979a1457c14f8297c9143773c4d85d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.889815  8262 ts_tablet_manager.cc:1434] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.011s
I20260709 12:20:47.892398  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5979a1457c14f8297c9143773c4d85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.892755  8262 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:47.879948  8271 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:47.895392  8054 tablet_service.cc:1511] Processing CreateTablet for tablet b2db314cd9b6453daa5d171b91113f3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.904255  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2db314cd9b6453daa5d171b91113f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.908582  8205 tablet_service.cc:1511] Processing CreateTablet for tablet b2db314cd9b6453daa5d171b91113f3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.909945  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2db314cd9b6453daa5d171b91113f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.914368  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 9647a9c32fa748e4bc9548eb7a92bdfc (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.915660  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9647a9c32fa748e4bc9548eb7a92bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.925601  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 9647a9c32fa748e4bc9548eb7a92bdfc (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.926973  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9647a9c32fa748e4bc9548eb7a92bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.933302  8285 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.933822  8285 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.936167  8285 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.936951  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:47.938299  8263 raft_consensus.cc:359] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.939041  8263 raft_consensus.cc:385] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.939324  8263 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.940019  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:47.942188  8219 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:47.943364  8110 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:47.944842  8285 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.947196  8053 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3a4527b584efbaf9d73ae4556e10f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:47.948661  8053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3a4527b584efbaf9d73ae4556e10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.949047  8271 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.953047  8285 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.957686  8129 tablet_service.cc:1511] Processing CreateTablet for tablet afe51432fd48472eb0166224a6ee8797 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.957919  8136 tablet_service.cc:1511] Processing CreateTablet for tablet d5979a1457c14f8297c9143773c4d85d (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.959082  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe51432fd48472eb0166224a6ee8797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.959676  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5979a1457c14f8297c9143773c4d85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.940057  8263 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.954896  8262 tablet_bootstrap.cc:654] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.955914  8267 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.961387  8130 tablet_service.cc:1511] Processing CreateTablet for tablet b2db314cd9b6453daa5d171b91113f3a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.961845  8261 ts_tablet_manager.cc:1434] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
I20260709 12:20:47.970314  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 9647a9c32fa748e4bc9548eb7a92bdfc (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.971886  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2db314cd9b6453daa5d171b91113f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.972523  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9647a9c32fa748e4bc9548eb7a92bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.972779  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:47.973349  8219 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.973578  8263 ts_tablet_manager.cc:1434] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:20:47.975996  8261 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:47.976477  8267 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:47.980602  8219 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:47.985545  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:47.986486  8267 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.986984  8267 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:47.987854  8267 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.991569  8284 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.992065  8284 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:47.993144  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:47.993692  8070 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.001307  8284 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.002997  8266 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.003530  8266 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.003948  8133 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3a4527b584efbaf9d73ae4556e10f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:48.005381  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3a4527b584efbaf9d73ae4556e10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.006038  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:48.006687  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:48.008301  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:48.009011  8219 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:48.010212  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3e3220f9e94cdfb85d6632a64db657 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:48.011219  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.011605  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3e3220f9e94cdfb85d6632a64db657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.014179  8263 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:48.018394  8210 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3a4527b584efbaf9d73ae4556e10f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:48.019057  8266 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:48.018849  7967 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.019701  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:48.020402  8069 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:48.021219  8284 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:48.021567  8284 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.021492  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3e3220f9e94cdfb85d6632a64db657 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:48.022039  8284 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.021850  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3e3220f9e94cdfb85d6632a64db657 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:48.022934  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3e3220f9e94cdfb85d6632a64db657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.023084  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:48.023736  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:48.019701  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3a4527b584efbaf9d73ae4556e10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.025779  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.026638  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3e3220f9e94cdfb85d6632a64db657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.027177  8266 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:48.027562  8266 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.027902  8266 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.032094  8284 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.043427  8266 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.044155  8059 tablet_service.cc:1511] Processing CreateTablet for tablet aa46cdee469046e0a85f4a03d2e03f92 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:48.045874  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa46cdee469046e0a85f4a03d2e03f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.047349  7965 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.049582  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:48.051156  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:48.051846  8146 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.052230  8069 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:48.056118  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:48.059764  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:48.061196  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:48.074051  8262 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.063082  8266 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:48.066975  8070 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:48.086041  8262 ts_tablet_manager.cc:1403] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.194s	user 0.003s	sys 0.016s
I20260709 12:20:48.097256  8129 tablet_service.cc:1511] Processing CreateTablet for tablet aa46cdee469046e0a85f4a03d2e03f92 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:48.098605  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa46cdee469046e0a85f4a03d2e03f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.099989  8263 tablet_bootstrap.cc:654] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.090204  8284 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.111232  8262 raft_consensus.cc:359] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:48.112565  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51499.3us
I20260709 12:20:48.092669  8266 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:48.116159  8261 tablet_bootstrap.cc:654] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.114205  8262 raft_consensus.cc:385] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.117659  8262 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.118521  8266 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:48.119472  8266 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.118469  8262 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.137110  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 90659c1daf854b0f9323204cf80f7aeb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:48.138530  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90659c1daf854b0f9323204cf80f7aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.138159  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 90659c1daf854b0f9323204cf80f7aeb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:48.139580  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90659c1daf854b0f9323204cf80f7aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.140556  8263 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:48.141320  8263 ts_tablet_manager.cc:1403] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.004s
I20260709 12:20:48.145833  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:48.147184  8262 ts_tablet_manager.cc:1434] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.006s
I20260709 12:20:48.148705  8261 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:48.149006  8262 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:48.149209  8261 ts_tablet_manager.cc:1403] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.009s
I20260709 12:20:48.151508  8263 raft_consensus.cc:359] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.151917  8202 tablet_service.cc:1511] Processing CreateTablet for tablet aa46cdee469046e0a85f4a03d2e03f92 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:48.156395  8263 raft_consensus.cc:385] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.157313  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa46cdee469046e0a85f4a03d2e03f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.157109  8263 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.155175  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 90659c1daf854b0f9323204cf80f7aeb (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:48.156279  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:48.161104  8284 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.162321  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90659c1daf854b0f9323204cf80f7aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.160847  8263 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.165663  8263 ts_tablet_manager.cc:1434] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:20:48.166860  8056 tablet_service.cc:1511] Processing CreateTablet for tablet 767edb8a304f440591a33aae36a36252 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:48.168398  8262 tablet_bootstrap.cc:654] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.170799  8129 tablet_service.cc:1511] Processing CreateTablet for tablet 767edb8a304f440591a33aae36a36252 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:48.172217  8129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767edb8a304f440591a33aae36a36252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.152165  8261 raft_consensus.cc:359] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.177033  8261 raft_consensus.cc:385] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.177402  8261 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.178531  8263 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:48.183743  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767edb8a304f440591a33aae36a36252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.191171  8263 tablet_bootstrap.cc:654] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.194605  8210 tablet_service.cc:1511] Processing CreateTablet for tablet 767edb8a304f440591a33aae36a36252 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:48.195909  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767edb8a304f440591a33aae36a36252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.196014  8053 tablet_service.cc:1511] Processing CreateTablet for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:48.197244  8053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753bdf66ab9c48ceb9558028f4bcf7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.204272  8261 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.213409  8261 ts_tablet_manager.cc:1434] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.004s
I20260709 12:20:48.214483  8261 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:48.223021  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08eb4ae8cb45649565146d64ab2983 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:48.223178  8130 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08eb4ae8cb45649565146d64ab2983 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:48.224400  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08eb4ae8cb45649565146d64ab2983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.224514  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08eb4ae8cb45649565146d64ab2983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.223021  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:48.225958  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753bdf66ab9c48ceb9558028f4bcf7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.226769  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:48.227432  8262 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.227941  8262 ts_tablet_manager.cc:1403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.011s
I20260709 12:20:48.228111  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753bdf66ab9c48ceb9558028f4bcf7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.231912  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08eb4ae8cb45649565146d64ab2983 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:48.231999  8262 raft_consensus.cc:359] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.236179  8262 raft_consensus.cc:385] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.236570  8262 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.237497  8262 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.237990  8054 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6e4aa49014b1fb0432076a5974c70 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:48.239348  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6e4aa49014b1fb0432076a5974c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.239537  8135 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6e4aa49014b1fb0432076a5974c70 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:48.240888  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6e4aa49014b1fb0432076a5974c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.241652  8208 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6e4aa49014b1fb0432076a5974c70 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:48.245034  8131 tablet_service.cc:1511] Processing CreateTablet for tablet bcacb9654fe1491c9fa2dc488d15060a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:48.245769  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08eb4ae8cb45649565146d64ab2983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.246299  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcacb9654fe1491c9fa2dc488d15060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.247701  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6e4aa49014b1fb0432076a5974c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.246379  7966 catalog_manager.cc:5697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.249930  8057 tablet_service.cc:1511] Processing CreateTablet for tablet bcacb9654fe1491c9fa2dc488d15060a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:48.251003  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcacb9654fe1491c9fa2dc488d15060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.255142  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 0cbf17a8c7e94e15b3279358c79cf509 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.258407  8209 tablet_service.cc:1511] Processing CreateTablet for tablet bcacb9654fe1491c9fa2dc488d15060a (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:48.259675  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcacb9654fe1491c9fa2dc488d15060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.261565  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 0cbf17a8c7e94e15b3279358c79cf509 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.262854  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cbf17a8c7e94e15b3279358c79cf509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.266201  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cbf17a8c7e94e15b3279358c79cf509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.275095  8262 ts_tablet_manager.cc:1434] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:20:48.275241  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 0cbf17a8c7e94e15b3279358c79cf509 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.278481  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cbf17a8c7e94e15b3279358c79cf509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.276202  8262 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:48.286298  8267 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.286804  8267 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.289909  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:48.291460  8109 leader_election.cc:343] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.292415  8267 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.294198  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:48.296145  8266 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.302181  8266 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:48.302814  8110 leader_election.cc:343] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.303259  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:48.304250  8266 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:48.304921  8267 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.308864  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:48.311367  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:48.313184  8186 leader_election.cc:343] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:48.315146  8184 leader_election.cc:343] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.315593  8184 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:48.317796  8261 tablet_bootstrap.cc:654] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.319976  8266 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.333607  8262 tablet_bootstrap.cc:654] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.347875  8130 tablet_service.cc:1511] Processing CreateTablet for tablet dea9fb7818f049248d8577e73c087888 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:48.355161  8263 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:48.354792  8210 tablet_service.cc:1511] Processing CreateTablet for tablet dea9fb7818f049248d8577e73c087888 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:48.355924  8263 ts_tablet_manager.cc:1403] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.010s
I20260709 12:20:48.356381  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea9fb7818f049248d8577e73c087888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.359543  8263 raft_consensus.cc:359] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.361449  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea9fb7818f049248d8577e73c087888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.363698  8055 tablet_service.cc:1511] Processing CreateTablet for tablet dea9fb7818f049248d8577e73c087888 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:20:48.374678  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:48.375010  8060 tablet_service.cc:1511] Processing CreateTablet for tablet a2f0fc39df96412f9cce0cd90f6f96e2 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:48.376463  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea9fb7818f049248d8577e73c087888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.377260  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f0fc39df96412f9cce0cd90f6f96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.377655  8131 tablet_service.cc:1511] Processing CreateTablet for tablet a2f0fc39df96412f9cce0cd90f6f96e2 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:48.381734  8261 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:48.382360  8261 ts_tablet_manager.cc:1403] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.004s
I20260709 12:20:48.385506  8261 raft_consensus.cc:359] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.386281  8261 raft_consensus.cc:385] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.386608  8261 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.387746  8261 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.389021  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f0fc39df96412f9cce0cd90f6f96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.370394  8263 raft_consensus.cc:385] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.396224  8263 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.395762  8206 tablet_service.cc:1511] Processing CreateTablet for tablet a2f0fc39df96412f9cce0cd90f6f96e2 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:48.397328  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f0fc39df96412f9cce0cd90f6f96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.396996  8263 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.403714  8267 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:48.407132  8055 tablet_service.cc:1511] Processing CreateTablet for tablet 14112996240a40858e18c7a0d75b2a12 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:48.408337  8261 ts_tablet_manager.cc:1434] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:20:48.409277  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14112996240a40858e18c7a0d75b2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.412961  8261 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:48.420651  8284 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:48.421051  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 14112996240a40858e18c7a0d75b2a12 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:48.421164  8054 tablet_service.cc:1511] Processing CreateTablet for tablet badbfade73ce40f0a89515d01fe50bd6 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.426234  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14112996240a40858e18c7a0d75b2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.426257  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badbfade73ce40f0a89515d01fe50bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.428243  8263 ts_tablet_manager.cc:1434] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.072s	user 0.002s	sys 0.005s
I20260709 12:20:48.428536  8133 tablet_service.cc:1511] Processing CreateTablet for tablet badbfade73ce40f0a89515d01fe50bd6 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.429773  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badbfade73ce40f0a89515d01fe50bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.429811  8262 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.430420  8262 ts_tablet_manager.cc:1403] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.154s	user 0.025s	sys 0.019s
I20260709 12:20:48.432973  8267 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.433482  8267 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.435902  8261 tablet_bootstrap.cc:654] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.435892  8262 raft_consensus.cc:359] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.437638  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:48.438714  8069 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:48.439968  8262 raft_consensus.cc:385] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.440740  8262 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.440706  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:48.442945  8220 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:48.441620  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.441761  8130 tablet_service.cc:1511] Processing CreateTablet for tablet 14112996240a40858e18c7a0d75b2a12 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:48.442165  8267 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.442183  8263 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:48.454921  8287 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:48.455358  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14112996240a40858e18c7a0d75b2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.455369  8287 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.455899  8287 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.461388  8210 tablet_service.cc:1511] Processing CreateTablet for tablet badbfade73ce40f0a89515d01fe50bd6 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.462754  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badbfade73ce40f0a89515d01fe50bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.466207  8266 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.465847  8262 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.466790  8266 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.469305  8266 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:48.471251  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:48.471519  8262 ts_tablet_manager.cc:1434] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:20:48.472563  8262 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
W20260709 12:20:48.472862  8186 leader_election.cc:343] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.473177  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:48.475641  8184 leader_election.cc:343] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.476133  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:48.478747  8262 tablet_bootstrap.cc:654] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.486129  8266 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.487304  8287 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.490507  8263 tablet_bootstrap.cc:654] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.495311  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:48.496021  8069 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.502370  8263 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:48.503841  8263 ts_tablet_manager.cc:1403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.001s
I20260709 12:20:48.508882  8287 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:20:48.510604  7953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50645.6us
I20260709 12:20:48.510710  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:48.546867  8220 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.547309  8262 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.547883  8262 ts_tablet_manager.cc:1403] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.022s
I20260709 12:20:48.508996  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.549078  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.548988  8054 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.550643  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.555099  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.557039  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.514777  8069 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:48.762914  8261 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:48.763667  8261 ts_tablet_manager.cc:1403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.351s	user 0.007s	sys 0.006s
I20260709 12:20:48.767386  8262 raft_consensus.cc:359] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.836717  8263 raft_consensus.cc:359] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.843973  8263 raft_consensus.cc:385] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.844535  8263 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.845801  8263 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.847890  8220 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:48.849716  8263 ts_tablet_manager.cc:1434] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.345s	user 0.009s	sys 0.004s
I20260709 12:20:48.851164  8263 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:48.836512  8262 raft_consensus.cc:385] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.854475  8262 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.857231  8262 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.857249  8261 raft_consensus.cc:359] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.860740  8261 raft_consensus.cc:385] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.861196  8261 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.863005  8261 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.864380  8110 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.865990  8262 ts_tablet_manager.cc:1434] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.318s	user 0.008s	sys 0.008s
I20260709 12:20:48.867827  8262 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:48.866259  8261 ts_tablet_manager.cc:1434] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.002s
I20260709 12:20:48.866633  8315 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:48.871783  8315 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:48.872771  8315 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.872798  8261 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:48.878823  8315 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.879365  8315 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.881807  8261 tablet_bootstrap.cc:654] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.882501  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:48.883239  8219 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:48.884676  8262 tablet_bootstrap.cc:654] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.884729  8110 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.885886  8314 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:48.886296  8314 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.886655  8314 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.894515  8261 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:48.895067  8261 ts_tablet_manager.cc:1403] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:20:48.897863  8261 raft_consensus.cc:359] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.896917  8315 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.898625  8261 raft_consensus.cc:385] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.900244  8261 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.900740  8314 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.901096  8261 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.903254  8262 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.903483  8261 ts_tablet_manager.cc:1434] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:48.904099  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:48.904318  8262 ts_tablet_manager.cc:1403] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.014s
I20260709 12:20:48.904723  8219 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.907145  8262 raft_consensus.cc:359] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.907843  8262 raft_consensus.cc:385] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.908181  8262 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.909336  8261 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:48.908938  8262 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.910761  8262 ts_tablet_manager.cc:1434] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:48.911772  8262 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:48.917251  8261 tablet_bootstrap.cc:654] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.918030  8219 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:48.919574  8110 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:48.920516  8315 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:48.921295  8314 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.926855  8315 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:48.927873  8262 tablet_bootstrap.cc:654] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.928697  8315 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.936105  8262 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:48.938941  8261 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:48.939467  8261 ts_tablet_manager.cc:1403] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
W20260709 12:20:48.939747  8096 tablet.cc:2406] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:48.942358  8261 raft_consensus.cc:359] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.943043  8261 raft_consensus.cc:385] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.943341  8261 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.944139  8261 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.946286  8261 ts_tablet_manager.cc:1434] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:48.947333  8261 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:48.936703  8262 ts_tablet_manager.cc:1403] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:20:48.953222  8261 tablet_bootstrap.cc:654] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.976876  8271 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.977586  8271 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.980974  8284 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:48.982002  8266 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.982259  8263 tablet_bootstrap.cc:654] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.982589  8266 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.983626  8271 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:48.984923  8266 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:20:48.986982  7953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 436333us
I20260709 12:20:48.987516  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:48.994184  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:48.995291  8219 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:48.953022  8262 raft_consensus.cc:359] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:48.998382  8262 raft_consensus.cc:385] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.998806  8262 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.999805  8262 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.002851  8262 ts_tablet_manager.cc:1434] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.013s
I20260709 12:20:49.004211  8262 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.005751  8146 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:49.013029  8262 tablet_bootstrap.cc:654] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.013723  8261 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.014250  8261 ts_tablet_manager.cc:1403] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.067s	user 0.037s	sys 0.028s
I20260709 12:20:49.017493  8261 raft_consensus.cc:359] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.017942  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.018438  8261 raft_consensus.cc:385] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.018853  8261 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.019718  8055 tablet_service.cc:1511] Processing CreateTablet for tablet fae0a66399b64e649f375238dc4cbcde (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:49.019755  8261 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.021421  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0a66399b64e649f375238dc4cbcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.022671  8261 ts_tablet_manager.cc:1434] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:49.023726  8261 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.024477  8262 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.024947  8262 ts_tablet_manager.cc:1403] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.012s
I20260709 12:20:49.027568  8262 raft_consensus.cc:359] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.028322  8262 raft_consensus.cc:385] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.028584  8262 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.029335  8262 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.031509  8261 tablet_bootstrap.cc:654] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.031845  8262 ts_tablet_manager.cc:1434] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:49.032809  8262 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.035328  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.038563  8262 tablet_bootstrap.cc:654] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.043298  8266 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:49.044723  8261 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.045271  8261 ts_tablet_manager.cc:1403] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:20:49.027501  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.048261  8261 raft_consensus.cc:359] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.051029  8261 raft_consensus.cc:385] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.051808  8261 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.050675  8262 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.048640  8069 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:49.053012  8262 ts_tablet_manager.cc:1403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:20:49.053593  8261 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.049899  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:49.055948  8262 raft_consensus.cc:359] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.054630  8068 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.058475  8262 raft_consensus.cc:385] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.058012  8261 ts_tablet_manager.cc:1434] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:49.060237  8261 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.062541  8262 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.063350  8262 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.065506  8262 ts_tablet_manager.cc:1434] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:20:49.066479  8262 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.074324  8261 tablet_bootstrap.cc:654] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.087750  8068 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:49.094324  8271 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.119133  8262 tablet_bootstrap.cc:654] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.135341  8331 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:49.143528  8133 tablet_service.cc:1511] Processing CreateTablet for tablet fae0a66399b64e649f375238dc4cbcde (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:49.144522  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0a66399b64e649f375238dc4cbcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.158838  8186 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.159737  8331 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.160110  8331 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.160413  8331 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.165115  8331 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.167515  8331 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.167939  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:49.169198  8184 leader_election.cc:343] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.171247  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:49.171667  8146 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.175238  8314 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.175720  8314 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.177102  8146 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:49.177886  8314 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.178608  8186 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.179440  8331 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.179921  8331 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:49.180449  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.180855  8331 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:49.181960  8109 leader_election.cc:343] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.182530  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:49.183174  8220 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:49.184476  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.185896  8314 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.185904  8267 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.186471  8314 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.186936  8314 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.186667  8267 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.187816  8263 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:49.188351  8263 ts_tablet_manager.cc:1403] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.338s	user 0.050s	sys 0.080s
I20260709 12:20:49.189787  8267 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.189903  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:49.191309  8109 leader_election.cc:343] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.191390  8263 raft_consensus.cc:359] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.192299  8263 raft_consensus.cc:385] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.192646  8263 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.193459  8263 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.194353  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:49.195003  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:49.197328  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.198426  8315 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:49.200088  8315 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.200435  8315 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.200805  8315 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.201356  8263 ts_tablet_manager.cc:1434] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:49.202423  8263 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:49.203338  8261 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.203809  8261 ts_tablet_manager.cc:1403] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.001s
I20260709 12:20:49.208127  8209 tablet_service.cc:1511] Processing CreateTablet for tablet fae0a66399b64e649f375238dc4cbcde (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:49.230305  8133 tablet_service.cc:1511] Processing CreateTablet for tablet a313281992bb42fbb55e3eb70444bb6f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:49.208616  8263 tablet_bootstrap.cc:654] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.238145  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a313281992bb42fbb55e3eb70444bb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.209329  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0a66399b64e649f375238dc4cbcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.226317  8210 tablet_service.cc:1511] Processing CreateTablet for tablet a313281992bb42fbb55e3eb70444bb6f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:49.226130  8055 tablet_service.cc:1511] Processing CreateTablet for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:49.242509  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.243032  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a313281992bb42fbb55e3eb70444bb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.229395  8130 tablet_service.cc:1511] Processing CreateTablet for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:49.245095  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.209239  8261 raft_consensus.cc:359] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.247156  8261 raft_consensus.cc:385] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.247565  8261 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.248157  8261 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.255631  8261 ts_tablet_manager.cc:1434] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:20:49.256742  8261 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.214820  8315 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.258934  8315 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.211512  8266 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.212865  8314 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.265266  8266 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.266919  8314 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.267513  8266 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.221046  8271 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.219576  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.277544  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.277659  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 61d6819393b345508f4a0ced5669567e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:49.278328  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.278973  8146 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:49.279161  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d6819393b345508f4a0ced5669567e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.279573  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 61d6819393b345508f4a0ced5669567e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:49.280229  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:49.280364  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:49.280869  8219 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.281071  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d6819393b345508f4a0ced5669567e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.282819  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.283334  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.272943  8271 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:49.284240  8109 leader_election.cc:343] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.284065  8202 tablet_service.cc:1511] Processing CreateTablet for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:20:49.284994  8184 leader_election.cc:343] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.285388  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.227500  8054 tablet_service.cc:1511] Processing CreateTablet for tablet a313281992bb42fbb55e3eb70444bb6f (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:20:49.285982  8184 leader_election.cc:343] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.285776  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 61d6819393b345508f4a0ced5669567e (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:49.286543  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a313281992bb42fbb55e3eb70444bb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.287052  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d6819393b345508f4a0ced5669567e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.288134  8271 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.280892  8220 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.290405  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.290943  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.291523  8146 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:49.292306  8136 tablet_service.cc:1511] Processing CreateTablet for tablet a76facb821d9488284580418cf9bbf22 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:49.293020  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.293730  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76facb821d9488284580418cf9bbf22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:49.294312  8109 leader_election.cc:343] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.301087  8056 tablet_service.cc:1511] Processing CreateTablet for tablet a76facb821d9488284580418cf9bbf22 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:49.301594  8135 tablet_service.cc:1511] Processing CreateTablet for tablet b9927bbb5560416bbc804210e19bb0ce (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:49.302372  8056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76facb821d9488284580418cf9bbf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.302820  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9927bbb5560416bbc804210e19bb0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.292344  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:49.305195  8218 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:49.305023  8203 tablet_service.cc:1511] Processing CreateTablet for tablet a76facb821d9488284580418cf9bbf22 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:49.306252  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76facb821d9488284580418cf9bbf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.307538  7967 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.309698  7967 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.318439  8057 tablet_service.cc:1511] Processing CreateTablet for tablet b9927bbb5560416bbc804210e19bb0ce (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:49.319701  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9927bbb5560416bbc804210e19bb0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.299064  8271 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.342321  8333 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.344437  8208 tablet_service.cc:1511] Processing CreateTablet for tablet b9927bbb5560416bbc804210e19bb0ce (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:49.342774  8333 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.345417  8333 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.329010  8314 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:20:49.341722  8271 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.349715  8271 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.351679  8055 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:49.345992  8287 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.352596  8287 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.353178  8055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9cc1738e4ab29ea95fed6e4f6b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.354041  8314 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:49.358984  8130 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:49.360731  8130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9cc1738e4ab29ea95fed6e4f6b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.379477  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:49.382340  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9927bbb5560416bbc804210e19bb0ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:49.394196  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:49.397956  8219 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:49.412582  8287 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.417420  8208 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 (DEFAULT_TABLE table=test-workload [id=c554e408e96144d09daf087dd7b99f0f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:49.421434  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9cc1738e4ab29ea95fed6e4f6b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:49.435529  8266 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.460719  8262 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.461409  8262 ts_tablet_manager.cc:1403] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.395s	user 0.011s	sys 0.025s
I20260709 12:20:49.476338  8334 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.476567  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.476982  8334 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.479354  8334 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:20:49.480211  8109 leader_election.cc:343] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.483826  8333 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.486527  8261 tablet_bootstrap.cc:654] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.489161  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:49.490785  8186 leader_election.cc:343] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.489207  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.459870  8266 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.494299  8068 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:49.495939  8266 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.497344  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:49.499946  8266 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.500494  8266 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.499145  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.501031  8266 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.501683  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.502451  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.473935  8287 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:20:49.487318  8271 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.517346  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.519973  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:20:49.522701  8184 leader_election.cc:343] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.520907  8146 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.527539  8333 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.512674  8315 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:20:49.524396  8186 leader_election.cc:343] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.516417  8311 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.532958  8186 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:49.533362  8311 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:49.534699  8311 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.536309  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:49.537308  8145 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.525808  8319 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.542527  8319 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:49.545533  8271 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.543921  8319 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.565310  8262 raft_consensus.cc:359] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.566627  8262 raft_consensus.cc:385] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.567109  8262 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.567243  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.554129  8333 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.571600  8263 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:49.571986  8263 ts_tablet_manager.cc:1403] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.370s	user 0.017s	sys 0.012s
I20260709 12:20:49.575338  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:49.576040  8220 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.578845  8145 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:49.580283  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:49.581805  8110 leader_election.cc:343] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.582299  8110 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.583830  8262 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.584800  8267 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.587054  8262 ts_tablet_manager.cc:1434] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.125s	user 0.025s	sys 0.033s
I20260709 12:20:49.589926  8262 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.600919  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.601727  8220 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
W20260709 12:20:49.602121  8184 leader_election.cc:343] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.602648  8333 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.603627  8333 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:49.605854  8333 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.618110  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:49.619549  8284 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.620275  8284 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:49.621580  8284 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.647612  8261 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.648372  8261 ts_tablet_manager.cc:1403] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.392s	user 0.041s	sys 0.030s
I20260709 12:20:49.660949  8263 raft_consensus.cc:359] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.662045  8263 raft_consensus.cc:385] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.662410  8263 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.664072  8263 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.648910  8266 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.670508  8263 ts_tablet_manager.cc:1434] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.002s
W20260709 12:20:49.671638  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:49.673007  8263 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:49.680353  8266 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.681614  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.683439  8262 tablet_bootstrap.cc:654] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.683396  8067 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.668380  8146 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:49.694654  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:20:49.696344  8186 leader_election.cc:343] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.698313  8261 raft_consensus.cc:359] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.699046  8261 raft_consensus.cc:385] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.699309  8261 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.700006  8261 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.705318  8263 tablet_bootstrap.cc:654] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.705708  8266 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:49.711700  8261 ts_tablet_manager.cc:1434] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
I20260709 12:20:49.712183  8262 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.712809  8261 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.713018  8262 ts_tablet_manager.cc:1403] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.004s
I20260709 12:20:49.715888  8262 raft_consensus.cc:359] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.716604  8262 raft_consensus.cc:385] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.716931  8262 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.707702  8067 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:49.719213  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:49.720417  8266 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.721140  8266 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:49.722020  8266 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.730178  8261 tablet_bootstrap.cc:654] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.730306  8262 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.734196  8262 ts_tablet_manager.cc:1434] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.005s
I20260709 12:20:49.737103  8262 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.735651  7965 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.746410  8261 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.756990  8262 tablet_bootstrap.cc:654] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.757550  8261 ts_tablet_manager.cc:1403] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.010s
I20260709 12:20:49.764516  8315 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.765282  8315 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.766322  8262 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.766862  8262 ts_tablet_manager.cc:1403] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 12:20:49.769349  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.770128  8067 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:49.769550  8315 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.770757  8263 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:49.772260  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.773607  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:49.775485  8219 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:49.775679  8315 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.772766  8262 raft_consensus.cc:359] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.776544  8262 raft_consensus.cc:385] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.776895  8262 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.776072  8315 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.777755  8315 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.777714  8262 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.780273  8262 ts_tablet_manager.cc:1434] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:49.771914  8261 raft_consensus.cc:359] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.780798  8261 raft_consensus.cc:385] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.781170  8261 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.782196  8261 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.781898  7966 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.784991  8261 ts_tablet_manager.cc:1434] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:20:49.785405  8263 ts_tablet_manager.cc:1403] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.113s	user 0.031s	sys 0.027s
I20260709 12:20:49.786067  8261 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.788405  8263 raft_consensus.cc:359] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.789069  8263 raft_consensus.cc:385] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.789317  8263 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.790349  8315 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.793289  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:49.793912  8067 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.794839  8262 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.795605  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.797096  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:49.797730  8219 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.797259  7967 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.798182  8315 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.798858  8263 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.800875  8263 ts_tablet_manager.cc:1434] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:49.801831  8263 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:49.810251  8219 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:49.811401  8263 tablet_bootstrap.cc:654] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.811717  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.812772  8315 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.813346  8315 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:49.805401  8262 tablet_bootstrap.cc:654] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.814359  8315 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.820506  8067 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:49.821924  8261 tablet_bootstrap.cc:654] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.838060  8261 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.838635  8261 ts_tablet_manager.cc:1403] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 12:20:49.853360  8261 raft_consensus.cc:359] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.854159  8261 raft_consensus.cc:385] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.855122  8261 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.855942  8261 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.858948  8261 ts_tablet_manager.cc:1434] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:49.858481  7963 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.860103  8261 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.873696  8261 tablet_bootstrap.cc:654] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.880280  8263 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:49.880813  8263 ts_tablet_manager.cc:1403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.079s	user 0.001s	sys 0.040s
I20260709 12:20:49.883577  8263 raft_consensus.cc:359] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.884260  8263 raft_consensus.cc:385] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.884531  8263 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.885422  8271 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.885933  8271 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.886314  7964 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.888070  8271 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.888908  7964 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.890030  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.890906  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:49.891700  8219 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:49.892995  8035 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:49.894235  8271 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.902269  8271 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.904978  8262 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:49.905484  8262 ts_tablet_manager.cc:1403] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.111s	user 0.034s	sys 0.008s
I20260709 12:20:49.905944  8266 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.906486  8266 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.908236  8262 raft_consensus.cc:359] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.908905  8262 raft_consensus.cc:385] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.909158  8262 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.909449  8266 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.909919  8262 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.911633  8261 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:49.912204  8261 ts_tablet_manager.cc:1403] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.016s
I20260709 12:20:49.912456  8262 ts_tablet_manager.cc:1434] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:49.913017  8263 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.913362  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.913810  8284 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.914096  8145 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:49.914294  8284 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.914062  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:49.916719  8186 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:20:49.917491  8184 leader_election.cc:343] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.917717  8266 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.918112  8266 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.918457  8266 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.921707  8284 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.922325  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:49.922950  8145 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:49.924196  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:49.925092  8284 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.925446  8284 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.925894  8284 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.926206  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:49.928000  8035 leader_election.cc:343] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.931133  8284 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.915872  8261 raft_consensus.cc:359] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.932147  8261 raft_consensus.cc:385] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.931422  8266 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.933073  8261 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.933333  8262 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:49.936672  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:49.938356  8184 leader_election.cc:343] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.939442  8266 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:49.940049  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:49.941257  8146 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.978174  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:49.984963  8145 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.978018  8261 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.979961  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:20:49.987263  8035 leader_election.cc:343] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.989826  8146 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:49.982014  8263 ts_tablet_manager.cc:1434] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.004s
I20260709 12:20:49.990794  8261 ts_tablet_manager.cc:1434] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.078s	user 0.022s	sys 0.029s
I20260709 12:20:49.991354  8263 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:49.983635  8262 tablet_bootstrap.cc:654] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.982390  8284 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:49.992602  8261 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:49.993016  8145 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:49.994525  8186 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:49.995821  8266 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.996349  8266 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:49.997107  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:20:49.997946  8284 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.997506  8266 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:49.998453  8284 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:50.000938  8284 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.003974  8315 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.004819  8319 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.007025  8263 tablet_bootstrap.cc:654] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.007575  8261 tablet_bootstrap.cc:654] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.019198  8334 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.019232  8262 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.020956  8262 ts_tablet_manager.cc:1403] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.003s
I20260709 12:20:50.019905  8334 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.029577  8334 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.029781  7964 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.030928  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.031664  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:50.032517  8186 leader_election.cc:343] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:50.033913  8184 leader_election.cc:343] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.034515  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.036000  8334 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.039734  8262 raft_consensus.cc:359] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.042726  8262 raft_consensus.cc:385] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.043131  8262 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.044045  8262 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.058867  8261 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.059401  8261 ts_tablet_manager.cc:1403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.016s
I20260709 12:20:50.060295  8262 ts_tablet_manager.cc:1434] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:20:50.062803  8261 raft_consensus.cc:359] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.063498  8261 raft_consensus.cc:385] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.063769  8261 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.064424  8261 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.066440  8261 ts_tablet_manager.cc:1434] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:20:50.067333  8261 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.061319  7963 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:50.078320  8261 tablet_bootstrap.cc:654] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.079908  8262 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.082911  8284 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.085749  8261 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.086369  8261 ts_tablet_manager.cc:1403] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 12:20:50.089459  8261 raft_consensus.cc:359] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.090513  8261 raft_consensus.cc:385] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.090972  8261 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.092892  8262 tablet_bootstrap.cc:654] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:50.131141  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc540 after lost signal to thread 6877
I20260709 12:20:50.195112  8261 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:50.121127  8109 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.093863  8263 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
W20260709 12:20:50.196362  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 75407.1us
I20260709 12:20:50.196810  8263 ts_tablet_manager.cc:1403] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.206s	user 0.032s	sys 0.052s
I20260709 12:20:50.164278  8267 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:20:50.201220  8263 raft_consensus.cc:359] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.130259  8333 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.202008  8263 raft_consensus.cc:385] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.203083  8263 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.203028  8333 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.204123  8263 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.205896  8263 ts_tablet_manager.cc:1434] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:50.125523  8266 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.206806  8266 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.208298  8145 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.210455  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.211334  8146 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:50.213347  8266 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.104403  8319 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.214913  8319 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:50.195699  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc500 after lost signal to thread 8001
W20260709 12:20:50.218720  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb6a0 after lost signal to thread 8094
W20260709 12:20:50.219910  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08000e13a0 after lost signal to thread 8170
I20260709 12:20:50.105453  8271 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.101s
W20260709 12:20:50.224689  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08000441e0 after lost signal to thread 8244
I20260709 12:20:50.220279  8319 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.232229  8261 ts_tablet_manager.cc:1434] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.000s
I20260709 12:20:50.233656  8261 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.235929  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.238921  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.221458  8334 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.223506  8263 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.254470  8261 tablet_bootstrap.cc:654] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.258729  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.261567  8263 tablet_bootstrap.cc:654] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.265792  8319 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.266464  8319 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.270089  8319 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.272447  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:50.275769  8109 leader_election.cc:343] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.277359  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.278249  8218 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:50.279594  8334 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.287122  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.291312  8267 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.291863  8267 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.292315  8267 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:50.304821  8109 leader_election.cc:343] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.307113  8266 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:50.313378  8184 leader_election.cc:343] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.314389  8184 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.315433  8266 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.327692  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.332069  8333 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.335250  8261 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.335824  8261 ts_tablet_manager.cc:1403] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.010s
I20260709 12:20:50.342448  8311 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.346688  8261 raft_consensus.cc:359] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.347680  8261 raft_consensus.cc:385] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.348031  8261 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.356287  8266 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.357089  8261 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:50.362376  8184 consensus_peers.cc:597] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.366266  8261 ts_tablet_manager.cc:1434] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:20:50.368029  8261 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.370949  8262 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.371428  8262 ts_tablet_manager.cc:1403] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.292s	user 0.115s	sys 0.145s
I20260709 12:20:50.371970  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.373211  8219 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:50.374454  8262 raft_consensus.cc:359] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.375077  8262 raft_consensus.cc:385] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.375341  8262 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.375998  8262 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.386066  8267 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.387661  8143 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:50.388919  8266 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.390166  8267 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.391639  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:50.395133  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.391870  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.392378  8311 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.397300  8262 ts_tablet_manager.cc:1434] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 12:20:50.398046  8263 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.399891  8263 ts_tablet_manager.cc:1403] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.021s
I20260709 12:20:50.401358  8262 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.399422  8266 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.407763  8315 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.404549  8333 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.406177  8267 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:20:50.404771  8109 leader_election.cc:343] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.417385  8267 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.402606  8311 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.421195  8267 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.421437  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:50.416339  8271 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.422796  8311 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.422602  8271 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.424854  8271 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.429641  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.430186  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.432498  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.433153  8217 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:50.434437  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.431282  8267 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.442631  8383 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.445528  8267 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.447834  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:50.442481  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.420146  8333 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:50.450177  8109 leader_election.cc:343] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:50.451004  8109 leader_election.cc:343] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.452154  8333 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.452947  8263 raft_consensus.cc:359] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.453101  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.453743  8263 raft_consensus.cc:385] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:50.455080  8186 leader_election.cc:343] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.458361  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.463914  8315 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.464354  8315 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.464797  8315 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.459842  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:50.460465  8271 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.468947  8220 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:50.469127  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.461122  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.481618  8220 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:50.482483  8263 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.488600  8261 tablet_bootstrap.cc:654] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.489871  8263 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.492015  8315 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.497380  8262 tablet_bootstrap.cc:654] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.495402  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:50.500021  8109 leader_election.cc:343] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.503710  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.504887  8263 ts_tablet_manager.cc:1434] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260709 12:20:50.505949  8263 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.506392  8319 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.507077  8319 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:50.508208  8319 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.511336  8315 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.512387  8067 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:50.521425  8184 leader_election.cc:343] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:50.526746  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:50.521976  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.536654  8333 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.547129  8266 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.562338  8271 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.564119  8263 tablet_bootstrap.cc:654] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.574851  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:50.575541  8216 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.588874  8219 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:50.578009  8266 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.592487  8266 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.603170  8262 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.603688  8262 ts_tablet_manager.cc:1403] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.203s	user 0.017s	sys 0.012s
I20260709 12:20:50.578011  7963 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.608896  8262 raft_consensus.cc:359] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.609566  8262 raft_consensus.cc:385] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.609866  8262 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.610486  8262 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.612255  8262 ts_tablet_manager.cc:1434] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:20:50.598219  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.613214  8262 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.614202  8267 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.614785  8267 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:50.617157  8266 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.615705  8267 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.618963  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.621101  8261 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
W20260709 12:20:50.621464  8186 leader_election.cc:343] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.621688  8261 ts_tablet_manager.cc:1403] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.254s	user 0.038s	sys 0.019s
I20260709 12:20:50.630777  8261 raft_consensus.cc:359] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.644511  8261 raft_consensus.cc:385] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.645092  8261 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.635598  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.637172  8383 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:20:50.646575  8383 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.653053  8383 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.653723  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.654398  8261 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.656077  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.657555  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.658330  8383 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:50.659817  8184 leader_election.cc:343] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.639451  8262 tablet_bootstrap.cc:654] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.634838  8216 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:50.660279  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.665745  8261 ts_tablet_manager.cc:1434] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:20:50.665769  8266 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.666852  8069 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.670933  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.671954  8263 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.672021  8319 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.672533  8263 ts_tablet_manager.cc:1403] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.002s
I20260709 12:20:50.672678  8319 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:50.669866  8261 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.673750  8319 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.728991  8263 raft_consensus.cc:359] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.729851  8263 raft_consensus.cc:385] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.730301  8263 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.731184  8263 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.733981  8263 ts_tablet_manager.cc:1434] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.022s
I20260709 12:20:50.736295  8263 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.744735  8263 tablet_bootstrap.cc:654] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.750823  8262 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.751328  8262 ts_tablet_manager.cc:1403] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.019s
I20260709 12:20:50.754012  8262 raft_consensus.cc:359] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.754547  8262 raft_consensus.cc:385] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.754848  8263 tablet_bootstrap.cc:492] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.754817  8262 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.757324  8261 tablet_bootstrap.cc:654] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.757908  8262 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.760128  8262 ts_tablet_manager.cc:1434] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:20:50.761119  8262 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.755395  8263 ts_tablet_manager.cc:1403] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 12:20:50.769089  8319 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.769578  8319 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.770395  8263 raft_consensus.cc:359] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.771100  8263 raft_consensus.cc:385] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.771391  8263 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.771778  8319 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.772236  8263 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.773590  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.774235  8216 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:50.774902  8263 ts_tablet_manager.cc:1434] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:50.775897  8263 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.775852  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:50.778108  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.779659  8261 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
W20260709 12:20:50.779595  8109 leader_election.cc:343] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.780778  8261 ts_tablet_manager.cc:1403] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.013s
I20260709 12:20:50.783228  8263 tablet_bootstrap.cc:654] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.783484  8261 raft_consensus.cc:359] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.784180  8261 raft_consensus.cc:385] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.784430  8261 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.784994  8262 tablet_bootstrap.cc:654] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.785128  8261 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.787523  8261 ts_tablet_manager.cc:1434] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:50.788424  8261 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.790477  8319 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.791028  8319 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.790644  7963 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.791749  8319 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.800590  8319 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.802343  8261 tablet_bootstrap.cc:654] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.803715  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:50.801375  7963 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:50.809015  8109 leader_election.cc:343] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.813572  8319 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.815275  8263 tablet_bootstrap.cc:492] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.815773  8263 ts_tablet_manager.cc:1403] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 12:20:50.818149  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:50.818696  8216 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.819741  8263 raft_consensus.cc:359] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.820519  8263 raft_consensus.cc:385] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.820839  8263 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.821691  8263 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.824340  8263 ts_tablet_manager.cc:1434] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:50.825351  8263 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.836902  8266 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.837466  8266 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.838788  8383 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.842507  8262 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.842759  8261 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.843003  8262 ts_tablet_manager.cc:1403] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.010s
I20260709 12:20:50.843227  8261 ts_tablet_manager.cc:1403] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.005s
I20260709 12:20:50.841653  8263 tablet_bootstrap.cc:654] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.842075  8383 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.840646  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:50.844189  8266 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.845722  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:50.846024  8184 leader_election.cc:343] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.846141  8262 raft_consensus.cc:359] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.846325  8261 raft_consensus.cc:359] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.846881  8262 raft_consensus.cc:385] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.847038  8261 raft_consensus.cc:385] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.847200  8262 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.847343  8261 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.847926  8262 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.848824  8145 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:50.849912  8216 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:50.850909  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:50.851245  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.852464  8319 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.853143  8262 ts_tablet_manager.cc:1434] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:20:50.854133  8262 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.854432  8186 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.855857  8266 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.856251  8266 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.856653  8266 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.853696  8383 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:50.848028  8261 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.852957  8319 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:50.861902  8319 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.864773  8261 ts_tablet_manager.cc:1434] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 12:20:50.865875  8261 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.861871  8262 tablet_bootstrap.cc:654] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.878587  8262 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:50.878928  8261 tablet_bootstrap.cc:654] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.879091  8262 ts_tablet_manager.cc:1403] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.006s
I20260709 12:20:50.883777  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:50.885192  8216 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:50.886315  8263 tablet_bootstrap.cc:492] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.886453  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:50.886768  8263 ts_tablet_manager.cc:1403] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.015s
I20260709 12:20:50.887703  8383 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.888216  8261 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.888682  8261 ts_tablet_manager.cc:1403] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:20:50.889648  8263 raft_consensus.cc:359] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.890416  8263 raft_consensus.cc:385] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.890739  8263 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.891399  8261 raft_consensus.cc:359] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.892067  8261 raft_consensus.cc:385] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.892354  8261 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.891605  8263 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.893044  8261 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.895181  8263 ts_tablet_manager.cc:1434] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:50.895227  8261 ts_tablet_manager.cc:1434] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:50.895313  7967 catalog_manager.cc:5697] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.897976  8263 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.897977  8261 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.896806  8262 raft_consensus.cc:359] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.900564  8262 raft_consensus.cc:385] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.900962  8262 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.901764  8262 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.904047  8262 ts_tablet_manager.cc:1434] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:20:50.904942  8262 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:50.906379  8263 tablet_bootstrap.cc:654] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.906605  8383 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.911482  8266 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.915304  8261 tablet_bootstrap.cc:654] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.918924  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:50.920037  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:20:50.920336  8184 leader_election.cc:343] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.920653  8143 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.922356  8266 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:50.938161  8319 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.949955  8143 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:50.951987  8186 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:50.953761  8266 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.955591  8266 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:50.957127  8266 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.962024  8263 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:50.962594  8263 ts_tablet_manager.cc:1403] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.022s
I20260709 12:20:50.968361  8263 raft_consensus.cc:359] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.969183  8263 raft_consensus.cc:385] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.969530  8263 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.970268  8263 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.973662  8262 tablet_bootstrap.cc:654] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.974969  8261 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:50.975487  8261 ts_tablet_manager.cc:1403] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.022s
I20260709 12:20:50.978619  8261 raft_consensus.cc:359] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.979400  8261 raft_consensus.cc:385] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.979724  8261 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.973122  8263 ts_tablet_manager.cc:1434] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:20:50.981498  8263 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:50.984922  8261 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:50.987493  8261 ts_tablet_manager.cc:1434] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:20:50.988579  8261 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:50.999838  8263 tablet_bootstrap.cc:654] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.000180  8267 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:51.039692  8261 tablet_bootstrap.cc:654] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.057909  8374 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.055243  7964 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.059527  8383 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.069592  8373 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.070317  8373 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.073645  8373 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:51.074736  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:51.060684  8374 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.079834  8374 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:51.081383  8067 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.087476  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.087837  8319 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.089128  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.068915  8383 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:51.116093  8186 leader_election.cc:343] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.116376  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:51.120414  8186 leader_election.cc:343] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.121733  8263 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:51.122432  8263 ts_tablet_manager.cc:1403] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.006s
I20260709 12:20:51.129868  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.133867  8383 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.134945  8311 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.135660  8311 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.138837  8311 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.140967  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:51.141620  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:51.142452  8216 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:20:51.142760  8109 leader_election.cc:343] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.144145  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.146800  8271 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.152046  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:51.153081  8217 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:51.155849  8069 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.173341  8263 raft_consensus.cc:359] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.173971  8263 raft_consensus.cc:385] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.174254  8263 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.177690  8263 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.182492  8263 ts_tablet_manager.cc:1434] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:20:51.184787  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:51.187139  8319 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.187723  8319 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.188257  8319 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.195503  8263 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:51.200850  8271 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.212779  8262 tablet_bootstrap.cc:492] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:51.213430  8262 ts_tablet_manager.cc:1403] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.309s	user 0.026s	sys 0.111s
W20260709 12:20:51.186580  8184 leader_election.cc:343] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.218569  8267 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.220422  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.221556  8374 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:51.222096  8184 leader_election.cc:343] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.222687  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.224522  8266 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.229116  8068 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.199925  8319 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.241458  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:51.242023  8267 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.241174  8262 raft_consensus.cc:359] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.242666  8267 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.243204  8262 raft_consensus.cc:385] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.243534  8262 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
W20260709 12:20:51.252933  8109 leader_election.cc:343] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.257146  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:51.259011  8109 leader_election.cc:343] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.461796  8261 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:51.462379  8261 ts_tablet_manager.cc:1403] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.474s	user 0.019s	sys 0.030s
I20260709 12:20:51.475731  8373 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.462589  8319 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.304062  8383 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.304061  8266 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.486393  8267 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.495357  8266 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.496838  8383 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.499071  8383 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.499431  8266 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:51.499818  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.500370  8145 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:51.501857  8263 tablet_bootstrap.cc:654] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:51.418210  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 138395us
I20260709 12:20:51.435969  8271 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.487524  8261 raft_consensus.cc:359] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.501830  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.503875  8261 raft_consensus.cc:385] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.504307  8261 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.506434  8261 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.509895  8262 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.512225  8146 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:51.512184  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:51.513556  8261 ts_tablet_manager.cc:1434] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.049s	user 0.002s	sys 0.005s
I20260709 12:20:51.514276  8261 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:51.515386  8262 ts_tablet_manager.cc:1434] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.302s	user 0.040s	sys 0.108s
I20260709 12:20:51.512359  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:51.504922  8271 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.517434  8374 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.518662  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:51.519284  8374 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.519243  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:51.519795  8374 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.519985  8219 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.520462  8218 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:51.523440  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:51.529821  8427 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.530289  8427 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.530656  8427 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.534171  8426 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.537788  8219 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
W20260709 12:20:51.538785  8184 leader_election.cc:343] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.540470  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:51.545897  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 286901us
I20260709 12:20:51.560417  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:51.563719  8374 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.564214  8271 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.565323  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.567816  8261 tablet_bootstrap.cc:654] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.569545  8262 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:51.569444  8267 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.573227  8216 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:20:51.570632  8423 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:20:51.574301  8184 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.569178  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45889.5us
I20260709 12:20:51.575167  8267 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:51.576193  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:51.576930  8218 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:51.576117  8267 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.582521  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.586752  8319 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.588775  8429 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:51.589254  8429 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.589602  8429 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.596593  8263 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:51.597800  8263 ts_tablet_manager.cc:1403] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.036s
I20260709 12:20:51.601260  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:51.601922  8146 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.606688  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:51.612267  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:51.617671  8263 raft_consensus.cc:359] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.618379  8263 raft_consensus.cc:385] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.618642  8263 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.619334  8263 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.609603  8374 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:20:51.623960  8184 leader_election.cc:343] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.627714  8427 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.652503  8262 tablet_bootstrap.cc:654] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.633363  8146 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:51.654384  8261 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:51.655014  8429 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:51.638581  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56834.9us
I20260709 12:20:51.661610  8261 ts_tablet_manager.cc:1403] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.007s
I20260709 12:20:51.660643  8426 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.670444  8263 ts_tablet_manager.cc:1434] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.072s	user 0.016s	sys 0.008s
I20260709 12:20:51.670956  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:51.671514  8263 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:51.671698  8373 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.672230  8373 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:20:51.669324  8109 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.677155  8373 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.677884  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:51.682461  8217 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.682593  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:51.675431  8427 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.673862  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:51.684669  8146 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.691870  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:51.695602  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.697317  8069 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:20:51.699128  8427 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:51.699776  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:51.704785  8217 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:51.678596  8429 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.714617  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:51.716596  8427 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.717355  8427 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:51.718575  8427 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.728375  8262 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:51.735757  8262 ts_tablet_manager.cc:1403] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.166s	user 0.015s	sys 0.004s
I20260709 12:20:51.737399  8146 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:51.735761  8261 raft_consensus.cc:359] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.739288  8261 raft_consensus.cc:385] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.739653  8261 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.740899  8261 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.732719  8383 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.743615  8383 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.746091  8383 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.748884  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.752058  8319 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.752699  8262 raft_consensus.cc:359] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.753328  8311 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.753518  8262 raft_consensus.cc:385] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.753767  8311 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:51.753899  8262 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.754714  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:51.755393  8217 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:51.758622  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:51.759544  8383 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.754730  8262 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.764339  8261 ts_tablet_manager.cc:1434] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.004s
W20260709 12:20:51.767391  8036 leader_election.cc:343] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.759950  8311 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.769806  8311 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.759977  8383 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.771323  8261 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:51.779177  8263 tablet_bootstrap.cc:654] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.780292  8383 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.783980  8262 ts_tablet_manager.cc:1434] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260709 12:20:51.786062  8262 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:51.793815  8261 tablet_bootstrap.cc:654] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.797291  8263 tablet_bootstrap.cc:492] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:51.801862  8262 tablet_bootstrap.cc:654] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.804226  8263 ts_tablet_manager.cc:1403] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.005s
I20260709 12:20:51.816996  8331 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.817651  8331 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.819005  8383 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.821974  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:51.823586  8331 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:51.824685  8263 raft_consensus.cc:359] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.824957  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.825444  8263 raft_consensus.cc:385] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.825779  8263 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
W20260709 12:20:51.823587  8184 leader_election.cc:343] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.826977  8263 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:51.827898  8186 leader_election.cc:343] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.828390  8186 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.829381  7967 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.829612  8331 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.831152  8263 ts_tablet_manager.cc:1434] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:20:51.832233  8263 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:51.829631  7966 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.834594  8262 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:51.834628  8261 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:51.835395  8262 ts_tablet_manager.cc:1403] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 12:20:51.835435  8261 ts_tablet_manager.cc:1403] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.004s
I20260709 12:20:51.841341  8261 raft_consensus.cc:359] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.842051  8261 raft_consensus.cc:385] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.842334  8261 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.842537  8263 tablet_bootstrap.cc:654] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.843079  8261 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.837993  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:20:51.845824  8036 leader_election.cc:343] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.849084  8261 ts_tablet_manager.cc:1434] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:20:51.853724  8383 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:51.855170  8261 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:51.855644  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:51.856309  8218 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.861901  8262 raft_consensus.cc:359] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.862962  8262 raft_consensus.cc:385] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.863343  8262 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.865193  8331 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.864895  8262 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.865754  8331 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.868193  8331 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:51.871433  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:51.871961  8261 tablet_bootstrap.cc:654] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:51.873310  8184 leader_election.cc:343] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.873601  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.874718  8262 ts_tablet_manager.cc:1434] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
W20260709 12:20:51.875051  8186 leader_election.cc:343] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.875147  8218 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:51.875752  8262 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:51.875548  8186 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.878595  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:51.879877  8383 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.880438  8383 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:51.881556  8383 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.878302  8331 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.890492  8263 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:51.891098  8263 ts_tablet_manager.cc:1403] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.008s
I20260709 12:20:51.898586  8263 raft_consensus.cc:359] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.899145  8263 raft_consensus.cc:385] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.899330  8263 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.899807  8263 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.901897  8262 tablet_bootstrap.cc:654] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.902362  8263 ts_tablet_manager.cc:1434] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:51.903419  8263 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:51.917572  8263 tablet_bootstrap.cc:654] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.921566  8261 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:51.922281  8261 ts_tablet_manager.cc:1403] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.008s
I20260709 12:20:51.923636  7967 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.926772  8261 raft_consensus.cc:359] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.927829  8261 raft_consensus.cc:385] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.928220  8261 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.929509  8261 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.944391  8261 ts_tablet_manager.cc:1434] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 12:20:51.945860  8261 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:51.952085  8262 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:51.952615  8262 ts_tablet_manager.cc:1403] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.077s	user 0.028s	sys 0.022s
I20260709 12:20:51.956419  8262 raft_consensus.cc:359] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.957163  8262 raft_consensus.cc:385] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.957480  8262 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.958191  8262 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.960547  8262 ts_tablet_manager.cc:1434] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:20:51.961633  8262 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:51.970835  8262 tablet_bootstrap.cc:654] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.972193  8261 tablet_bootstrap.cc:654] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.980300  8383 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.981122  8383 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:51.987869  8263 tablet_bootstrap.cc:492] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:51.988511  8263 ts_tablet_manager.cc:1403] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.012s
I20260709 12:20:51.986254  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:51.990195  8143 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:51.991685  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:51.987872  8319 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:51.992564  8427 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.992969  8427 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.993338  8427 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.996850  8383 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.005851  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.006659  8217 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:52.011555  8263 raft_consensus.cc:359] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.012238  8263 raft_consensus.cc:385] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.012425  8263 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.013131  8263 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.015697  8263 ts_tablet_manager.cc:1434] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:20:51.980824  7964 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.007509  8427 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.024833  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.025488  8217 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.025857  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:52.026546  8143 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.028940  8331 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.029495  8331 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.023281  8261 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.031102  8261 ts_tablet_manager.cc:1403] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.017s
I20260709 12:20:52.032912  8263 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.033545  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:52.035204  8186 leader_election.cc:343] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.031767  8331 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:52.035684  8427 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.039726  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:52.044592  8184 leader_election.cc:343] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.041841  8143 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:52.045127  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.046494  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.047403  8331 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.048239  8262 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.048834  8262 ts_tablet_manager.cc:1403] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.006s
I20260709 12:20:52.046525  8261 raft_consensus.cc:359] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.050587  8261 raft_consensus.cc:385] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.054327  8217 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:52.050911  8261 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.058498  8261 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.055734  8066 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.048872  8427 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.062618  8261 ts_tablet_manager.cc:1434] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260709 12:20:52.063676  8065 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.065603  8261 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.067767  8331 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.068279  8331 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.064797  8427 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:52.072316  8319 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.071830  8383 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.072595  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.075330  8262 raft_consensus.cc:359] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.076017  8262 raft_consensus.cc:385] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.076058  8319 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.076675  8319 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.079022  8319 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:20:52.079088  8184 leader_election.cc:343] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.073441  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:52.073668  8383 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.076399  8262 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.070608  8331 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:20:52.103762  8186 leader_election.cc:343] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.113282  8383 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.116442  8319 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.126345  8262 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.127311  8319 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.131392  8263 tablet_bootstrap.cc:654] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.072845  8427 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.126613  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.133208  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.134428  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.134675  8217 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.135267  8218 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:52.131803  8319 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.135880  8110 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.133975  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.124564  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.138401  8374 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:52.139721  8109 leader_election.cc:343] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.135921  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:52.137634  8319 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:20:52.137820  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43918.3us
I20260709 12:20:52.141788  8319 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.142510  8319 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.142575  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.138433  8262 ts_tablet_manager.cc:1434] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.002s
I20260709 12:20:52.165196  8262 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:52.144116  8311 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.173453  8261 tablet_bootstrap.cc:654] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.145766  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.175684  8383 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.176182  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.177350  8429 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.145124  8374 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.181365  8374 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.185689  8319 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.197115  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.199150  8374 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:52.200565  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:52.202119  8186 leader_election.cc:343] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:52.204308  8184 leader_election.cc:343] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.204946  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.206755  8374 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.211970  7966 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.243904  8267 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.262341  8262 tablet_bootstrap.cc:654] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.266439  8263 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:52.266953  8263 ts_tablet_manager.cc:1403] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.234s	user 0.008s	sys 0.008s
I20260709 12:20:52.263862  8267 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.274840  8434 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:20:52.275444  8434 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.277204  8263 raft_consensus.cc:359] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.278033  8263 raft_consensus.cc:385] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.278335  8263 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.279594  8263 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.280153  8434 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.284276  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:52.285544  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.287217  8319 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.287691  8267 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.289011  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.291249  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.294026  8263 ts_tablet_manager.cc:1434] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:20:52.294330  8434 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.296600  8311 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.300019  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.301635  8427 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.302191  8373 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.303547  8434 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.310071  8261 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.310642  8261 ts_tablet_manager.cc:1403] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.245s	user 0.028s	sys 0.013s
I20260709 12:20:52.313617  8261 raft_consensus.cc:359] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.314369  8261 raft_consensus.cc:385] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.314678  8261 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.315392  8261 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.317340  8263 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.320559  8374 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.321092  8374 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:52.319003  8109 leader_election.cc:343] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:52.339174  8109 leader_election.cc:343] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.339727  8263 tablet_bootstrap.cc:654] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.377902  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.378650  8218 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.381023  8434 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.383796  8261 ts_tablet_manager.cc:1434] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.006s
I20260709 12:20:52.384521  8261 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.388336  8262 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.388914  8262 ts_tablet_manager.cc:1403] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.224s	user 0.019s	sys 0.008s
I20260709 12:20:52.389007  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.389689  8219 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.391515  8262 raft_consensus.cc:359] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.392285  8262 raft_consensus.cc:385] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.392729  8262 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.395876  8374 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:52.399364  8262 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.404059  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:52.405887  8186 leader_election.cc:343] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.419870  8110 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:20:52.420723  8184 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:52.420887  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.426187  8462 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.426631  8462 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.426963  8462 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.431227  8262 ts_tablet_manager.cc:1434] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:20:52.432507  8262 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
W20260709 12:20:52.443930  8184 leader_election.cc:343] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.444423  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.443390  8383 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.448613  8383 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.451938  8383 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.453382  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.453830  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:52.449466  8374 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.455381  8036 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.456324  8383 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.440085  8219 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.457166  8462 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.466184  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.466604  8261 tablet_bootstrap.cc:654] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:52.468348  8109 leader_election.cc:343] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.472474  8110 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.476831  8311 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.466228  8462 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.477382  8311 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.478333  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.478323  8311 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.479064  8219 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.485438  8263 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:52.485965  8263 ts_tablet_manager.cc:1403] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.022s
I20260709 12:20:52.489283  8065 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.502997  8219 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.503232  8262 tablet_bootstrap.cc:654] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.506217  8261 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.506394  8110 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.506752  8261 ts_tablet_manager.cc:1403] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 12:20:52.507656  8267 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.508231  8267 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.503296  8263 raft_consensus.cc:359] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.508939  8263 raft_consensus.cc:385] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.510394  8263 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.511545  8263 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.509063  8267 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.521106  8263 ts_tablet_manager.cc:1434] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:20:52.509521  8261 raft_consensus.cc:359] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.523083  8261 raft_consensus.cc:385] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.523368  8261 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.528229  8263 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.524276  8261 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.545589  8261 ts_tablet_manager.cc:1434] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 12:20:52.546591  8261 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.558352  7967 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.560163  7967 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.564101  8262 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.564617  8262 ts_tablet_manager.cc:1403] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.006s
I20260709 12:20:52.571014  8262 raft_consensus.cc:359] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.575342  8263 tablet_bootstrap.cc:654] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.572527  8262 raft_consensus.cc:385] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.575778  8262 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.578097  8383 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.578570  8383 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.580832  8383 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.586337  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:52.588461  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.589373  8219 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:52.590495  8035 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.591696  8383 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.577445  8262 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.594281  8262 ts_tablet_manager.cc:1434] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:20:52.601758  8262 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:52.603502  8261 tablet_bootstrap.cc:654] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.608321  8262 tablet_bootstrap.cc:654] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.609246  8383 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.610496  8263 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:52.611068  8263 ts_tablet_manager.cc:1403] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.011s
I20260709 12:20:52.615612  8263 raft_consensus.cc:359] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.621747  8331 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.622509  8331 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.616552  8263 raft_consensus.cc:385] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.624832  8263 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.625809  8263 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.626338  8331 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:52.626875  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.629045  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:52.630754  8186 leader_election.cc:343] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:52.632131  8184 leader_election.cc:343] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.632681  8263 ts_tablet_manager.cc:1434] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 12:20:52.632655  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:52.633754  8331 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.634518  8263 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.650759  8262 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.651463  8262 ts_tablet_manager.cc:1403] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.004s
I20260709 12:20:52.650774  8261 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.652182  8263 tablet_bootstrap.cc:654] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.652304  8261 ts_tablet_manager.cc:1403] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.022s
I20260709 12:20:52.655843  8262 raft_consensus.cc:359] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.656980  8262 raft_consensus.cc:385] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.662132  8261 raft_consensus.cc:359] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.672470  8261 raft_consensus.cc:385] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.672884  8261 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.673784  8261 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.672470  8262 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.676162  8261 ts_tablet_manager.cc:1434] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:20:52.676074  8262 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.677657  8261 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.684399  8261 tablet_bootstrap.cc:654] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.693281  8427 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.701700  8261 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.702193  8261 ts_tablet_manager.cc:1403] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:20:52.706350  8261 raft_consensus.cc:359] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.707088  8261 raft_consensus.cc:385] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.707420  8262 ts_tablet_manager.cc:1434] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:20:52.708642  8262 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:52.707376  8261 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.715983  8262 tablet_bootstrap.cc:654] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.740263  8261 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.742417  8261 ts_tablet_manager.cc:1434] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 12:20:52.743862  8311 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.744442  8311 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.718451  8263 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:52.747645  8263 ts_tablet_manager.cc:1403] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.009s
I20260709 12:20:52.748591  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.749402  8219 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.719790  8271 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:52.750774  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:52.747730  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.753918  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.755399  8462 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.756597  8311 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.755808  8462 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.752527  8263 raft_consensus.cc:359] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.760601  8263 raft_consensus.cc:385] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.760573  8462 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.743486  8261 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
W20260709 12:20:52.762991  8109 leader_election.cc:343] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.768177  8263 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.769111  8263 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.776798  8263 ts_tablet_manager.cc:1434] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:20:52.777866  8263 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.782996  8261 tablet_bootstrap.cc:654] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.783886  8262 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.784732  8262 ts_tablet_manager.cc:1403] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.004s
I20260709 12:20:52.780611  8462 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.785768  8311 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.786293  8311 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.789188  8311 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.789324  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.790033  8067 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.791837  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.792160  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.792145  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.792816  8311 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.793295  8311 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.793718  8311 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:52.794011  8109 leader_election.cc:343] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.794854  8219 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.799677  8462 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.802527  8263 tablet_bootstrap.cc:654] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.800769  8262 raft_consensus.cc:359] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.804248  8262 raft_consensus.cc:385] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.806170  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.806931  8219 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.808145  8311 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.812352  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.813203  8067 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.804718  8262 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.814395  8262 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.816617  8262 ts_tablet_manager.cc:1434] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:20:52.818195  8262 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:52.820801  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.821367  8261 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.821489  8216 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.821893  8261 ts_tablet_manager.cc:1403] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.012s
I20260709 12:20:52.824908  8311 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.828011  8067 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.830382  8216 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.830509  8219 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.832290  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.834049  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.835587  8462 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.836382  8267 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.836254  8462 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.836990  8267 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.837934  8267 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.837836  8462 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.845117  8261 raft_consensus.cc:359] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.847734  8261 raft_consensus.cc:385] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.848464  8261 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.850320  8261 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.871897  8261 ts_tablet_manager.cc:1434] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 12:20:52.873126  8261 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.887405  7967 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.893729  7967 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.895730  8262 tablet_bootstrap.cc:654] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.897902  8263 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:52.898403  8263 ts_tablet_manager.cc:1403] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.024s
I20260709 12:20:52.902559  8484 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:52.906699  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:52.907100  8319 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.903158  8484 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.907637  8319 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.909971  8319 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.911305  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.911363  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.905925  8263 raft_consensus.cc:359] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.912746  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:52.912482  8263 raft_consensus.cc:385] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.913358  8263 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.913441  8065 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:20:52.913687  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:52.914357  8219 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:52.914125  8263 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:52.915431  8109 leader_election.cc:343] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.916024  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.910634  8319 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:52.916981  8462 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.916239  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:20:52.917394  8462 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.917845  8462 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.918956  8319 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.919544  8319 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.919977  8319 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.923154  8261 tablet_bootstrap.cc:654] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.926239  8263 ts_tablet_manager.cc:1434] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:20:52.915759  8484 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.930428  8319 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.930961  8462 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.932469  8262 tablet_bootstrap.cc:492] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:52.932978  8262 ts_tablet_manager.cc:1403] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.002s
I20260709 12:20:52.933277  8263 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:52.940804  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.940996  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.941612  8219 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:52.942739  8109 leader_election.cc:343] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.936386  8262 raft_consensus.cc:359] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.948963  8219 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:52.949244  8262 raft_consensus.cc:385] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.949666  8262 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.950263  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:52.950620  8262 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.951315  8267 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.951849  8319 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.953008  8262 ts_tablet_manager.cc:1434] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:20:52.954352  8262 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:52.955382  8462 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:52.955263  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:52.955978  8065 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.959231  8261 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:52.959725  8261 ts_tablet_manager.cc:1403] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.004s
I20260709 12:20:52.961567  8263 tablet_bootstrap.cc:654] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.962684  8261 raft_consensus.cc:359] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.963459  8261 raft_consensus.cc:385] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.963675  8065 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:20:52.963737  8261 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.965086  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:52.955299  8484 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:20:52.967407  8311 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.968521  8267 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.965900  8261 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.969525  8267 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:52.971486  8261 ts_tablet_manager.cc:1434] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:20:52.972839  8490 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.980984  8261 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:52.983891  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:52.990248  8311 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:52.990813  8262 tablet_bootstrap.cc:654] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.991288  8311 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.007115  8373 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.012076  8373 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.014446  8373 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.008508  8374 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.018803  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.019312  8374 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:53.020360  8184 leader_election.cc:343] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.021544  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.021808  8374 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.022754  8492 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.023299  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:53.025859  8186 leader_election.cc:343] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.025940  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.026407  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:20:53.028342  8184 leader_election.cc:343] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.023414  8492 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:53.029444  8186 leader_election.cc:343] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.030097  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.030869  8492 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.031471  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.032271  8373 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.033483  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:53.034456  8109 leader_election.cc:343] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.035353  8110 leader_election.cc:343] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.035781  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.031886  8374 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.037218  8267 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.041841  8261 tablet_bootstrap.cc:654] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.043198  8262 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.043708  8262 ts_tablet_manager.cc:1403] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.006s
I20260709 12:20:53.047969  8263 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:53.048385  8263 ts_tablet_manager.cc:1403] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.025s
I20260709 12:20:53.050487  8262 raft_consensus.cc:359] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.051175  8262 raft_consensus.cc:385] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.051442  8262 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.052040  8262 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.056772  8262 ts_tablet_manager.cc:1434] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:53.057706  8262 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.070019  8262 tablet_bootstrap.cc:654] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.075744  8263 raft_consensus.cc:359] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.077346  8383 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.068039  7967 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.078735  8263 raft_consensus.cc:385] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.079130  8263 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.079949  7967 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.080955  8383 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.084002  8383 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.087757  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.088065  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.089510  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.090355  8383 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.090058  8263 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.094260  8261 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.095114  8261 ts_tablet_manager.cc:1403] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.028s
I20260709 12:20:53.097244  8263 ts_tablet_manager.cc:1434] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:20:53.098259  8263 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:53.098083  8261 raft_consensus.cc:359] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.099732  8261 raft_consensus.cc:385] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.100224  8261 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.101401  8261 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.102609  8374 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.103173  8374 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.104451  8261 ts_tablet_manager.cc:1434] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:53.106212  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.106766  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:53.108403  8186 leader_election.cc:343] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.108978  8184 leader_election.cc:343] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.109135  8374 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.109457  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.111002  8261 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.112672  8373 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.120673  8261 tablet_bootstrap.cc:654] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.126153  8263 tablet_bootstrap.cc:654] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.128892  8262 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.129350  8262 ts_tablet_manager.cc:1403] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.000s
I20260709 12:20:53.132797  8262 raft_consensus.cc:359] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.133667  8262 raft_consensus.cc:385] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.134023  8262 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.135033  8262 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.138236  8262 ts_tablet_manager.cc:1434] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:53.140802  8262 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.142170  8261 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.142625  8261 ts_tablet_manager.cc:1403] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.009s
I20260709 12:20:53.145408  8261 raft_consensus.cc:359] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.146064  8261 raft_consensus.cc:385] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.146328  8261 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.146940  8261 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.148998  8261 ts_tablet_manager.cc:1434] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:53.149955  8261 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.151407  8262 tablet_bootstrap.cc:654] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.160300  8261 tablet_bootstrap.cc:654] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.167577  8065 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.183405  8383 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.183962  8383 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.185828  8263 tablet_bootstrap.cc:492] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:53.186354  8263 ts_tablet_manager.cc:1403] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.016s
I20260709 12:20:53.187808  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.187945  8383 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.189101  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.189585  8263 raft_consensus.cc:359] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.189934  8143 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:53.190358  8263 raft_consensus.cc:385] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.190738  8263 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.191457  8263 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.191900  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:53.193359  8429 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.193842  8429 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.188542  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:53.194314  8429 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.198940  8262 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.199656  8262 ts_tablet_manager.cc:1403] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.004s
I20260709 12:20:53.203488  8261 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.203961  8261 ts_tablet_manager.cc:1403] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.025s
I20260709 12:20:53.206187  8429 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.193821  8263 ts_tablet_manager.cc:1434] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:53.208508  8263 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:53.209575  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.209622  8261 raft_consensus.cc:359] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.210253  8219 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.210417  8261 raft_consensus.cc:385] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.210757  8261 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.211409  8261 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.213452  8261 ts_tablet_manager.cc:1434] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:20:53.215958  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:53.216337  8261 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.216557  8143 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.218134  8429 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.223862  8261 tablet_bootstrap.cc:654] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.225077  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:53.226300  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:53.229125  8429 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.229662  8429 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:53.232719  8374 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:20:53.233294  8374 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.234294  8143 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:53.236972  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.238246  8263 tablet_bootstrap.cc:654] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.239715  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.240367  8065 raft_consensus.cc:2368] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3.
I20260709 12:20:53.240698  8374 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.241441  8184 leader_election.cc:400] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3.
I20260709 12:20:53.241740  8184 leader_election.cc:403] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.232126  8429 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.242658  8374 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.253170  8262 raft_consensus.cc:359] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.254210  8262 raft_consensus.cc:385] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.254619  8262 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.261744  8374 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3.
I20260709 12:20:53.262621  8262 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.270413  8319 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.266516  8262 ts_tablet_manager.cc:1434] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.003s
I20260709 12:20:53.282521  8263 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:53.283849  8263 ts_tablet_manager.cc:1403] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.009s
I20260709 12:20:53.282521  8261 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.285382  8261 ts_tablet_manager.cc:1403] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.013s
I20260709 12:20:53.286558  8263 raft_consensus.cc:359] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.288383  8262 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.293243  8490 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.295027  8262 tablet_bootstrap.cc:654] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.308872  8261 raft_consensus.cc:359] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.311355  8261 raft_consensus.cc:385] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.312211  8261 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.313457  8261 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.319419  8261 ts_tablet_manager.cc:1434] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:20:53.287250  8263 raft_consensus.cc:385] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.321406  8263 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.322183  8263 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.322976  8261 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.327131  8263 ts_tablet_manager.cc:1434] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:20:53.328084  8263 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:53.329067  8261 tablet_bootstrap.cc:654] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.334971  8263 tablet_bootstrap.cc:654] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.335134  7967 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.341169  8374 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.341782  8374 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.345081  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:53.347003  8184 leader_election.cc:343] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.352210  8262 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.352713  8262 ts_tablet_manager.cc:1403] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.006s
I20260709 12:20:53.353084  8070 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.356168  8262 raft_consensus.cc:359] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.356958  8262 raft_consensus.cc:385] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.357448  8262 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.358798  8262 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.362979  8262 ts_tablet_manager.cc:1434] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:53.363615  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.363982  8262 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.364327  8143 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:53.366065  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.367681  8331 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.368100  8331 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.368479  8331 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.372202  8490 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.375617  8261 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.376194  8261 ts_tablet_manager.cc:1403] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.003s
I20260709 12:20:53.378753  8262 tablet_bootstrap.cc:654] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.379172  8331 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.380271  8261 raft_consensus.cc:359] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.375614  8374 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.381126  8261 raft_consensus.cc:385] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.381501  8261 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.381634  8490 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.382136  8490 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.382406  8261 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.383576  8311 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.384280  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.384087  8311 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.385236  8261 ts_tablet_manager.cc:1434] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:53.385802  8490 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.385869  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:53.385833  8184 leader_election.cc:343] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.386330  8311 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.386646  8217 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:53.388191  8261 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.387990  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.388561  8263 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:53.389038  8263 ts_tablet_manager.cc:1403] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.017s
I20260709 12:20:53.388795  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.389608  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.388828  8219 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:53.389777  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:53.390839  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:20:53.391144  8109 leader_election.cc:343] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.392288  8109 leader_election.cc:343] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.392534  8319 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.393065  8319 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.393483  8319 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.394358  8462 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.394807  8462 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.395186  8462 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.396682  8261 tablet_bootstrap.cc:654] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.407199  8311 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.409979  8462 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.410457  8267 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.412235  8462 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.393270  8263 raft_consensus.cc:359] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.417057  8263 raft_consensus.cc:385] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.417376  8263 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.417747  8067 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:53.418989  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.419728  8216 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.419814  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.423180  8319 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.426411  8267 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.427317  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.433283  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:53.434007  8141 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:53.427841  8109 leader_election.cc:343] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.428982  8263 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.442526  8216 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:53.444060  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.445896  8141 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
W20260709 12:20:53.458076  8109 leader_election.cc:343] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.460757  8319 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.448342  8311 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.436527  8331 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.469455  8263 ts_tablet_manager.cc:1434] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 12:20:53.469409  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.471119  8263 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:53.472693  8331 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.474593  8331 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:53.477174  8331 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.480980  8067 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.466554  8311 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:53.485482  8311 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.486270  8261 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.486912  8261 ts_tablet_manager.cc:1403] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.005s
I20260709 12:20:53.488752  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.489393  8216 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:53.503302  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56062.3us
I20260709 12:20:53.556608  8262 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.557183  8262 ts_tablet_manager.cc:1403] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.001s
I20260709 12:20:53.559952  8262 raft_consensus.cc:359] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.560653  8262 raft_consensus.cc:385] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.560923  8262 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.561780  8262 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.565304  8068 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.562584  8261 raft_consensus.cc:359] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.586269  8261 raft_consensus.cc:385] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.587149  8261 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.588294  8261 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.589840  8262 ts_tablet_manager.cc:1434] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:20:53.591147  8262 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.593762  8267 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.596711  8267 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.602241  8267 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.598541  8261 ts_tablet_manager.cc:1434] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.111s	user 0.016s	sys 0.008s
I20260709 12:20:53.613619  8261 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.617648  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.621917  7966 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.626706  8462 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:53.627812  8109 leader_election.cc:343] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.620075  8216 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:53.638113  8522 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.657718  8217 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:53.660741  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.661770  8492 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.662235  8492 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:53.663053  8492 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.663985  8263 tablet_bootstrap.cc:654] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.660763  8374 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.673834  8374 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.675719  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.675925  8374 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.676366  8218 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:53.642275  8522 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.681592  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:53.686065  8186 leader_election.cc:343] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.692749  8373 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.682435  8267 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:20:53.693363  8373 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.695516  8373 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.695711  8262 tablet_bootstrap.cc:654] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.700080  8267 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.701143  8271 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.703863  8271 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.707830  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.709275  8271 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.709748  8319 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.710093  8319 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.710390  8319 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.713249  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.692816  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.700383  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.713997  8434 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:20:53.701581  8267 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.731146  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:53.723605  8184 leader_election.cc:343] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.724924  8186 leader_election.cc:343] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.723232  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.721973  8434 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.726816  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.718580  8218 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:53.733598  8184 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:20:53.735158  8184 leader_election.cc:343] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.738613  8184 leader_election.cc:343] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.738520  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.739061  8267 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.739182  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.739516  8066 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:53.740599  8524 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.737138  8141 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:53.741873  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:53.742738  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:53.743259  8311 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.743598  8271 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.743657  8311 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.744081  8271 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.744156  8311 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.744453  8271 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.745113  8261 tablet_bootstrap.cc:654] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.747813  7966 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.752101  8271 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.757539  8271 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.752391  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.758358  8218 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:53.760703  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.761282  8216 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.763911  8522 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.766631  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.767298  8143 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:53.768962  8186 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.770920  8524 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.771274  8524 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.771492  8434 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.771639  8524 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.775136  8319 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.779367  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.782828  8319 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.735946  8374 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.795387  7964 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.804527  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.805226  8215 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.815393  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.813321  8331 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.816763  8109 leader_election.cc:343] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.816740  8331 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.819036  8331 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.809361  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:53.822695  8518 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:53.836084  8263 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
W20260709 12:20:53.836849  8525 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:53.837072  8263 ts_tablet_manager.cc:1403] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.366s	user 0.015s	sys 0.010s
I20260709 12:20:53.825474  8216 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:53.838846  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:53.841080  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.843740  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.844941  8036 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.846109  8271 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:53.851562  8186 leader_election.cc:343] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.853058  8262 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:53.853535  8262 ts_tablet_manager.cc:1403] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.263s	user 0.016s	sys 0.020s
W20260709 12:20:53.853196  8184 leader_election.cc:343] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.859321  8184 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.860356  8373 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.840801  8524 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.868255  8263 raft_consensus.cc:359] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.868969  8263 raft_consensus.cc:385] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.869244  8263 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.871256  8311 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.873230  8141 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:53.874154  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.874926  8066 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:53.876559  8311 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:53.852512  8518 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:20:53.877743  8215 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:53.876600  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:53.882666  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.883776  8263 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.885917  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:53.887037  8217 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:20:53.890739  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.891484  8319 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.881165  8271 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.890372  8267 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.897502  8267 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:53.897441  8263 ts_tablet_manager.cc:1434] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 12:20:53.898036  8271 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:53.899083  8263 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:53.898675  8267 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.898962  8271 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.903944  8261 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:53.904392  8261 ts_tablet_manager.cc:1403] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.291s	user 0.012s	sys 0.001s
I20260709 12:20:53.901916  8262 raft_consensus.cc:359] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.906683  8262 raft_consensus.cc:385] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.907054  8262 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.907938  8262 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.917549  8262 ts_tablet_manager.cc:1434] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.064s	user 0.002s	sys 0.005s
I20260709 12:20:53.919870  8261 raft_consensus.cc:359] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.920143  8524 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:53.920603  8261 raft_consensus.cc:385] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.920945  8261 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.921577  8261 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.921590  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:53.927179  8262 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:53.934448  8261 ts_tablet_manager.cc:1434] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:20:53.935322  8261 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:53.927060  8146 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.937251  8383 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.941082  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:53.940949  8383 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.942977  8383 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:20:53.943745  8184 leader_election.cc:343] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.946640  8146 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:53.947840  8186 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:53.958040  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:53.958863  8220 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:20:53.963953  8184 consensus_peers.cc:597] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.964506  8531 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.965093  8531 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:53.949508  8492 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:53.971608  7966 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.962795  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:53.974022  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:53.967980  8531 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:53.975564  8524 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:53.978422  8434 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.000995  8524 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.004528  8331 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.004673  8524 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.005190  8331 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.007097  8524 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.007298  8331 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.009690  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.011052  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:54.013707  8184 leader_election.cc:343] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.014614  8263 tablet_bootstrap.cc:654] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:54.016508  8184 leader_election.cc:343] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.018079  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.019286  8145 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:54.022640  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.025514  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.029162  8373 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.029397  8186 leader_election.cc:343] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.029910  8186 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.029773  8373 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.032815  8373 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.037084  8374 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.039327  8434 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.041203  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:54.045444  8184 leader_election.cc:343] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.045337  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:54.048260  8186 leader_election.cc:343] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.048707  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.046587  8331 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.049410  8331 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.049819  8331 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.049999  8262 tablet_bootstrap.cc:654] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.050853  8524 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.067349  8331 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.069569  8261 tablet_bootstrap.cc:654] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.086797  7966 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.088970  7964 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.096211  8319 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.096954  8311 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.102218  8263 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.102727  8263 ts_tablet_manager.cc:1403] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.204s	user 0.011s	sys 0.009s
I20260709 12:20:54.105806  8263 raft_consensus.cc:359] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.106483  8263 raft_consensus.cc:385] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.106734  8263 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.107631  8263 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:54.109153  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:54.109819  8263 ts_tablet_manager.cc:1434] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:54.110678  8263 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.135051  8263 tablet_bootstrap.cc:654] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.135435  8262 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.135974  8262 ts_tablet_manager.cc:1403] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.218s	user 0.016s	sys 0.020s
I20260709 12:20:54.137673  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:54.140604  8184 leader_election.cc:343] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.141985  8262 raft_consensus.cc:359] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.142378  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:54.142702  8262 raft_consensus.cc:385] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.143028  8262 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.143698  8262 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.143028  8141 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.146529  8068 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.139173  8331 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.150208  8261 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.150904  8261 ts_tablet_manager.cc:1403] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.216s	user 0.004s	sys 0.009s
I20260709 12:20:54.152701  8262 ts_tablet_manager.cc:1434] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:20:54.154001  8262 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.174670  8141 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:54.176709  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.178287  8531 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.179042  8531 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:54.180385  8261 raft_consensus.cc:359] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.181416  8261 raft_consensus.cc:385] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.181766  8261 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.182629  8261 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.184332  8462 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.180294  8531 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.191061  8261 ts_tablet_manager.cc:1434] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:20:54.192410  8261 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.209501  8263 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.216428  8263 ts_tablet_manager.cc:1403] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.106s	user 0.032s	sys 0.031s
I20260709 12:20:54.222551  8263 raft_consensus.cc:359] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.223400  8263 raft_consensus.cc:385] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.223769  8263 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.236851  8263 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.241678  8262 tablet_bootstrap.cc:654] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.247112  8263 ts_tablet_manager.cc:1434] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:20:54.252149  8263 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.255911  7966 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.268738  8261 tablet_bootstrap.cc:654] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.285080  8263 tablet_bootstrap.cc:654] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.292021  8262 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.292526  8262 ts_tablet_manager.cc:1403] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.002s
I20260709 12:20:54.297169  8262 raft_consensus.cc:359] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.297828  8262 raft_consensus.cc:385] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.298090  8262 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.300383  8263 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.300875  8263 ts_tablet_manager.cc:1403] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.000s
I20260709 12:20:54.302682  8262 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.312728  8262 ts_tablet_manager.cc:1434] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:20:54.314335  8263 raft_consensus.cc:359] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.315001  8263 raft_consensus.cc:385] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.315224  8262 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.315259  8263 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.316159  8263 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.317179  8261 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.321270  8262 tablet_bootstrap.cc:654] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.321792  8261 ts_tablet_manager.cc:1403] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.014s
I20260709 12:20:54.325103  8261 raft_consensus.cc:359] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.326740  8263 ts_tablet_manager.cc:1434] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:20:54.332406  8261 raft_consensus.cc:385] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.332790  8261 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.333448  8261 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.336496  8262 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.336964  8262 ts_tablet_manager.cc:1403] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 12:20:54.340644  8262 raft_consensus.cc:359] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.341281  8262 raft_consensus.cc:385] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.341518  8262 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.342108  8262 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.347991  8492 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.348433  8492 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.350085  8261 ts_tablet_manager.cc:1434] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:20:54.350483  8492 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.352254  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.353092  8262 ts_tablet_manager.cc:1434] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
W20260709 12:20:54.353843  8109 leader_election.cc:343] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.353965  8262 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.356112  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.356839  8217 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.358419  8110 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.360247  8492 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.360713  8263 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.360668  8492 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.361123  8492 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.361454  8261 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.367807  8518 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.368336  8261 tablet_bootstrap.cc:654] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.371507  8492 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.383386  8262 tablet_bootstrap.cc:654] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.383951  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:54.386255  8109 leader_election.cc:343] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.389154  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:54.391223  8261 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.391698  8261 ts_tablet_manager.cc:1403] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.005s
I20260709 12:20:54.393270  8263 tablet_bootstrap.cc:654] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.394121  8261 raft_consensus.cc:359] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.394691  8261 raft_consensus.cc:385] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.394873  8261 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.389767  8492 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.395783  8217 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.396394  8261 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.411293  8217 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.412796  8261 ts_tablet_manager.cc:1434] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:20:54.413230  8110 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.413738  8261 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.418406  8434 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.417181  8492 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.419579  8492 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:54.420568  8492 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.422442  8262 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.422919  8262 ts_tablet_manager.cc:1403] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.000s
I20260709 12:20:54.425720  8263 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.425781  8262 raft_consensus.cc:359] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.426321  8263 ts_tablet_manager.cc:1403] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.003s
I20260709 12:20:54.426615  8262 raft_consensus.cc:385] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.426914  8262 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.427549  8262 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.429306  8263 raft_consensus.cc:359] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.430160  8263 raft_consensus.cc:385] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.430461  8263 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.431203  8263 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.432713  8261 tablet_bootstrap.cc:654] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.433574  8263 ts_tablet_manager.cc:1434] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:54.437122  8263 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.442703  8262 ts_tablet_manager.cc:1434] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:20:54.447809  8261 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.448346  8261 ts_tablet_manager.cc:1403] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:20:54.448361  8262 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.447868  8319 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.453526  8066 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.455302  8261 raft_consensus.cc:359] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.456131  8261 raft_consensus.cc:385] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.462729  8531 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.464563  8263 tablet_bootstrap.cc:654] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:54.467032  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.470315  8261 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.471220  8261 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.471684  7967 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.473465  8261 ts_tablet_manager.cc:1434] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:20:54.474888  8261 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.470321  8262 tablet_bootstrap.cc:654] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.497072  8492 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.498317  8531 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.499029  8531 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.497938  8492 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.503880  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.503575  8261 tablet_bootstrap.cc:654] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:54.512347  8184 leader_election.cc:343] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.513743  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.520817  8066 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.522049  8531 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.524112  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.526947  8319 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.527410  8319 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:54.528855  8186 leader_election.cc:343] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.529351  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.530509  8531 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.531594  8492 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.526276  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.533596  8531 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.532140  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.534313  8217 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.534161  8531 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.535780  8319 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.536291  8531 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.537482  8319 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.537812  8319 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.538086  8319 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.541131  8110 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.541855  8263 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.542070  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.542387  8263 ts_tablet_manager.cc:1403] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.006s
I20260709 12:20:54.541668  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.544782  8492 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.545161  8492 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.545475  8492 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.546648  8263 raft_consensus.cc:359] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:54.546648  8109 leader_election.cc:343] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.547415  8263 raft_consensus.cc:385] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.547721  8263 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.548346  8263 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.550448  8263 ts_tablet_manager.cc:1434] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:54.550917  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.551410  8263 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.551474  8434 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.552078  8434 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.556231  8434 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.556427  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:54.553016  8186 leader_election.cc:343] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.563179  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.564168  8263 tablet_bootstrap.cc:654] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:54.564738  8184 leader_election.cc:343] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.566656  8035 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.567327  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.568380  8331 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.568647  8429 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.572815  8331 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.575832  8331 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.576294  8331 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.578616  8331 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.579368  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.580928  8261 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.581534  8261 ts_tablet_manager.cc:1403] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.107s	user 0.005s	sys 0.011s
W20260709 12:20:54.583266  8184 leader_election.cc:343] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.584429  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.586038  8262 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.586577  8262 ts_tablet_manager.cc:1403] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.008s
I20260709 12:20:54.588429  8263 tablet_bootstrap.cc:492] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.588877  8263 ts_tablet_manager.cc:1403] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 12:20:54.588987  8261 raft_consensus.cc:359] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.589726  8261 raft_consensus.cc:385] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.590001  8261 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.590670  8261 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:54.586052  8186 leader_election.cc:343] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.591483  8263 raft_consensus.cc:359] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.592161  8263 raft_consensus.cc:385] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.592145  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.592541  8263 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.593197  8263 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.595928  8319 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.597559  8067 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.609761  8331 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.610220  8331 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.612303  8331 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.614756  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:54.615912  8186 leader_election.cc:343] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.616605  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.623272  8319 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.583309  8492 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.595593  8262 raft_consensus.cc:359] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.601686  8524 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.625237  8262 raft_consensus.cc:385] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.625730  8262 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.602473  8263 ts_tablet_manager.cc:1434] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:54.605194  8261 ts_tablet_manager.cc:1434] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:20:54.626324  8492 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.626891  8262 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.627168  8263 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.628310  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:54.628922  8217 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.629698  8262 ts_tablet_manager.cc:1434] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 12:20:54.627216  8261 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.632328  8262 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.633631  8263 tablet_bootstrap.cc:654] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.605993  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.636145  8261 tablet_bootstrap.cc:654] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.638917  8263 tablet_bootstrap.cc:492] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.639364  8263 ts_tablet_manager.cc:1403] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:20:54.645896  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:54.646588  8220 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.658321  8263 raft_consensus.cc:359] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.659181  8263 raft_consensus.cc:385] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.659485  8263 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
W20260709 12:20:54.663637  8184 leader_election.cc:343] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.664151  8184 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.664523  8262 tablet_bootstrap.cc:654] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.664750  8263 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.668448  8331 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.671219  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:54.671517  8524 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.671907  8067 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.672676  8220 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.672783  8217 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.674922  8263 ts_tablet_manager.cc:1434] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 12:20:54.675324  8261 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.678628  8110 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.678951  8261 ts_tablet_manager.cc:1403] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.007s
I20260709 12:20:54.680068  8110 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.680673  8462 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.682144  8462 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:54.682358  8261 raft_consensus.cc:359] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.683153  8261 raft_consensus.cc:385] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.683502  8261 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.683583  8311 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.683235  8462 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.684191  8311 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:54.685209  8311 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.678341  8263 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.688439  8262 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.689494  8262 ts_tablet_manager.cc:1403] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.008s
I20260709 12:20:54.691928  8262 raft_consensus.cc:359] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.692662  8262 raft_consensus.cc:385] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.692974  8262 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.693660  8262 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.694325  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:54.695820  8262 ts_tablet_manager.cc:1434] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:20:54.696853  8262 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.703354  8262 tablet_bootstrap.cc:654] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.703114  8331 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.688890  8261 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.710372  8263 tablet_bootstrap.cc:654] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.712348  8261 ts_tablet_manager.cc:1434] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
W20260709 12:20:54.725417  8109 leader_election.cc:343] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.725669  8566 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.726379  8566 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.691752  8067 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.734974  8566 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.739893  8261 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:54.749786  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.750816  8218 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.752991  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.754173  8492 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.754652  8492 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.756217  8492 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.768334  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.769207  8066 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.793452  8492 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.798024  8263 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.798628  8263 ts_tablet_manager.cc:1403] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.015s
I20260709 12:20:54.805888  8262 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.806389  8262 ts_tablet_manager.cc:1403] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.110s	user 0.057s	sys 0.034s
I20260709 12:20:54.809372  8068 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.809525  8492 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.809110  8263 raft_consensus.cc:359] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.810415  8263 raft_consensus.cc:385] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.810454  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:54.810774  8263 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.811079  8218 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.811424  8263 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.811753  8262 raft_consensus.cc:359] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.812597  8262 raft_consensus.cc:385] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.812968  8263 ts_tablet_manager.cc:1434] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:20:54.813040  8262 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.813959  8263 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.814529  8262 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.830209  8262 ts_tablet_manager.cc:1434] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.015s
I20260709 12:20:54.831393  8262 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.833791  8263 tablet_bootstrap.cc:654] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.842947  8261 tablet_bootstrap.cc:654] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.850989  8262 tablet_bootstrap.cc:654] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.844054  8218 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.848366  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:54.852821  8067 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.853650  7963 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.855167  7963 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.852815  8311 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.857079  8311 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.858964  8067 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.860736  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.861085  8311 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.862200  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.862479  8263 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:54.862913  8263 ts_tablet_manager.cc:1403] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 12:20:54.861492  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.862836  8215 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.865238  8492 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.866743  8492 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:20:54.867399  8109 leader_election.cc:343] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.867630  8492 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.870673  8263 raft_consensus.cc:359] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.864725  8383 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.871357  8263 raft_consensus.cc:385] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.871667  8263 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.871503  8383 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.872331  8263 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.874063  8383 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.874450  8263 ts_tablet_manager.cc:1434] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:20:54.875367  8263 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:54.875350  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.879199  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.880729  8319 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.881105  8319 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.881433  8319 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.891014  8319 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.895357  8331 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.897280  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:54.898175  8216 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:54.897742  8331 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.899127  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:54.900324  8331 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:54.901870  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:54.903187  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:54.903594  8141 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:54.903811  8217 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:54.905097  8109 leader_election.cc:343] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.905514  8319 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.905827  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:54.914186  8261 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:54.915087  8261 ts_tablet_manager.cc:1403] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.011s
I20260709 12:20:54.917127  8331 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.904505  8035 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:54.932173  8331 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.940347  8331 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.945185  8262 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:54.944983  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.945648  8262 ts_tablet_manager.cc:1403] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.114s	user 0.020s	sys 0.036s
W20260709 12:20:54.948978  8184 leader_election.cc:343] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:54.949388  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44987.6us
I20260709 12:20:54.955891  8429 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.956326  8429 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.944666  8434 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.959136  8263 tablet_bootstrap.cc:654] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.962388  8492 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.962563  7967 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.963660  8492 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.966112  8492 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.967653  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:54.968294  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:54.969005  8109 leader_election.cc:343] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.970713  8215 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:54.972904  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.973603  8319 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.974097  8319 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.974352  8319 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.977905  8217 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:54.976405  8261 raft_consensus.cc:359] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.981640  8261 raft_consensus.cc:385] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.981948  8261 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.982334  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:54.970840  8429 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:54.983358  8434 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.983680  8492 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.983740  8262 raft_consensus.cc:359] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.984371  8492 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:54.984562  8262 raft_consensus.cc:385] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.984949  8262 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.982684  8261 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.985291  8492 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.986549  8462 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:54.987951  8262 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.990398  8262 ts_tablet_manager.cc:1434] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:20:54.991372  8262 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:54.973151  8331 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:54.994134  8319 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.013576  8319 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.007781  8331 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.015865  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.016047  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:55.016717  8217 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.013013  8462 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:20:55.026907  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.014225  8261 ts_tablet_manager.cc:1434] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.099s	user 0.012s	sys 0.006s
I20260709 12:20:55.014240  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.028506  8261 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:55.035938  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:55.036588  8142 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.013000  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:55.037096  8184 leader_election.cc:343] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.042384  8263 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:55.042841  8263 ts_tablet_manager.cc:1403] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.004s
W20260709 12:20:55.045499  8109 leader_election.cc:343] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.053540  8263 raft_consensus.cc:359] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.054363  8263 raft_consensus.cc:385] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.054651  8263 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.055311  8263 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.055894  8262 tablet_bootstrap.cc:654] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.055891  8070 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.072491  8263 ts_tablet_manager.cc:1434] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:20:55.073542  8263 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:55.076534  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.102676  7963 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.113127  8331 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.120910  8331 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:55.126504  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56596.3us
I20260709 12:20:55.129660  8331 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.133592  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:55.135669  8186 leader_election.cc:343] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.105039  8217 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:55.145341  8142 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:55.146773  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:55.147710  8331 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.148334  8331 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:55.149399  8331 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.150470  8261 tablet_bootstrap.cc:654] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.158602  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:55.162120  8267 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.162773  8267 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:55.163818  8267 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.191243  8263 tablet_bootstrap.cc:654] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.187543  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:55.195214  8184 leader_election.cc:343] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.195822  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.198273  8331 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.207238  8261 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:55.212047  8261 ts_tablet_manager.cc:1403] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.015s
I20260709 12:20:55.216707  8434 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.219964  8261 raft_consensus.cc:359] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.231439  8261 raft_consensus.cc:385] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.232285  8261 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.233551  8261 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.236953  8261 ts_tablet_manager.cc:1434] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 12:20:55.239300  8261 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:55.240690  8434 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.241228  8434 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.244683  8434 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.246474  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.247663  8215 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:55.250846  8261 tablet_bootstrap.cc:654] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.230669  8263 tablet_bootstrap.cc:492] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:55.254388  8263 ts_tablet_manager.cc:1403] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.002s
W20260709 12:20:55.231611  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59662.7us
I20260709 12:20:55.257793  8263 raft_consensus.cc:359] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.258615  8263 raft_consensus.cc:385] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.258961  8263 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.259836  8263 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.262300  8263 ts_tablet_manager.cc:1434] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:55.263382  8263 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:55.267324  8267 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.270115  8262 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:55.270699  8262 ts_tablet_manager.cc:1403] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.280s	user 0.014s	sys 0.020s
I20260709 12:20:55.271123  8070 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.273470  7967 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.276602  8263 tablet_bootstrap.cc:654] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.278258  8262 raft_consensus.cc:359] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.282323  8262 raft_consensus.cc:385] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.282729  8262 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.283463  8262 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.284040  7964 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.287587  8262 ts_tablet_manager.cc:1434] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:20:55.291077  8262 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:55.289866  8261 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:55.292287  8261 ts_tablet_manager.cc:1403] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 12:20:55.295214  8261 raft_consensus.cc:359] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.295956  8261 raft_consensus.cc:385] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.296260  8261 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.297014  8261 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.301571  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.309475  8261 ts_tablet_manager.cc:1434] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:55.311172  8261 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:55.308382  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.312911  8383 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.314499  8263 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:55.314961  8263 ts_tablet_manager.cc:1403] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 12:20:55.322679  8566 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.328056  8594 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.333417  8492 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.338310  8262 tablet_bootstrap.cc:654] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.340957  8263 raft_consensus.cc:359] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.341619  8594 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.344477  8263 raft_consensus.cc:385] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:55.344732  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:55.345235  8263 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.346618  8263 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.379736  8263 ts_tablet_manager.cc:1434] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:20:55.380874  8263 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:55.384207  8261 tablet_bootstrap.cc:654] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.391561  8531 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.392148  8531 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.394335  8492 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.394428  8531 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.395052  8492 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.401494  8492 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.401659  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.401710  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.402594  8262 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:55.403748  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.408272  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.408946  8068 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:55.408310  8217 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:55.407812  8262 ts_tablet_manager.cc:1403] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.005s
W20260709 12:20:55.410948  8186 leader_election.cc:343] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.413589  8263 tablet_bootstrap.cc:654] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.417014  8261 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:55.417629  8261 ts_tablet_manager.cc:1403] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.000s
I20260709 12:20:55.422857  8262 raft_consensus.cc:359] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.422891  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:20:55.423964  8184 leader_election.cc:343] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.423681  8262 raft_consensus.cc:385] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.425443  8462 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.425570  8262 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.425910  8462 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.426298  8462 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.426353  8262 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.424486  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.431493  8531 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.433128  8261 raft_consensus.cc:359] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.433775  8261 raft_consensus.cc:385] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.434044  8261 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.434734  8492 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.437199  8262 ts_tablet_manager.cc:1434] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:20:55.438225  8262 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:55.447010  8261 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.462611  8531 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.463173  8531 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.467455  8531 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.468950  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.470477  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:55.470650  8186 leader_election.cc:343] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.472222  8595 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.472726  8595 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.473840  8068 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.475071  8595 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.477109  8261 ts_tablet_manager.cc:1434] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:20:55.478327  8462 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.480525  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.481217  8220 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:55.481356  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:55.482833  8109 leader_election.cc:343] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:55.484092  8184 leader_election.cc:343] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.484488  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.485181  8531 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.485702  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:55.486737  8492 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.487102  8492 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.487445  8492 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.495752  8492 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.500278  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.501044  8261 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
W20260709 12:20:55.501907  8109 leader_election.cc:343] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.502168  8492 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.504763  8531 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.505268  8531 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.505760  8492 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.507228  8531 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.509286  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:55.509388  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.509945  8220 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:55.510751  8186 leader_election.cc:343] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.519945  8492 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.520444  8462 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.522696  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:55.523489  8219 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.525508  8263 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:55.526201  8263 ts_tablet_manager.cc:1403] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.146s	user 0.027s	sys 0.017s
I20260709 12:20:55.528695  8263 raft_consensus.cc:359] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.529361  8263 raft_consensus.cc:385] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.529675  8263 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.531296  8262 tablet_bootstrap.cc:654] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.522082  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.531383  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.540496  8070 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.544160  8219 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:55.550432  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:55.555576  8263 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.558444  8434 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.561815  8184 leader_election.cc:343] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.564824  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.566020  8331 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.563604  8263 ts_tablet_manager.cc:1434] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:20:55.551530  8595 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.569710  8263 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:55.558856  8220 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:55.576786  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:55.578208  8267 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.567299  8434 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.578747  8267 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:55.579624  8267 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.581351  8261 tablet_bootstrap.cc:654] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.581854  8070 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:55.572328  8595 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:55.584808  8462 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.597663  8531 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.599040  8331 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.599514  8331 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.626019  8331 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:55.596966  8434 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.617010  8068 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.623347  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.598744  8462 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.629225  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.635123  8462 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.636305  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.637543  8263 tablet_bootstrap.cc:654] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:55.637828  8184 leader_election.cc:343] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.637570  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:20:55.638913  8186 leader_election.cc:343] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.639067  8217 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:55.639410  8186 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.640641  8531 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.640872  8110 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:55.641641  8267 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.642057  8267 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.642356  8267 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.628110  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.640899  8595 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.653582  8267 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.648262  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.655380  8267 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.657164  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.673967  8262 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:55.674422  8262 ts_tablet_manager.cc:1403] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.027s
W20260709 12:20:55.680642  8109 leader_election.cc:343] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.682016  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:20:55.682138  8109 leader_election.cc:343] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.682603  8219 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.681422  8492 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.685634  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:55.702396  8581 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.707401  8219 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:55.710848  8110 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:55.712648  8566 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.713177  8566 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:55.714052  8566 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.716535  8262 raft_consensus.cc:359] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.727413  8262 raft_consensus.cc:385] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.730337  8262 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.725778  8068 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.730165  8595 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:20:55.781373  8262 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.793848  8262 ts_tablet_manager.cc:1434] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.004s
I20260709 12:20:55.794598  8262 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:55.795790  8263 tablet_bootstrap.cc:492] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:55.796253  8263 ts_tablet_manager.cc:1403] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.227s	user 0.010s	sys 0.024s
I20260709 12:20:55.808898  8261 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:55.809342  8261 ts_tablet_manager.cc:1403] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.331s	user 0.020s	sys 0.012s
I20260709 12:20:55.798218  8434 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.806057  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 128200us
I20260709 12:20:55.833319  8610 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.833917  8610 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.834450  8263 raft_consensus.cc:359] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.835132  8263 raft_consensus.cc:385] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.835413  8263 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.817590  8434 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:55.843369  8612 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:20:55.844965  8434 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.847906  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:55.856343  8263 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.880380  8610 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.883682  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:55.885437  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.886128  8215 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:55.890740  7963 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.896023  8263 ts_tablet_manager.cc:1434] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 12:20:55.897528  8263 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:55.899856  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:55.900815  7963 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.903728  8311 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.904175  8311 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.904515  8311 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.885895  8617 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:20:55.884392  8068 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
W20260709 12:20:55.947190  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 58733.8us
I20260709 12:20:55.946169  8311 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.950063  8311 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:55.969290  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:55.970156  8067 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.987812  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:55.988030  8261 raft_consensus.cc:359] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:55.989068  8261 raft_consensus.cc:385] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.989449  8261 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.992540  8067 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
W20260709 12:20:55.994812  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93849us
I20260709 12:20:55.994370  8261 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.001389  8261 ts_tablet_manager.cc:1434] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.192s	user 0.008s	sys 0.007s
I20260709 12:20:55.997725  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:56.031657  8263 tablet_bootstrap.cc:654] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.004139  8262 tablet_bootstrap.cc:654] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.006127  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.009889  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:55.999147  8587 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.048568  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50927.7us
W20260709 12:20:56.068184  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62147.1us
I20260709 12:20:56.068742  8261 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:56.073132  8616 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:56.062791  8610 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.066818  8216 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.067152  8587 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.085826  8610 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:56.086796  8610 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.095011  8216 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:56.107388  8587 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:56.108363  8263 tablet_bootstrap.cc:492] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:56.108801  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:56.114208  8263 ts_tablet_manager.cc:1403] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.008s
W20260709 12:20:56.115196  8186 leader_election.cc:343] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.122572  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:56.123533  8263 raft_consensus.cc:359] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.124187  8263 raft_consensus.cc:385] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:56.125677  8184 leader_election.cc:343] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.124452  8263 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.126871  8263 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.129321  8263 ts_tablet_manager.cc:1434] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:20:56.126124  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.130331  8263 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:56.131217  8587 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.132154  8067 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.178923  8616 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.179447  8616 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.192871  8616 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.224643  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:56.225347  8216 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:56.232088  8267 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.232533  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:20:56.233438  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96965us
I20260709 12:20:56.234022  8594 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.238041  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:56.239216  8616 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:56.239651  8616 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.240000  8616 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.236033  7963 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.242705  7963 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.249550  8261 tablet_bootstrap.cc:654] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.269199  8263 tablet_bootstrap.cc:654] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.276571  8616 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.279286  8066 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:20:56.285092  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:56.285662  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:56.283761  8616 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.286249  8216 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.291507  8610 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.302294  8623 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:56.308933  8216 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:20:56.309870  8217 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:20:56.310916  8262 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:56.311452  8262 ts_tablet_manager.cc:1403] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.517s	user 0.015s	sys 0.006s
I20260709 12:20:56.312359  8263 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:56.312829  8263 ts_tablet_manager.cc:1403] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.012s
I20260709 12:20:56.312989  8261 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:56.313414  8261 ts_tablet_manager.cc:1403] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.245s	user 0.006s	sys 0.016s
I20260709 12:20:56.314237  8262 raft_consensus.cc:359] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.314913  8262 raft_consensus.cc:385] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.315186  8262 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.315477  8263 raft_consensus.cc:359] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.315898  8261 raft_consensus.cc:359] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.316200  8263 raft_consensus.cc:385] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.316562  8261 raft_consensus.cc:385] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.316665  8263 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.316977  8261 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.317440  8263 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.317739  8261 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.319376  8263 ts_tablet_manager.cc:1434] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:56.320142  8263 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:56.360092  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.372798  8261 ts_tablet_manager.cc:1434] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:20:56.375761  8261 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:56.315788  8262 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.390192  8622 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.391597  8622 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.390290  8616 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:56.396351  8616 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:56.396005  8462 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.398348  8623 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:56.398013  8616 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.398847  8623 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:56.401083  8622 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.439949  8261 tablet_bootstrap.cc:654] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.441802  8263 tablet_bootstrap.cc:654] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.443684  8262 ts_tablet_manager.cc:1434] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
W20260709 12:20:56.453615  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52190.8us
I20260709 12:20:56.463729  8066 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.482069  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:56.482657  8262 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:56.496006  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:56.504703  8610 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.508081  8587 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.508927  8587 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.523667  8035 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.409683  8623 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.530823  8311 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.537417  8311 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.538273  8587 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:56.538040  8311 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.576639  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:56.578908  8311 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.589614  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:56.599843  8261 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:56.600175  8383 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.604609  8623 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.600479  8261 ts_tablet_manager.cc:1403] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.225s	user 0.008s	sys 0.015s
W20260709 12:20:56.614254  8109 leader_election.cc:343] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.626173  8262 tablet_bootstrap.cc:654] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.626601  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:56.633213  8261 raft_consensus.cc:359] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.634004  8261 raft_consensus.cc:385] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.634320  8261 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.635059  8261 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:56.636111  8186 leader_election.cc:343] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.641232  8261 ts_tablet_manager.cc:1434] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:20:56.653642  8261 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:56.656800  8263 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:56.661053  8263 ts_tablet_manager.cc:1403] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.341s	user 0.027s	sys 0.025s
I20260709 12:20:56.674535  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:56.675334  8214 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
W20260709 12:20:56.677574  8184 leader_election.cc:343] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.678071  8184 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.682273  8618 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.668099  8263 raft_consensus.cc:359] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.693109  8263 raft_consensus.cc:385] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.696130  8262 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:56.696709  8263 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.700314  8262 ts_tablet_manager.cc:1403] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.018s
I20260709 12:20:56.688030  8261 tablet_bootstrap.cc:654] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.703225  8263 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.710002  8263 ts_tablet_manager.cc:1434] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:20:56.722541  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:56.723454  8566 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.723870  8566 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.724255  8566 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.727334  8263 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:56.736820  8262 raft_consensus.cc:359] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.737810  8262 raft_consensus.cc:385] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.738234  8262 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.739176  8623 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.746563  8566 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.747098  8618 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.746765  8262 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.755431  7964 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.767055  8319 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:56.769148  8261 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:56.770308  8566 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.772047  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:56.758351  8618 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.772617  8217 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.776031  8263 tablet_bootstrap.cc:654] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.777102  8261 ts_tablet_manager.cc:1403] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.003s
I20260709 12:20:56.778475  8262 ts_tablet_manager.cc:1434] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 12:20:56.781688  8262 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:56.790055  8217 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:56.791661  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:56.794155  8595 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.794658  8595 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:56.795595  8595 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.810105  8262 tablet_bootstrap.cc:654] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.824049  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:56.826385  8618 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:56.826591  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:56.827412  8184 leader_election.cc:343] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.819751  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:20:56.828688  8186 leader_election.cc:343] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.828920  8066 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.829104  8186 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:56.830868  8331 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.834960  8623 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.837631  8263 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:56.839845  8263 ts_tablet_manager.cc:1403] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.000s
I20260709 12:20:56.872591  8261 raft_consensus.cc:359] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.873389  8261 raft_consensus.cc:385] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.873660  8261 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.876102  8261 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.880087  8261 ts_tablet_manager.cc:1434] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.005s
I20260709 12:20:56.881285  8261 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:56.888521  8263 raft_consensus.cc:359] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.889170  8263 raft_consensus.cc:385] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.889390  8263 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.892191  8066 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:56.898788  8261 tablet_bootstrap.cc:654] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.903240  8462 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.903680  8462 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.899994  8263 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.917644  8462 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.920148  8263 ts_tablet_manager.cc:1434] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 12:20:56.920006  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:56.923028  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:56.925554  8212 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:56.926636  8262 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:56.926728  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:56.927269  8262 ts_tablet_manager.cc:1403] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.021s
I20260709 12:20:56.927524  8462 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.927865  8462 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.928222  8462 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:56.929628  8109 leader_election.cc:343] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.930435  8263 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:56.938544  8462 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:56.942976  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:56.946993  8262 raft_consensus.cc:359] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.947715  8262 raft_consensus.cc:385] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.947970  8262 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.951617  8462 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:56.951464  8262 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.953488  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:56.954770  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:56.955397  8212 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:56.961537  8109 leader_election.cc:343] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.960418  7967 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.967762  8146 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:20:56.968269  8146 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 0
I20260709 12:20:56.968665  8146 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:56.970106  8262 ts_tablet_manager.cc:1434] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:20:56.970775  8146 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:56.971711  8216 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:56.967762  8212 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:56.973053  8622 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.973767  8263 tablet_bootstrap.cc:654] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.974778  8261 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:56.975268  8261 ts_tablet_manager.cc:1403] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.005s
I20260709 12:20:56.975768  8262 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:56.976519  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:56.978446  8383 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.985317  8492 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.985894  8492 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:56.986641  8492 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.990363  8261 raft_consensus.cc:359] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:56.991199  8261 raft_consensus.cc:385] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.991518  8261 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.993172  8261 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.021276  8262 tablet_bootstrap.cc:654] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.042493  8261 ts_tablet_manager.cc:1434] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 12:20:57.051489  8261 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:57.098507  8263 tablet_bootstrap.cc:492] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.098963  8263 ts_tablet_manager.cc:1403] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.169s	user 0.034s	sys 0.046s
I20260709 12:20:57.103771  8331 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.104249  8331 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.108242  7963 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.113281  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.117524  8262 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.111454  8331 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:20:57.118880  8186 leader_election.cc:343] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.120891  8262 ts_tablet_manager.cc:1403] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.027s
I20260709 12:20:57.122344  8263 raft_consensus.cc:359] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.122859  8263 raft_consensus.cc:385] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.123080  8263 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.123610  8263 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.126658  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:57.129573  8184 leader_election.cc:343] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.129999  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:57.131506  8331 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.142340  8263 ts_tablet_manager.cc:1434] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.043s	user 0.001s	sys 0.007s
I20260709 12:20:57.143913  8263 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.147574  8261 tablet_bootstrap.cc:654] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.147917  8262 raft_consensus.cc:359] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.148645  8262 raft_consensus.cc:385] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.148926  8262 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.150431  8262 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.154100  8618 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.154644  8618 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.157243  8262 ts_tablet_manager.cc:1434] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:20:57.160509  8618 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.161865  8262 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.164201  8595 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.164834  8595 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.166095  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.166733  8062 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:57.167599  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.168172  8143 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:57.169305  8186 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.169582  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.170163  8617 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.170538  8617 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.170593  8595 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.170907  8617 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.173704  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.174333  8062 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.175845  8109 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.177269  8492 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.177675  8492 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.186408  8492 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.178452  8263 tablet_bootstrap.cc:654] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.184540  8617 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.193815  8212 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:20:57.198563  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.199157  8062 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.199579  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:57.200320  8617 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.205132  8261 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:57.206238  8062 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:57.197829  8262 tablet_bootstrap.cc:654] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.207960  8261 ts_tablet_manager.cc:1403] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.007s
I20260709 12:20:57.209520  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:57.210901  8261 raft_consensus.cc:359] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.211654  8261 raft_consensus.cc:385] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.211927  8261 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.211899  8618 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.212721  8618 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:57.213635  8618 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.221755  8262 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.221589  8261 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.222246  8262 ts_tablet_manager.cc:1403] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.002s
I20260709 12:20:57.226962  8261 ts_tablet_manager.cc:1434] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:20:57.228091  8261 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Bootstrap starting.
I20260709 12:20:57.228988  8262 raft_consensus.cc:359] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.229689  8262 raft_consensus.cc:385] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.229955  8262 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.234452  8262 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.236510  8492 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.241035  8146 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:57.245915  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:57.245532  8492 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.249238  8262 ts_tablet_manager.cc:1434] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:20:57.250283  8262 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.251262  8261 tablet_bootstrap.cc:654] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.251747  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.252677  8062 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 1: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:20:57.253801  8109 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:57.254525  8595 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.255820  7964 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.269701  8261 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: No bootstrap required, opened a new log
I20260709 12:20:57.270264  8261 ts_tablet_manager.cc:1403] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 12:20:57.275293  8263 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.275635  8261 raft_consensus.cc:359] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.276433  8261 raft_consensus.cc:385] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.275792  8263 ts_tablet_manager.cc:1403] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.012s
I20260709 12:20:57.276762  8261 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.277361  8262 tablet_bootstrap.cc:654] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.285002  8263 raft_consensus.cc:359] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.286062  8263 raft_consensus.cc:385] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.286360  8263 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.287349  8263 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.290052  8262 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.290611  8262 ts_tablet_manager.cc:1403] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 12:20:57.296000  8263 ts_tablet_manager.cc:1434] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:20:57.286263  8261 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.297130  8263 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.318742  8263 tablet_bootstrap.cc:654] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.304023  8492 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:20:57.298759  8261 ts_tablet_manager.cc:1434] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:20:57.310329  8262 raft_consensus.cc:359] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.326784  8262 raft_consensus.cc:385] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.327126  8262 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.327963  8262 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.335649  8595 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:57.350479  8262 ts_tablet_manager.cc:1434] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.000s
I20260709 12:20:57.353860  8262 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.359118  8263 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.359702  8263 ts_tablet_manager.cc:1403] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 12:20:57.364899  8262 tablet_bootstrap.cc:654] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.378387  8263 raft_consensus.cc:359] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.379137  8263 raft_consensus.cc:385] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.379408  8263 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.380053  8263 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.389489  8263 ts_tablet_manager.cc:1434] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 12:20:57.385262  8262 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.390404  8262 ts_tablet_manager.cc:1403] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.013s
I20260709 12:20:57.394659  8263 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.395572  8262 raft_consensus.cc:359] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.396327  8262 raft_consensus.cc:385] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.396610  8262 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.397346  8262 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.399796  8262 ts_tablet_manager.cc:1434] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:20:57.405299  8262 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.406279  8263 tablet_bootstrap.cc:654] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.411631  8263 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.412122  8263 ts_tablet_manager.cc:1403] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:20:57.414820  8263 raft_consensus.cc:359] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.415494  8263 raft_consensus.cc:385] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.415774  8263 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.416383  8263 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.418612  8263 ts_tablet_manager.cc:1434] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:20:57.420200  8262 tablet_bootstrap.cc:654] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.422147  8664 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.422647  8664 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.423653  8263 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.427412  8331 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.427671  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.428093  8331 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.428375  8216 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:57.430246  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:57.430786  8331 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.431854  8622 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.432303  8622 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.432713  8622 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.449491  8664 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.494693  8263 tablet_bootstrap.cc:654] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.499002  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:20:57.501089  8186 leader_election.cc:343] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.500963  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.505815  8618 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.508963  8184 leader_election.cc:343] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.506449  8618 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.510563  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.511225  8618 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.512859  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.513476  8142 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:57.509425  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:57.515079  8618 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.515041  8186 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.516345  8383 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.516796  8383 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.518603  8383 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.528785  8263 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.529285  8263 ts_tablet_manager.cc:1403] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.000s
I20260709 12:20:57.530491  8070 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.533550  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.534216  8067 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 0.
I20260709 12:20:57.534333  8622 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.537936  8622 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.543540  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.544081  8263 raft_consensus.cc:359] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.544986  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:20:57.557318  8036 leader_election.cc:343] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:57.558346  8036 leader_election.cc:343] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.524919  8618 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.559315  8618 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.564340  8262 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.569806  8262 ts_tablet_manager.cc:1403] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.165s	user 0.032s	sys 0.038s
I20260709 12:20:57.552687  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.572218  8216 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 1: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:20:57.572522  8618 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.556409  8263 raft_consensus.cc:385] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.573638  8262 raft_consensus.cc:359] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.574702  8262 raft_consensus.cc:385] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.575089  8262 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.575765  8262 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.577982  8262 ts_tablet_manager.cc:1434] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:57.574648  8263 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.579895  8263 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.580379  8594 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:20:57.583770  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:57.590848  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:57.591523  8212 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.595095  8262 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.599395  8212 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:57.601883  8262 tablet_bootstrap.cc:654] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.603526  8263 ts_tablet_manager.cc:1434] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:20:57.604043  8622 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.605932  8617 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.618093  8617 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.620538  8617 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.621372  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:20:57.622907  8184 leader_election.cc:343] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.623572  8462 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.651903  8263 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
W20260709 12:20:57.656143  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49558.9us
I20260709 12:20:57.662741  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.659265  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:57.670250  8664 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.670784  8664 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:57.671748  8664 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.677660  8617 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:57.672257  8186 leader_election.cc:343] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.685691  8186 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:20:57.686611  8617 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.690145  8610 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.690744  8610 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.693653  8610 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.702813  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.703505  8067 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.713670  8624 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.714208  8624 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.716395  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.716568  8624 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.718003  8624 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.718405  8624 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.719130  8624 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.722206  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.723035  8212 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.724038  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.724779  8217 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.728045  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.728724  8070 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.733510  8462 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.733978  8462 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.735913  8462 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.737982  8617 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.739378  8624 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.741685  8624 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.611882  8618 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.743880  8618 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:20:57.745379  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.766247  8070 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.775238  7964 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.752170  8262 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.759054  8263 tablet_bootstrap.cc:654] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.760824  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:57.778020  8070 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:57.750072  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.779300  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:57.778409  8142 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.782810  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.782929  8595 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.783406  8595 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.783458  8217 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.783865  8595 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.784425  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:57.785017  8216 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.778059  8262 ts_tablet_manager.cc:1403] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.197s	user 0.036s	sys 0.014s
I20260709 12:20:57.792423  8216 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:57.788612  8617 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.793570  8617 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:20:57.794502  8617 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.807763  8595 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.813452  8262 raft_consensus.cc:359] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.818058  8262 raft_consensus.cc:385] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.819118  8262 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.821954  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.823347  8462 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.823699  8462 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.823995  8462 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.824378  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:57.824939  8216 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.831099  8462 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.832326  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.832948  8062 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.835994  8216 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:57.822646  8142 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:20:57.821784  8262 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.838481  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.839082  8063 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.840422  8262 ts_tablet_manager.cc:1434] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.002s
I20260709 12:20:57.841708  8262 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.843408  8263 tablet_bootstrap.cc:492] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.844036  8263 ts_tablet_manager.cc:1403] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.192s	user 0.010s	sys 0.000s
I20260709 12:20:57.847389  8063 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:57.847659  8263 raft_consensus.cc:359] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.848543  8263 raft_consensus.cc:385] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.836974  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.848968  8263 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.849735  8263 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.852098  8263 ts_tablet_manager.cc:1434] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:57.853179  8263 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.854055  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.855759  8262 tablet_bootstrap.cc:654] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.856556  8594 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.857100  8594 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:57.857965  8594 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.859223  8263 tablet_bootstrap.cc:654] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.868233  8110 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.870700  8263 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.871234  8263 ts_tablet_manager.cc:1403] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:20:57.874214  8263 raft_consensus.cc:359] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.875023  8263 raft_consensus.cc:385] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.875319  8263 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.876091  8263 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.876601  8594 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.877979  8594 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:57.878407  8263 ts_tablet_manager.cc:1434] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:57.879393  8263 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
W20260709 12:20:57.871394  8109 leader_election.cc:343] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.878793  8594 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.886636  8263 tablet_bootstrap.cc:654] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.811359  8595 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.897389  8263 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.897768  8262 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:57.897852  8263 ts_tablet_manager.cc:1403] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 12:20:57.898307  8262 ts_tablet_manager.cc:1403] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.014s
I20260709 12:20:57.900902  8262 raft_consensus.cc:359] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.901630  8262 raft_consensus.cc:385] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.901916  8262 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.910369  8062 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:57.910903  8263 raft_consensus.cc:359] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.911717  8263 raft_consensus.cc:385] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.912014  8263 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.912700  8263 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.914629  8462 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.915793  8263 ts_tablet_manager.cc:1434] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:20:57.916953  8263 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Bootstrap starting.
I20260709 12:20:57.917941  8610 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.918439  8610 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.920372  8610 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.923475  8263 tablet_bootstrap.cc:654] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.902581  8262 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.926366  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:57.926992  8217 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.929095  7967 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.933022  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.933754  8212 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:57.936658  8217 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:57.938050  8262 ts_tablet_manager.cc:1434] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:20:57.939246  8262 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Bootstrap starting.
I20260709 12:20:57.939055  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:57.942402  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:57.940779  8063 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.946642  7963 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.948709  8262 tablet_bootstrap.cc:654] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.949273  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.950791  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.951557  8594 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.948577  7963 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.952069  8594 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:57.952903  8594 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.951195  8595 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.958400  8595 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.958758  8595 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.959448  8383 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.959785  8263 tablet_bootstrap.cc:492] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: No bootstrap required, opened a new log
I20260709 12:20:57.959887  8383 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.960435  8263 ts_tablet_manager.cc:1403] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.004s
I20260709 12:20:57.962549  8383 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:57.964864  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:20:57.965515  8142 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:57.964010  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:57.967532  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 0.
I20260709 12:20:57.967885  8036 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:57.968700  8383 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.969023  8383 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.969318  8383 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.969821  8263 raft_consensus.cc:359] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:57.970638  8263 raft_consensus.cc:385] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.970920  8263 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.971616  8263 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:57.950567  8109 leader_election.cc:343] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.973922  8263 ts_tablet_manager.cc:1434] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:20:57.979859  8383 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.036826  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:20:58.037405  8143 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.045796  8595 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.047833  8595 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:58.048799  8143 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:58.051033  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:58.051591  8217 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.057942  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:20:58.058981  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:20:58.059835  8664 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.060292  8664 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:20:58.061146  8664 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:58.071905  8036 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:58.072269  8383 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 1 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:58.075681  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:58.076308  8212 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.081900  7963 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.083446  8212 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:58.084956  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:58.085490  8067 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.090163  8262 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: No bootstrap required, opened a new log
I20260709 12:20:58.091037  8063 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:58.092713  8262 ts_tablet_manager.cc:1403] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent bootstrapping tablet: real 0.154s	user 0.047s	sys 0.075s
I20260709 12:20:58.099612  8262 raft_consensus.cc:359] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.100323  8262 raft_consensus.cc:385] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:58.100603  8262 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Initialized, Role: FOLLOWER
I20260709 12:20:58.101804  8262 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:20:58.107829  8015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:58.120020  8262 ts_tablet_manager.cc:1434] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.006s
I20260709 12:20:58.126773  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:58.128190  8462 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.128670  8462 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:58.129513  8462 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.139365  8067 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:58.149574  8664 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.192312  7963 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.204487  7964 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.229054  8462 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.229584  8462 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.231590  8462 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:58.232486  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:58.233203  8062 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:58.233486  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:58.234165  8220 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 0.
I20260709 12:20:58.234243  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:58.235126  8594 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:58.235543  8594 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.235858  8594 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.242544  8594 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.244834  8594 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:58.245539  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:20:58.246225  8062 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.247080  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:20:58.247740  8220 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.259334  8062 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:58.260668  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:20:58.261577  8462 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:58.262707  8462 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:20:58.263546  8462 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.278331  8220 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:20:58.279842  7967 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:58.286665  8617 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.302400  8331 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.373202  8594 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.373739  8594 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:20:58.375890  8594 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:20:58.376430  8594 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.376705  8492 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.378449  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:20:58.378928  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:20:58.380797  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:20:58.383196  8462 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:58.404721  8595 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.409463  8595 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.420670  8492 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.461969  8610 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.545164  8594 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:58.547780  8622 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.551982  8143 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.563949  8622 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.602687  8594 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.785990  8594 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.801143  8595 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:59.511008  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:59.527328  8719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:59.531661  8720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:59.535952  8722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:59.537770  6874 server_base.cc:1061] running on GCE node
I20260709 12:20:59.540688  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:59.541060  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:59.541330  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599659541310 us; error 0 us; skew 500 ppm
I20260709 12:20:59.542361  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:59.546746  6874 webserver.cc:533] Webserver started at http://127.6.182.132:41229/ using document root <none> and password file <none>
I20260709 12:20:59.547514  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:59.547783  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:59.548214  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:59.550028  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-3-root/instance:
uuid: "1659f359000d40bda3fc864911b1c75c"
format_stamp: "Formatted at 2026-07-09 12:20:59 on dist-test-slave-lgtn"
I20260709 12:20:59.562258  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:20:59.568339  8727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:59.569639  6874 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:20:59.570024  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
uuid: "1659f359000d40bda3fc864911b1c75c"
format_stamp: "Formatted at 2026-07-09 12:20:59 on dist-test-slave-lgtn"
I20260709 12:20:59.570441  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:59.609543  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:59.611491  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:59.613494  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:59.617219  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:59.617517  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:59.617861  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:59.618115  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:59.804205  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.132:35761
I20260709 12:20:59.804342  8790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.132:35761 every 8 connection(s)
I20260709 12:20:59.827049  6874 auto_leader_rebalancer-test.cc:439] add a tserver: 1659f359000d40bda3fc864911b1c75c
I20260709 12:20:59.850711  8791 heartbeater.cc:344] Connected to a master server at 127.6.182.190:33539
I20260709 12:20:59.851176  8791 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:59.852169  8791 heartbeater.cc:507] Master 127.6.182.190:33539 requested a full tablet report, sending...
I20260709 12:20:59.854645  7964 ts_manager.cc:194] Registered new tserver with Master: 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:20:59.856424  7964 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57846
I20260709 12:21:00.326205  8062 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:00.354069  8143 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.358448  8664 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:00.370635  8214 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.373315  8622 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:00.385625  8664 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.387286  8142 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:00.421597  8034 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df7583ede5b943628d7b1b33336c660a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:00.421322  7964 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.538679  8220 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.547710  8142 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:00.588582  8220 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.590204  8777 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:00.599282  8062 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.626286  8594 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:00.695035  8610 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.696890  8220 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.749779  8070 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:00.777268  8109 consensus_peers.cc:597] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d03e6a3f73454ce8a6a8e18e83852297. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:00.783320  7963 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.788527  8143 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:00.841841  8820 ts_tablet_manager.cc:933] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:00.860229  8791 heartbeater.cc:499] Master 127.6.182.190:33539 was elected leader, sending a full tablet report...
I20260709 12:21:00.860339  8820 tablet_copy_client.cc:323] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:21:00.888643  8214 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:00.888615  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dea9fb7818f049248d8577e73c087888. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:00.889546  8070 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.891541  8817 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:00.892480  8816 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:00.926507  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet df7583ede5b943628d7b1b33336c660a from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:21:00.927321  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet df7583ede5b943628d7b1b33336c660a from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-df7583ede5b943628d7b1b33336c660a
I20260709 12:21:00.928532  8816 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.938870  8063 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.947491  8080 tablet_copy_source_session.cc:215] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:00.936980  8214 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:00.954203  8143 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:00.963877  7963 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.975630  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7583ede5b943628d7b1b33336c660a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:00.989563  8063 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:00.991426  8214 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:00.993209  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90659c1daf854b0f9323204cf80f7aeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:00.994160  8610 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:00.979678  8827 ts_tablet_manager.cc:933] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:01.000725  8817 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.024190  8820 tablet_copy_client.cc:806] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:01.030165  8820 tablet_copy_client.cc:670] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:01.042304  8820 tablet_copy_client.cc:538] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:01.071949  8827 tablet_copy_client.cc:323] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:01.074160  8610 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:01.079213  8820 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:01.086720  8070 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:01.116775  8220 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:01.132611  7964 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.167889  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet d03e6a3f73454ce8a6a8e18e83852297 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:01.168519  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet d03e6a3f73454ce8a6a8e18e83852297 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-d03e6a3f73454ce8a6a8e18e83852297
I20260709 12:21:01.179868  8820 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.187626  8156 tablet_copy_source_session.cc:215] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:01.187718  8820 tablet_bootstrap.cc:492] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:01.190411  8820 ts_tablet_manager.cc:1403] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.020s
I20260709 12:21:01.191478  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03e6a3f73454ce8a6a8e18e83852297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:01.194087  8820 raft_consensus.cc:359] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.195451  8820 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:01.202873  8820 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.265714  8820 ts_tablet_manager.cc:1434] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.075s	user 0.027s	sys 0.030s
I20260709 12:21:01.269183  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-df7583ede5b943628d7b1b33336c660a received from {username='slave'} at 127.0.0.1:34594
I20260709 12:21:01.269755  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-df7583ede5b943628d7b1b33336c660a on tablet df7583ede5b943628d7b1b33336c660a with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:01.276648  8827 tablet_copy_client.cc:806] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:01.277385  8827 tablet_copy_client.cc:670] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:01.282104  8827 tablet_copy_client.cc:538] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:01.299564  8827 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:01.322953  8827 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.324028  8827 tablet_bootstrap.cc:492] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:01.324846  8827 ts_tablet_manager.cc:1403] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:21:01.328011  8827 raft_consensus.cc:359] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.328722  8827 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:01.329540  8827 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.331987  8827 ts_tablet_manager.cc:1434] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:01.336050  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-d03e6a3f73454ce8a6a8e18e83852297 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:01.336555  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-d03e6a3f73454ce8a6a8e18e83852297 on tablet d03e6a3f73454ce8a6a8e18e83852297 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:01.346011  8765 raft_consensus.cc:1217] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:01.353215  8765 raft_consensus.cc:1217] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:01.372659  8827 ts_tablet_manager.cc:933] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:01.397087  8827 tablet_copy_client.cc:323] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:01.399034  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet dea9fb7818f049248d8577e73c087888 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:01.399670  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet dea9fb7818f049248d8577e73c087888 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-dea9fb7818f049248d8577e73c087888
I20260709 12:21:01.408422  8820 ts_tablet_manager.cc:933] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:01.415210  8156 tablet_copy_source_session.cc:215] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:01.423565  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea9fb7818f049248d8577e73c087888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:01.444478  8820 tablet_copy_client.cc:323] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:01.454677  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 90659c1daf854b0f9323204cf80f7aeb from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:01.455287  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 90659c1daf854b0f9323204cf80f7aeb from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-90659c1daf854b0f9323204cf80f7aeb
I20260709 12:21:01.475660  8156 tablet_copy_source_session.cc:215] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:01.480549  8820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90659c1daf854b0f9323204cf80f7aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:01.498658  8820 tablet_copy_client.cc:806] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:01.499333  8820 tablet_copy_client.cc:670] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:01.503389  8820 tablet_copy_client.cc:538] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:01.513698  8827 tablet_copy_client.cc:806] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:01.514501  8827 tablet_copy_client.cc:670] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:01.518586  8827 tablet_copy_client.cc:538] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:01.518919  8820 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:01.551877  8820 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.553221  8820 tablet_bootstrap.cc:492] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:01.554139  8820 ts_tablet_manager.cc:1403] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.007s
I20260709 12:21:01.558852  8820 raft_consensus.cc:359] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.559926  8820 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:01.560770  8820 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.563824  8827 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:01.573628  8820 ts_tablet_manager.cc:1434] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:21:01.578035  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-90659c1daf854b0f9323204cf80f7aeb received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:01.578547  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-90659c1daf854b0f9323204cf80f7aeb on tablet 90659c1daf854b0f9323204cf80f7aeb with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:01.600404  8827 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.601482  8827 tablet_bootstrap.cc:492] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:01.602267  8827 ts_tablet_manager.cc:1403] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.004s
I20260709 12:21:01.608013  8827 raft_consensus.cc:359] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.609237  8827 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:01.609947  8827 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:01.612550  8827 ts_tablet_manager.cc:1434] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:01.616678  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-dea9fb7818f049248d8577e73c087888 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:01.617095  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-dea9fb7818f049248d8577e73c087888 on tablet dea9fb7818f049248d8577e73c087888 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:01.754340  8835 raft_consensus.cc:1064] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:01.763808  8835 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:01.789080  8765 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.791947  8220 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.797943  8143 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.804366  8799 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:21:01.808014  8799 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:01.822413  8664 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:01.849129  8799 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:01.853865  8765 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:01.859150  8146 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:01.879863  7963 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:01.903035  8214 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:01.921679  8765 raft_consensus.cc:1217] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:01.933300  8817 raft_consensus.cc:1064] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:01.935875  8817 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:01.953294  8062 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.954424  8214 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.957418  8765 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:01.957603  8814 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:01.960825  8777 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:21:01.984673  8850 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:01.997087  8070 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.006450  8765 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.007968  8664 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.016601  8664 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.025463  8764 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.039125  8214 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.041049  8845 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:02.048264  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df7583ede5b943628d7b1b33336c660a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:02.053287  8214 raft_consensus.cc:2955] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.063596  7963 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:02.070648  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 110468us
I20260709 12:21:02.076035  8764 raft_consensus.cc:1217] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:02.080010  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet df7583ede5b943628d7b1b33336c660a with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:02.125072  8856 tablet_replica.cc:333] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:02.139984  8852 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.159941  8070 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.161298  8764 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.162705  8220 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.182060  8856 raft_consensus.cc:2243] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:02.182921  8856 raft_consensus.cc:2272] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:02.183331  7963 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.186869  8856 ts_tablet_manager.cc:1916] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:02.217263  8856 ts_tablet_manager.cc:1929] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:02.217859  8856 log.cc:1199] T df7583ede5b943628d7b1b33336c660a P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/df7583ede5b943628d7b1b33336c660a
I20260709 12:21:02.219719  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet df7583ede5b943628d7b1b33336c660a (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:02.237937  8143 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.244052  8764 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.244457  8220 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.246023  8777 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.255334  8852 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.257202  8214 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.268289  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d03e6a3f73454ce8a6a8e18e83852297 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:02.274623  8850 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:21:02.279844  7967 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.286016  8764 raft_consensus.cc:2955] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.294252  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet d03e6a3f73454ce8a6a8e18e83852297 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:02.324575  8858 tablet_replica.cc:333] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:02.326128  8858 raft_consensus.cc:2243] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:02.326953  8858 raft_consensus.cc:2272] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:02.330606  8858 ts_tablet_manager.cc:1916] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:02.354724  8858 ts_tablet_manager.cc:1929] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:02.355235  8858 log.cc:1199] T d03e6a3f73454ce8a6a8e18e83852297 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/d03e6a3f73454ce8a6a8e18e83852297
I20260709 12:21:02.357319  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet d03e6a3f73454ce8a6a8e18e83852297 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:02.435509  8853 raft_consensus.cc:1064] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:02.438319  8853 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.508850  8764 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.511804  8852 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:02.512257  8062 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.521731  8797 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:02.536824  8220 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.543354  8814 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:02.557840  8848 raft_consensus.cc:1064] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:02.562089  8848 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.593127  8850 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.599383  8765 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.628796  8764 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.632078  8063 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.632123  8777 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:02.639969  8777 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:02.648128  8217 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:02.653014  8777 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:02.679065  7964 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.685544  8070 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.695367  8850 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.710736  8763 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.719614  8220 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.715057  8146 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.736218  8765 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.738400  8850 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.740046  8062 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.745693  8817 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.748520  8765 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.751438  8063 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.760704  8777 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.763247  7963 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.779624  8214 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.790318  8146 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:02.792085  8063 raft_consensus.cc:2955] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.802563  8764 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.805841  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dea9fb7818f049248d8577e73c087888 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:02.810029  8777 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.810508  8062 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:02.814239  8848 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:02.823010  8797 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.826450  8764 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.826643  8070 raft_consensus.cc:2955] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.845047  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90659c1daf854b0f9323204cf80f7aeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:02.847239  7963 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.882176  7967 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:02.891826  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet dea9fb7818f049248d8577e73c087888 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:02.909085  8869 tablet_replica.cc:333] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:02.914187  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 90659c1daf854b0f9323204cf80f7aeb with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:02.916970  8869 raft_consensus.cc:2243] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:02.917811  8869 raft_consensus.cc:2272] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:02.921625  8869 ts_tablet_manager.cc:1916] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:02.948598  8869 ts_tablet_manager.cc:1929] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:02.949132  8869 log.cc:1199] T dea9fb7818f049248d8577e73c087888 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/dea9fb7818f049248d8577e73c087888
I20260709 12:21:02.951001  8869 tablet_replica.cc:333] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:02.951115  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet dea9fb7818f049248d8577e73c087888 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:02.952649  8869 raft_consensus.cc:2243] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:02.953493  8869 raft_consensus.cc:2272] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:02.956696  8869 ts_tablet_manager.cc:1916] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:02.972647  8869 ts_tablet_manager.cc:1929] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:02.973083  8869 log.cc:1199] T 90659c1daf854b0f9323204cf80f7aeb P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/90659c1daf854b0f9323204cf80f7aeb
I20260709 12:21:02.974632  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 90659c1daf854b0f9323204cf80f7aeb (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:04.006642  8063 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:04.016968  8034 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d90f9cc1738e4ab29ea95fed6e4f6b94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:04.018882  8217 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.020144  8143 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.020846  8799 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:04.022181  8841 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.032649  8841 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.034407  8143 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.053177  8220 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.087636  7964 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:04.099448  8143 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:04.137143  8109 consensus_peers.cc:597] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52f19ea14efe485bb7af9f0baee00fdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:04.137143  8220 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.140883  8062 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.141947  8848 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.143061  8874 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.168900  8852 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.175189  8062 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.180037  8220 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.233682  8063 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.244792  8143 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.246161  8220 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.246634  8799 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:04.252355  7963 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:04.256165  8034 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bc5d19ae7b44bd6bff5e8b59a820ffb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:04.257448  8799 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.278267  8876 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.279785  8143 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.281445  8217 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.301518  7967 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.337078  8214 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.348075  8143 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.349320  8868 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:04.349864  8063 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:04.351645  8868 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:04.361900  8867 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.363595  8143 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:04.365617  8184 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e7bfc6a04b14b94bfa1ea185d2d50d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:04.370047  8063 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:04.384485  7963 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:04.438354  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65065.8us
I20260709 12:21:04.538650  8901 ts_tablet_manager.cc:933] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:04.540748  8901 tablet_copy_client.cc:323] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:21:04.543011  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:21:04.543566  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet d90f9cc1738e4ab29ea95fed6e4f6b94 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-d90f9cc1738e4ab29ea95fed6e4f6b94
I20260709 12:21:04.551009  8080 tablet_copy_source_session.cc:215] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:04.554293  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9cc1738e4ab29ea95fed6e4f6b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:04.569972  8901 tablet_copy_client.cc:806] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:04.570637  8901 tablet_copy_client.cc:670] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:04.574712  8901 tablet_copy_client.cc:538] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:04.582764  8901 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:04.612462  8901 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.613509  8901 tablet_bootstrap.cc:492] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:04.614154  8901 ts_tablet_manager.cc:1403] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.005s
I20260709 12:21:04.616868  8901 raft_consensus.cc:359] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.617558  8901 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:04.618217  8901 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.624496  8901 ts_tablet_manager.cc:1434] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:21:04.627851  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-d90f9cc1738e4ab29ea95fed6e4f6b94 received from {username='slave'} at 127.0.0.1:34594
I20260709 12:21:04.628401  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-d90f9cc1738e4ab29ea95fed6e4f6b94 on tablet d90f9cc1738e4ab29ea95fed6e4f6b94 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:04.644547  8901 ts_tablet_manager.cc:933] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:04.647686  8901 tablet_copy_client.cc:323] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:04.649520  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 52f19ea14efe485bb7af9f0baee00fdb from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:04.650058  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 52f19ea14efe485bb7af9f0baee00fdb from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-52f19ea14efe485bb7af9f0baee00fdb
I20260709 12:21:04.655577  8156 tablet_copy_source_session.cc:215] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:04.658758  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f19ea14efe485bb7af9f0baee00fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:04.675494  8901 tablet_copy_client.cc:806] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:04.676074  8901 tablet_copy_client.cc:670] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:04.691543  8901 tablet_copy_client.cc:538] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:04.701577  8901 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:04.750955  8901 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.753113  8901 tablet_bootstrap.cc:492] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:04.754441  8901 ts_tablet_manager.cc:1403] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.021s
I20260709 12:21:04.757771  8901 raft_consensus.cc:359] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.758615  8901 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:04.759292  8901 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.761695  8901 ts_tablet_manager.cc:1434] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:21:04.764467  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-52f19ea14efe485bb7af9f0baee00fdb received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:04.765002  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-52f19ea14efe485bb7af9f0baee00fdb on tablet 52f19ea14efe485bb7af9f0baee00fdb with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:04.842319  8901 ts_tablet_manager.cc:933] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:04.846190  8901 tablet_copy_client.cc:323] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:21:04.847833  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:21:04.848408  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-5bc5d19ae7b44bd6bff5e8b59a820ffb
I20260709 12:21:04.856051  8080 tablet_copy_source_session.cc:215] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:04.860476  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:04.878703  8908 ts_tablet_manager.cc:933] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:04.883412  8901 tablet_copy_client.cc:806] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:04.885196  8901 tablet_copy_client.cc:670] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:04.889021  8901 tablet_copy_client.cc:538] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:04.889750  8908 tablet_copy_client.cc:323] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:04.900170  8901 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:04.905815  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:04.906443  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-3e7bfc6a04b14b94bfa1ea185d2d50d7
I20260709 12:21:04.920578  8230 tablet_copy_source_session.cc:215] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:04.926466  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:04.938174  8901 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.939205  8901 tablet_bootstrap.cc:492] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:04.939810  8901 ts_tablet_manager.cc:1403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.012s
I20260709 12:21:04.942231  8901 raft_consensus.cc:359] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.943073  8901 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:04.943718  8901 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:04.945493  8908 tablet_copy_client.cc:806] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:04.946046  8908 tablet_copy_client.cc:670] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:04.947741  8901 ts_tablet_manager.cc:1434] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:04.949527  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-5bc5d19ae7b44bd6bff5e8b59a820ffb received from {username='slave'} at 127.0.0.1:34594
I20260709 12:21:04.949844  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-5bc5d19ae7b44bd6bff5e8b59a820ffb on tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:04.954298  8764 raft_consensus.cc:1217] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:04.968086  8908 tablet_copy_client.cc:538] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:04.977500  8908 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:04.998260  8908 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:04.999181  8908 tablet_bootstrap.cc:492] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:04.999876  8908 ts_tablet_manager.cc:1403] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.009s
I20260709 12:21:05.002890  8908 raft_consensus.cc:359] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:05.003741  8908 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:05.004495  8908 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:05.006893  8908 ts_tablet_manager.cc:1434] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:21:05.009130  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-3e7bfc6a04b14b94bfa1ea185d2d50d7 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:05.009652  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-3e7bfc6a04b14b94bfa1ea185d2d50d7 on tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:05.206634  8764 raft_consensus.cc:1217] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:05.298966  8764 raft_consensus.cc:1217] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:05.323518  8764 raft_consensus.cc:1217] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:05.336069  8875 raft_consensus.cc:1064] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:05.338613  8875 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:05.345134  8764 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.347227  8799 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.348393  8220 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.354229  8916 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:21:05.363562  8143 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.365164  8916 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.382755  8875 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.385396  8220 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.390592  8146 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.398737  8764 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.415648  7967 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.444406  8070 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:05.450574  8764 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:05.451581  8220 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:05.452919  8875 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.453704  8916 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.462713  8799 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.469415  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:05.471146  8220 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.471206  8764 raft_consensus.cc:2955] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.491429  7963 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.506767  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet d90f9cc1738e4ab29ea95fed6e4f6b94 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:05.527038  8924 tablet_replica.cc:333] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:05.528074  8924 raft_consensus.cc:2243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.528712  8924 raft_consensus.cc:2272] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.531220  8924 ts_tablet_manager.cc:1916] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:05.542778  8924 ts_tablet_manager.cc:1929] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:05.543169  8924 log.cc:1199] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/d90f9cc1738e4ab29ea95fed6e4f6b94
I20260709 12:21:05.544478  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet d90f9cc1738e4ab29ea95fed6e4f6b94 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:05.642576  8900 raft_consensus.cc:1064] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:05.645344  8900 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:05.652822  8764 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.653056  8070 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.655244  8214 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.656468  8848 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.662626  8852 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:05.666685  8852 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:05.697890  8900 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.701975  8214 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.702358  8764 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.717530  7966 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.725595  8062 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:05.747603  8900 consensus_queue.cc:1175] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d67d00ae45b444cbe343726df1760e8" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 12:21:05.757666  8146 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:05.775310  8217 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:05.778136  8848 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:05.790669  8852 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.795043  8917 raft_consensus.cc:1064] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:05.797966  8917 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:05.801501  8217 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.809319  8764 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:05.815124  8214 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.816972  8916 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.818073  8142 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.820297  8764 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:05.821024  8916 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.826426  8931 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:05.827807  8916 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:05.830274  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52f19ea14efe485bb7af9f0baee00fdb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:05.886454  8763 raft_consensus.cc:2955] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.888231  7966 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:05.900064  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55004.9us
W20260709 12:21:05.902616  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57767.6us
I20260709 12:21:05.909266  8916 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.911796  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 52f19ea14efe485bb7af9f0baee00fdb with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:05.917380  8142 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.964226  7963 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.987459  8938 tablet_replica.cc:333] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:05.988744  8938 raft_consensus.cc:2243] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:05.991263  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58158.8us
I20260709 12:21:05.993861  8938 raft_consensus.cc:2272] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.996397  8220 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:05.997169  8763 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.010603  8938 ts_tablet_manager.cc:1916] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:06.015491  8898 raft_consensus.cc:1064] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:06.018360  8898 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:06.036336  8062 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:06.047648  8143 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:06.048897  8763 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:06.049567  8914 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:06.050166  8142 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:06.052754  8799 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.054302  8799 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.058586  8763 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:06.058820  8062 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:06.061149  8917 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.062670  8143 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.076100  8914 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:06.075917  8763 raft_consensus.cc:2955] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.081959  8914 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:06.082460  7967 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.095685  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:06.097394  8938 ts_tablet_manager.cc:1929] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:06.098158  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:06.101033  8938 log.cc:1199] T 52f19ea14efe485bb7af9f0baee00fdb P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/52f19ea14efe485bb7af9f0baee00fdb
I20260709 12:21:06.105175  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 52f19ea14efe485bb7af9f0baee00fdb (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:06.117022  8946 tablet_replica.cc:333] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:06.125084  8946 raft_consensus.cc:2243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.124048  8914 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.125892  8946 raft_consensus.cc:2272] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.129997  8946 ts_tablet_manager.cc:1916] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:06.133518  8764 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.145995  8142 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.147007  8062 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.160777  7967 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.182128  8217 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:06.212985  8946 ts_tablet_manager.cc:1929] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:06.213615  8946 log.cc:1199] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/5bc5d19ae7b44bd6bff5e8b59a820ffb
I20260709 12:21:06.216238  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 5bc5d19ae7b44bd6bff5e8b59a820ffb (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:06.218501  8764 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:06.219014  8062 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:06.220422  8898 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.221903  8914 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:06.233280  8939 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.244096  8063 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.246001  8764 raft_consensus.cc:2955] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:06.246045  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:06.263418  7967 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.276480  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:06.280435  8947 tablet_replica.cc:333] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:06.281559  8947 raft_consensus.cc:2243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.282282  8947 raft_consensus.cc:2272] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.285696  8947 ts_tablet_manager.cc:1916] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:06.298590  8947 ts_tablet_manager.cc:1929] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:06.298918  8947 log.cc:1199] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/3e7bfc6a04b14b94bfa1ea185d2d50d7
I20260709 12:21:06.300530  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 3e7bfc6a04b14b94bfa1ea185d2d50d7 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:07.373983  8143 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.381623  8062 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.381888  8217 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:07.381819  8109 consensus_peers.cc:597] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f036b82035545a1beb20d54efe5a550. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:07.383224  8852 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:07.384202  8926 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.392751  8927 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.395426  8062 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.400290  8220 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.408805  8143 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.415589  7963 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:07.435177  8109 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdd3a4527b584efbaf9d73ae4556e10f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:07.437186  8220 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.438714  8062 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.438654  8926 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:07.440300  8852 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.449630  8927 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.451761  8220 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.455807  8062 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.467751  8143 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.472368  7967 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.479595  8220 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:07.480587  8109 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9927bbb5560416bbc804210e19bb0ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:07.481252  8062 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.481923  8926 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.484313  8927 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:07.502452  8927 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.507587  8062 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.508313  8217 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.525118  7966 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.535470  8217 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:07.542906  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cee9f5adec64ff983b1c5510d0979af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:07.545534  8143 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.546243  8062 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:07.547608  8939 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:07.548527  8914 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.561501  8914 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.563340  8142 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.565253  8063 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.577998  7966 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:07.825667  8968 ts_tablet_manager.cc:933] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:07.827790  8968 tablet_copy_client.cc:323] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:07.830622  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 5f036b82035545a1beb20d54efe5a550 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:07.831283  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 5f036b82035545a1beb20d54efe5a550 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-5f036b82035545a1beb20d54efe5a550
I20260709 12:21:07.841897  8156 tablet_copy_source_session.cc:215] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:07.842828  8970 ts_tablet_manager.cc:933] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:07.845088  8970 tablet_copy_client.cc:323] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:07.845417  8968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f036b82035545a1beb20d54efe5a550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.846772  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet bdd3a4527b584efbaf9d73ae4556e10f from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:07.847332  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet bdd3a4527b584efbaf9d73ae4556e10f from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-bdd3a4527b584efbaf9d73ae4556e10f
I20260709 12:21:07.854980  8156 tablet_copy_source_session.cc:215] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:07.858405  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3a4527b584efbaf9d73ae4556e10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.867569  8968 tablet_copy_client.cc:806] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:07.868502  8968 tablet_copy_client.cc:670] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:07.881242  8970 tablet_copy_client.cc:806] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:07.881912  8970 tablet_copy_client.cc:670] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:07.882957  8968 tablet_copy_client.cc:538] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:07.893304  8970 tablet_copy_client.cc:538] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:07.895488  8968 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:07.908197  8970 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:07.926198  8968 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:07.927152  8968 tablet_bootstrap.cc:492] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:07.927866  8968 ts_tablet_manager.cc:1403] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.012s
I20260709 12:21:07.931193  8968 raft_consensus.cc:359] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.932015  8968 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:07.932762  8968 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.936295  8968 ts_tablet_manager.cc:1434] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:21:07.940927  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-5f036b82035545a1beb20d54efe5a550 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:07.941236  8970 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:07.941406  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-5f036b82035545a1beb20d54efe5a550 on tablet 5f036b82035545a1beb20d54efe5a550 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:07.942322  8970 tablet_bootstrap.cc:492] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:07.943040  8970 ts_tablet_manager.cc:1403] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.015s
I20260709 12:21:07.946321  8970 raft_consensus.cc:359] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.947198  8970 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:07.947832  8970 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:07.950089  8970 ts_tablet_manager.cc:1434] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:07.951759  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-bdd3a4527b584efbaf9d73ae4556e10f received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:07.952168  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-bdd3a4527b584efbaf9d73ae4556e10f on tablet bdd3a4527b584efbaf9d73ae4556e10f with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:08.031162  8970 ts_tablet_manager.cc:933] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:08.034940  8970 tablet_copy_client.cc:323] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:08.038249  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 4cee9f5adec64ff983b1c5510d0979af from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:08.038901  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 4cee9f5adec64ff983b1c5510d0979af from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-4cee9f5adec64ff983b1c5510d0979af
I20260709 12:21:08.047801  8230 tablet_copy_source_session.cc:215] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:08.051438  8970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cee9f5adec64ff983b1c5510d0979af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:08.068142  8970 tablet_copy_client.cc:806] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:08.070502  8970 tablet_copy_client.cc:670] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:08.073881  8968 ts_tablet_manager.cc:933] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:08.074707  8970 tablet_copy_client.cc:538] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:08.075673  8968 tablet_copy_client.cc:323] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:08.077440  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet b9927bbb5560416bbc804210e19bb0ce from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:08.078053  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet b9927bbb5560416bbc804210e19bb0ce from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-b9927bbb5560416bbc804210e19bb0ce
I20260709 12:21:08.085621  8970 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:08.087018  8156 tablet_copy_source_session.cc:215] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:08.090910  8968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9927bbb5560416bbc804210e19bb0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:08.109669  8968 tablet_copy_client.cc:806] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:08.110309  8968 tablet_copy_client.cc:670] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:08.116379  8968 tablet_copy_client.cc:538] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:08.118456  8970 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:08.119493  8970 tablet_bootstrap.cc:492] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:08.120226  8970 ts_tablet_manager.cc:1403] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.008s
I20260709 12:21:08.123533  8970 raft_consensus.cc:359] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:08.124473  8970 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:08.125236  8970 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:08.137125  8968 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:08.146416  8970 ts_tablet_manager.cc:1434] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:21:08.148514  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-4cee9f5adec64ff983b1c5510d0979af received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:08.149055  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-4cee9f5adec64ff983b1c5510d0979af on tablet 4cee9f5adec64ff983b1c5510d0979af with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:08.204300  8968 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:08.205462  8968 tablet_bootstrap.cc:492] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:08.206238  8968 ts_tablet_manager.cc:1403] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.020s
I20260709 12:21:08.209707  8968 raft_consensus.cc:359] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:08.210675  8968 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:08.211393  8968 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:08.214498  8968 ts_tablet_manager.cc:1434] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:21:08.216550  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-b9927bbb5560416bbc804210e19bb0ce received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:08.217023  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-b9927bbb5560416bbc804210e19bb0ce on tablet b9927bbb5560416bbc804210e19bb0ce with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:08.340173  8764 raft_consensus.cc:1217] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:08.423516  8764 raft_consensus.cc:1217] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:08.506651  8764 raft_consensus.cc:1217] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:08.644274  8764 raft_consensus.cc:1217] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:08.832490  8962 raft_consensus.cc:1064] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:08.834844  8962 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:08.844758  8214 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.845950  8070 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.846446  8852 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.846800  8764 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.847806  8927 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.853121  8852 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.875315  8926 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.878577  8764 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.891398  8070 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.893435  8214 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.894062  7966 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.932082  8927 raft_consensus.cc:1064] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:08.934715  8927 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:08.939713  8142 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:08.944096  8764 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.946818  8962 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.952672  8070 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.954702  8214 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:08.955343  8962 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:08.958231  8926 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.967391  8763 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:08.968843  8926 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:08.978078  8214 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:08.980285  8927 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:08.983317  8926 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:08.995551  8852 raft_consensus.cc:1064] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:09.006839  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f036b82035545a1beb20d54efe5a550 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:09.006387  8763 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.009719  8852 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:09.026224  8764 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.026894  8962 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.012286  8214 raft_consensus.cc:2955] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.027575  7963 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.060029  8070 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.064184  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f036b82035545a1beb20d54efe5a550 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:09.069834  8993 tablet_replica.cc:333] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:21:09.098529  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 75359.1us
I20260709 12:21:09.112069  7964 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:09.152002  8993 raft_consensus.cc:2243] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.153025  8993 raft_consensus.cc:2272] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.156510  8993 ts_tablet_manager.cc:1916] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:09.159751  8764 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.164287  8995 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.171113  8062 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.177127  8852 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.181057  8142 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:09.175907  8214 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.187736  8993 ts_tablet_manager.cc:1929] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:09.188524  8993 log.cc:1199] T 5f036b82035545a1beb20d54efe5a550 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/5f036b82035545a1beb20d54efe5a550
I20260709 12:21:09.190737  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 5f036b82035545a1beb20d54efe5a550 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:09.201663  8763 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.208840  8962 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.215799  8212 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.217408  8063 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.221362  8926 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.228561  8927 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.234038  8991 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.234851  8992 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.237581  8764 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.243759  8062 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.252199  8763 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.255849  8063 raft_consensus.cc:2955] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.260766  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdd3a4527b584efbaf9d73ae4556e10f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:09.270694  7964 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:09.282178  8914 raft_consensus.cc:1064] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:09.286568  8914 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:09.295459  8212 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.319237  7964 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.323554  8143 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.324972  8062 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.325886  9002 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:09.333694  8764 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:09.334828  8914 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.342710  9002 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.343675  8143 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:09.359606  8763 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.361019  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet bdd3a4527b584efbaf9d73ae4556e10f with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:09.361459  8992 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.374294  8764 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.371722  8992 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.401070  7964 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.405162  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9927bbb5560416bbc804210e19bb0ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:09.411348  9004 tablet_replica.cc:333] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:09.414866  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet b9927bbb5560416bbc804210e19bb0ce with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:09.431306  8993 tablet_replica.cc:333] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:09.438822  8993 raft_consensus.cc:2243] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.438963  8212 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.439831  8993 raft_consensus.cc:2272] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.443691  8993 ts_tablet_manager.cc:1916] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:09.443056  9002 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.447576  9004 raft_consensus.cc:2243] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.448374  9004 raft_consensus.cc:2272] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.447985  8143 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.457770  9004 ts_tablet_manager.cc:1916] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:09.463673  8993 ts_tablet_manager.cc:1929] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:09.464265  8993 log.cc:1199] T b9927bbb5560416bbc804210e19bb0ce P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/b9927bbb5560416bbc804210e19bb0ce
I20260709 12:21:09.466249  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet b9927bbb5560416bbc804210e19bb0ce (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:09.478072  8992 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.479811  8063 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.485706  9004 ts_tablet_manager.cc:1929] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:09.486207  9004 log.cc:1199] T bdd3a4527b584efbaf9d73ae4556e10f P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/bdd3a4527b584efbaf9d73ae4556e10f
I20260709 12:21:09.485172  8764 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.483935  7966 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.502539  8212 raft_consensus.cc:2955] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.506248  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet bdd3a4527b584efbaf9d73ae4556e10f (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:09.515628  8220 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:09.527101  8764 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.529525  8063 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:09.532928  8996 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:09.533964  9002 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:09.547612  8967 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.549592  8764 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.557837  8063 raft_consensus.cc:2955] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.566679  7964 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:09.584566  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cee9f5adec64ff983b1c5510d0979af with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:09.586323  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4cee9f5adec64ff983b1c5510d0979af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:09.607869  9007 tablet_replica.cc:333] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:09.608974  9007 raft_consensus.cc:2243] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:09.609670  9007 raft_consensus.cc:2272] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:09.613152  9007 ts_tablet_manager.cc:1916] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:09.627882  9007 ts_tablet_manager.cc:1929] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:09.628183  9007 log.cc:1199] T 4cee9f5adec64ff983b1c5510d0979af P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/4cee9f5adec64ff983b1c5510d0979af
I20260709 12:21:09.629819  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 4cee9f5adec64ff983b1c5510d0979af (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:10.690575  8212 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:10.696884  8143 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.698398  8063 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.698297  8996 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:10.698058  8184 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9647a9c32fa748e4bc9548eb7a92bdfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.701176  8967 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:10.706827  8996 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.708841  8142 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.718905  8063 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.738804  7967 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.747269  8142 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:10.761168  8109 consensus_peers.cc:597] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2f0fc39df96412f9cce0cd90f6f96e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.762928  8063 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.764721  8995 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:10.770740  8212 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.780001  8852 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:10.786974  8962 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.787822  8063 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.812681  8212 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.826843  7963 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.832636  8142 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:10.863910  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f18c688c54647cc96908c6b4eb6a80b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.864975  8063 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.867251  8212 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.869412  9021 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:10.871609  8962 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:10.892946  8995 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.897248  8214 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.901736  8063 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.914121  8212 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:10.922794  7967 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:10.926029  8184 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ac329aaff89417f8e5eeb5f5f3e9a17. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:10.925292  8142 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.934178  8063 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:10.934147  8996 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:10.939350  8996 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:10.958086  8967 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.960474  8066 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.960780  8142 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:10.980355  7963 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:11.124891  9030 ts_tablet_manager.cc:933] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:11.126713  9030 tablet_copy_client.cc:323] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:11.128201  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 9647a9c32fa748e4bc9548eb7a92bdfc from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:11.128783  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 9647a9c32fa748e4bc9548eb7a92bdfc from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-9647a9c32fa748e4bc9548eb7a92bdfc
I20260709 12:21:11.137475  8230 tablet_copy_source_session.cc:215] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:11.140816  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9647a9c32fa748e4bc9548eb7a92bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.154698  9030 tablet_copy_client.cc:806] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:11.155238  9030 tablet_copy_client.cc:670] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:11.158773  9030 tablet_copy_client.cc:538] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:11.167937  9030 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:11.199185  9030 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:11.200204  9030 tablet_bootstrap.cc:492] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:11.201025  9030 ts_tablet_manager.cc:1403] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 12:21:11.204949  9030 raft_consensus.cc:359] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.205853  9030 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:11.206575  9030 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.217235  9030 ts_tablet_manager.cc:1434] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:21:11.218930  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-9647a9c32fa748e4bc9548eb7a92bdfc received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:11.219342  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-9647a9c32fa748e4bc9548eb7a92bdfc on tablet 9647a9c32fa748e4bc9548eb7a92bdfc with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:11.246376  9030 ts_tablet_manager.cc:933] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:11.248371  9030 tablet_copy_client.cc:323] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:11.250325  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet a2f0fc39df96412f9cce0cd90f6f96e2 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:11.250805  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet a2f0fc39df96412f9cce0cd90f6f96e2 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-a2f0fc39df96412f9cce0cd90f6f96e2
I20260709 12:21:11.257565  8156 tablet_copy_source_session.cc:215] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:11.262247  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f0fc39df96412f9cce0cd90f6f96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.289151  9030 tablet_copy_client.cc:806] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:11.290047  9030 tablet_copy_client.cc:670] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:11.294606  9030 tablet_copy_client.cc:538] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:11.313588  9030 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:11.337277  9037 ts_tablet_manager.cc:933] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:11.348366  9035 ts_tablet_manager.cc:933] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:11.357465  9035 tablet_copy_client.cc:323] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:11.359001  9037 tablet_copy_client.cc:323] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:11.360807  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 2f18c688c54647cc96908c6b4eb6a80b from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:11.361479  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 2f18c688c54647cc96908c6b4eb6a80b from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-2f18c688c54647cc96908c6b4eb6a80b
I20260709 12:21:11.365171  9030 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:11.366245  9030 tablet_bootstrap.cc:492] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:11.367035  9030 ts_tablet_manager.cc:1403] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.011s
I20260709 12:21:11.368899  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:11.369539  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-6ac329aaff89417f8e5eeb5f5f3e9a17
I20260709 12:21:11.373956  9030 raft_consensus.cc:359] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.376048  9030 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:11.376847  9030 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.379678  9030 ts_tablet_manager.cc:1434] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:21:11.382118  8155 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-a2f0fc39df96412f9cce0cd90f6f96e2 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:11.382614  8155 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-a2f0fc39df96412f9cce0cd90f6f96e2 on tablet a2f0fc39df96412f9cce0cd90f6f96e2 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:11.383495  8230 tablet_copy_source_session.cc:215] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:11.388996  8156 tablet_copy_source_session.cc:215] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:11.392037  9035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f18c688c54647cc96908c6b4eb6a80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.404258  9037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:11.409719  9035 tablet_copy_client.cc:806] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:11.410356  9035 tablet_copy_client.cc:670] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:11.415548  9035 tablet_copy_client.cc:538] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:11.425925  9035 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:11.430948  9037 tablet_copy_client.cc:806] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:11.431617  9037 tablet_copy_client.cc:670] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:11.435297  9037 tablet_copy_client.cc:538] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:11.450232  9035 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:11.451229  9035 tablet_bootstrap.cc:492] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:11.450416  9037 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:11.451900  9035 ts_tablet_manager.cc:1403] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 12:21:11.462139  9035 raft_consensus.cc:359] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.463163  9035 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:11.463977  9035 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.467971  9035 ts_tablet_manager.cc:1434] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:11.469894  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-2f18c688c54647cc96908c6b4eb6a80b received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:11.470329  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-2f18c688c54647cc96908c6b4eb6a80b on tablet 2f18c688c54647cc96908c6b4eb6a80b with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:11.482474  9037 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:11.483428  9037 tablet_bootstrap.cc:492] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:11.484118  9037 ts_tablet_manager.cc:1403] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.003s
I20260709 12:21:11.487131  9037 raft_consensus.cc:359] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.487972  9037 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:11.489197  9037 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:11.491639  9037 ts_tablet_manager.cc:1434] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:21:11.493301  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-6ac329aaff89417f8e5eeb5f5f3e9a17 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:11.493692  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-6ac329aaff89417f8e5eeb5f5f3e9a17 on tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:11.725247  8763 raft_consensus.cc:1217] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:11.734200  8764 raft_consensus.cc:1217] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:11.763003  8764 raft_consensus.cc:1217] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:11.929453  8764 raft_consensus.cc:1217] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:12.286660  9043 raft_consensus.cc:1064] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:12.289350  9043 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.299734  8764 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.300762  8214 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.301309  9022 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.302814  9026 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.305538  8063 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.306818  9026 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.337394  9046 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.339183  8063 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.342958  8214 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.346544  9042 raft_consensus.cc:1064] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:12.349377  9042 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.373873  9052 raft_consensus.cc:1064] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:12.382398  8764 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.384415  8063 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.386196  8142 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.386018  9042 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.387986  8996 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.378501  9052 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.395463  9050 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.389947  7967 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:12.404397  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61533.1us
I20260709 12:21:12.414019  8763 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.443173  9022 raft_consensus.cc:1064] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:12.442991  9042 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.446310  9022 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.442188  8764 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.456068  8062 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.483675  8062 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.494386  8765 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.490561  8996 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:21:12.507893  9056 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.525822  8765 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:21:12.542387  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 70537.2us
I20260709 12:21:12.540194  9046 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:12.558317  8142 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.565945  8143 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.579016  8214 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.582683  8063 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:12.585242  9046 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.587137  9046 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.584208  9064 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.588398  8765 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.617606  7966 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.622581  8063 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.624264  9042 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:21:12.642019  8142 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.659428  8764 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.663120  8217 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.664153  9065 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.666122  9065 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.687378  9063 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.688087  7966 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.707489  8217 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.710784  9043 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.718744  8063 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.730358  8220 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.732849  8762 raft_consensus.cc:2955] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.760807  8765 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.763296  8062 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.771852  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2f0fc39df96412f9cce0cd90f6f96e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:12.774484  9064 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:12.793476  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50012.6us
I20260709 12:21:12.790665  8143 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.797919  9042 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.810598  8214 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.811098  7964 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.814394  7963 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.825446  9042 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.828680  8220 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.840256  8764 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.842177  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f0fc39df96412f9cce0cd90f6f96e2 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:12.843299  8062 raft_consensus.cc:2955] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.871419  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:12.866503  7963 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.878432  9077 tablet_replica.cc:333] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:12.879678  9077 raft_consensus.cc:2243] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.880913  8762 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.883392  9064 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.883860  8062 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.901017  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:12.880419  9077 raft_consensus.cc:2272] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.872080  8764 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.896894  9056 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.908892  8996 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:12.898905  8762 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.915588  9079 tablet_replica.cc:333] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:12.917080  9079 raft_consensus.cc:2243] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.918035  9079 raft_consensus.cc:2272] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.922319  8062 raft_consensus.cc:2955] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.923935  9079 ts_tablet_manager.cc:1916] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:12.934141  7967 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.937382  9077 ts_tablet_manager.cc:1916] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:12.942757  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9647a9c32fa748e4bc9548eb7a92bdfc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:12.953562  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 9647a9c32fa748e4bc9548eb7a92bdfc with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:12.959857  9079 ts_tablet_manager.cc:1929] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:12.960420  9079 log.cc:1199] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/6ac329aaff89417f8e5eeb5f5f3e9a17
I20260709 12:21:12.962085  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 6ac329aaff89417f8e5eeb5f5f3e9a17 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:12.962232  9079 tablet_replica.cc:333] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:12.963791  9079 raft_consensus.cc:2243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:12.964643  9079 raft_consensus.cc:2272] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:12.968498  9079 ts_tablet_manager.cc:1916] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:12.973790  8143 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:12.977085  9077 ts_tablet_manager.cc:1929] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:12.977598  9077 log.cc:1199] T a2f0fc39df96412f9cce0cd90f6f96e2 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/a2f0fc39df96412f9cce0cd90f6f96e2
I20260709 12:21:12.983562  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet a2f0fc39df96412f9cce0cd90f6f96e2 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:12.987346  8764 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.988828  8062 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:12.988899  9046 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.990118  9043 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.995860  9046 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:12.999491  8062 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:13.001188  8764 raft_consensus.cc:2955] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:13.006906  9079 ts_tablet_manager.cc:1929] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:13.007462  9079 log.cc:1199] T 9647a9c32fa748e4bc9548eb7a92bdfc P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/9647a9c32fa748e4bc9548eb7a92bdfc
I20260709 12:21:13.009732  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 9647a9c32fa748e4bc9548eb7a92bdfc (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:13.035310  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f18c688c54647cc96908c6b4eb6a80b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:13.031498  7966 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:13.049827  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f18c688c54647cc96908c6b4eb6a80b with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:13.056172  9080 tablet_replica.cc:333] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:13.056883  9080 raft_consensus.cc:2243] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:13.057572  9080 raft_consensus.cc:2272] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:13.066924  9080 ts_tablet_manager.cc:1916] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:13.080715  9080 ts_tablet_manager.cc:1929] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:13.082082  9080 log.cc:1199] T 2f18c688c54647cc96908c6b4eb6a80b P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/2f18c688c54647cc96908c6b4eb6a80b
I20260709 12:21:13.083606  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 2f18c688c54647cc96908c6b4eb6a80b (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:14.123606  8213 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:14.132295  8184 consensus_peers.cc:597] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ac2bed7a5004a9dbb30cda857b5ef6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:14.132571  8142 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.133209  8065 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.135586  9056 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.137018  9084 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:14.147112  9084 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.149761  8142 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.150565  8062 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.173120  8142 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.173844  7967 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.187526  8216 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.188879  8062 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.189306  9076 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:14.192812  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0351f909341497abfdf11bbc6fd51e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:14.193630  9076 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.197546  9078 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.205456  8216 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.213186  8213 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.225629  7963 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.225716  8062 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:14.237073  8184 consensus_peers.cc:597] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4ed3b4d69eb4982923a37293db3b766. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:14.240203  8142 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.242818  9056 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.240463  8065 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.253592  9056 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:14.261711  9084 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.266319  8142 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.270678  8065 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.276678  8213 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.280846  7963 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.301584  8142 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:14.304672  9056 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.315753  8062 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:14.317899  8184 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14112996240a40858e18c7a0d75b2a12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:14.318014  9064 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.317668  9098 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.319852  8142 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.327979  8062 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:14.343247  7966 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.590715  9101 ts_tablet_manager.cc:933] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:14.592998  9101 tablet_copy_client.cc:323] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:14.595323  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet c0351f909341497abfdf11bbc6fd51e0 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:14.595979  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet c0351f909341497abfdf11bbc6fd51e0 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-c0351f909341497abfdf11bbc6fd51e0
I20260709 12:21:14.605268  8156 tablet_copy_source_session.cc:215] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:14.608587  9101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0351f909341497abfdf11bbc6fd51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:14.640012  9101 tablet_copy_client.cc:806] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:14.640758  9101 tablet_copy_client.cc:670] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:14.642252  9103 ts_tablet_manager.cc:933] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:14.643796  9104 ts_tablet_manager.cc:933] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:14.653560  9103 tablet_copy_client.cc:323] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:14.654047  9101 tablet_copy_client.cc:538] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:14.650981  9104 tablet_copy_client.cc:323] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:14.655624  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:14.656302  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 8ac2bed7a5004a9dbb30cda857b5ef6d from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-8ac2bed7a5004a9dbb30cda857b5ef6d
I20260709 12:21:14.656666  8229 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet c4ed3b4d69eb4982923a37293db3b766 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:14.657217  8229 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet c4ed3b4d69eb4982923a37293db3b766 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-c4ed3b4d69eb4982923a37293db3b766
I20260709 12:21:14.673641  8229 tablet_copy_source_session.cc:215] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:14.674528  8230 tablet_copy_source_session.cc:215] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:14.677789  9103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:14.678531  9104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ed3b4d69eb4982923a37293db3b766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:14.681914  9101 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:14.716888  9104 tablet_copy_client.cc:806] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:14.717514  9104 tablet_copy_client.cc:670] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:14.718281  9101 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:14.719229  9101 tablet_bootstrap.cc:492] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:14.719901  9101 ts_tablet_manager.cc:1403] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.013s
I20260709 12:21:14.721542  9104 tablet_copy_client.cc:538] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:14.723208  9101 raft_consensus.cc:359] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.728008  9101 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:14.728790  9101 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.740864  9104 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:14.743721  9103 tablet_copy_client.cc:806] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:14.744406  9103 tablet_copy_client.cc:670] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:14.755601  9103 tablet_copy_client.cc:538] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:14.758348  9101 ts_tablet_manager.cc:1434] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.013s
I20260709 12:21:14.768500  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-c0351f909341497abfdf11bbc6fd51e0 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:14.769006  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-c0351f909341497abfdf11bbc6fd51e0 on tablet c0351f909341497abfdf11bbc6fd51e0 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:14.771103  9103 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:14.796846  9104 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:14.798245  9104 tablet_bootstrap.cc:492] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:14.799144  9104 ts_tablet_manager.cc:1403] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.010s
I20260709 12:21:14.803123  9104 raft_consensus.cc:359] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.803848  9104 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:14.804468  9104 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.807451  9104 ts_tablet_manager.cc:1434] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:21:14.809325  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-c4ed3b4d69eb4982923a37293db3b766 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:14.809669  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-c4ed3b4d69eb4982923a37293db3b766 on tablet c4ed3b4d69eb4982923a37293db3b766 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:14.813395  9103 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:14.814370  9103 tablet_bootstrap.cc:492] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:14.815112  9103 ts_tablet_manager.cc:1403] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.006s
I20260709 12:21:14.818953  9103 raft_consensus.cc:359] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.819808  9103 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:14.821038  9103 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.823297  9103 ts_tablet_manager.cc:1434] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:14.824957  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-8ac2bed7a5004a9dbb30cda857b5ef6d received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:14.825343  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-8ac2bed7a5004a9dbb30cda857b5ef6d on tablet 8ac2bed7a5004a9dbb30cda857b5ef6d with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:14.876770  9103 ts_tablet_manager.cc:933] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:14.878499  9103 tablet_copy_client.cc:323] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:14.880029  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 14112996240a40858e18c7a0d75b2a12 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:14.880577  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 14112996240a40858e18c7a0d75b2a12 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-14112996240a40858e18c7a0d75b2a12
I20260709 12:21:14.888242  8230 tablet_copy_source_session.cc:215] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:14.891970  9103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14112996240a40858e18c7a0d75b2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:14.915778  9103 tablet_copy_client.cc:806] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:14.916436  9103 tablet_copy_client.cc:670] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:14.926045  9103 tablet_copy_client.cc:538] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:14.936327  9103 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:14.964442  9103 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:14.965569  9103 tablet_bootstrap.cc:492] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:14.966300  9103 ts_tablet_manager.cc:1403] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.004s
I20260709 12:21:14.968886  8762 raft_consensus.cc:1217] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:14.969486  9103 raft_consensus.cc:359] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.970422  9103 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:14.972168  9103 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:14.975899  9103 ts_tablet_manager.cc:1434] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:14.978348  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-14112996240a40858e18c7a0d75b2a12 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:14.978808  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-14112996240a40858e18c7a0d75b2a12 on tablet 14112996240a40858e18c7a0d75b2a12 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:15.076333  8762 raft_consensus.cc:1217] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:15.128666  8762 raft_consensus.cc:1217] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:15.373037  9078 raft_consensus.cc:1064] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:15.375553  9078 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.384295  8764 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.385816  9082 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.386224  8214 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.388509  9082 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.392781  8063 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.401340  9082 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.415747  9043 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.421510  8764 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.428608  8213 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.435840  7966 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.425392  8063 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.466218  8764 raft_consensus.cc:1217] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:15.502996  8142 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.526178  8764 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.526805  8065 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.534176  9105 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:15.536877  9043 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:15.538244  9121 raft_consensus.cc:1064] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:15.540874  9121 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.545090  9105 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.550242  8764 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.552318  9113 raft_consensus.cc:1064] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:15.554895  9113 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.562094  8065 raft_consensus.cc:2955] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.583197  7963 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.596940  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet c0351f909341497abfdf11bbc6fd51e0 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:15.603303  9128 tablet_replica.cc:333] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:15.604729  9128 raft_consensus.cc:2243] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.605630  9128 raft_consensus.cc:2272] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.611637  9128 ts_tablet_manager.cc:1916] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:15.632740  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0351f909341497abfdf11bbc6fd51e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:15.647147  8764 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.647367  8142 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.649699  8065 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.652489  9113 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.653394  9064 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.658401  9064 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.668097  9128 ts_tablet_manager.cc:1929] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:15.671245  8143 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.673744  9128 log.cc:1199] T c0351f909341497abfdf11bbc6fd51e0 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/c0351f909341497abfdf11bbc6fd51e0
I20260709 12:21:15.674513  8062 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.675360  9064 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.676219  9121 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.676776  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet c0351f909341497abfdf11bbc6fd51e0 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:15.676805  8762 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:15.682716  9064 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.693339  9113 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.694545  8146 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.730309  8764 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.722239  7967 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.737550  8065 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.743260  8762 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.734015  9121 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.735476  8062 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.762972  8213 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.763998  8142 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.766484  7967 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.772218  8146 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.774159  9064 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:15.781872  8762 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.782663  9098 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.783800  9113 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:15.789076  8142 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.789472  8764 raft_consensus.cc:2955] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.802577  8216 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:15.819667  8762 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.822753  7964 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.833843  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:15.841956  9113 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:15.842736  8142 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:15.844472  9113 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:15.851709  9121 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.855829  8146 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.858668  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ac2bed7a5004a9dbb30cda857b5ef6d with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:15.866642  9136 tablet_replica.cc:333] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:15.867740  9136 raft_consensus.cc:2243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.868481  9136 raft_consensus.cc:2272] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.868026  8762 raft_consensus.cc:2955] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.874254  9136 ts_tablet_manager.cc:1916] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:15.890801  9136 ts_tablet_manager.cc:1929] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:15.891253  9136 log.cc:1199] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/8ac2bed7a5004a9dbb30cda857b5ef6d
I20260709 12:21:15.895339  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 8ac2bed7a5004a9dbb30cda857b5ef6d (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:15.895684  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4ed3b4d69eb4982923a37293db3b766 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:15.901780  7963 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:15.917140  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ed3b4d69eb4982923a37293db3b766 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:15.918140  9136 tablet_replica.cc:333] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:15.919063  9136 raft_consensus.cc:2243] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.919824  9136 raft_consensus.cc:2272] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.927953  9136 ts_tablet_manager.cc:1916] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:15.945379  9136 ts_tablet_manager.cc:1929] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:15.945820  9136 log.cc:1199] T c4ed3b4d69eb4982923a37293db3b766 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/c4ed3b4d69eb4982923a37293db3b766
I20260709 12:21:15.947176  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet c4ed3b4d69eb4982923a37293db3b766 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:16.008337  9064 raft_consensus.cc:1064] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:16.010524  9064 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:16.017175  8762 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:16.017537  8146 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:16.018814  8065 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:16.018949  9098 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:16.020016  9064 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:16.021327  9121 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:16.049130  9098 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.050778  8062 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.063447  8146 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.076330  7966 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:16.116855  8764 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.154345  8213 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:16.159929  8762 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:16.160079  8062 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:16.161572  9121 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:16.162411  9064 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:16.168735  9121 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.170462  8062 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.181350  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14112996240a40858e18c7a0d75b2a12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:16.179843  8762 raft_consensus.cc:2955] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:16.198108  7963 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:16.211997  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 14112996240a40858e18c7a0d75b2a12 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:16.213553  9141 tablet_replica.cc:333] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:16.214480  9141 raft_consensus.cc:2243] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.215157  9141 raft_consensus.cc:2272] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.218685  9141 ts_tablet_manager.cc:1916] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:16.231753  9141 ts_tablet_manager.cc:1929] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:16.232254  9141 log.cc:1199] T 14112996240a40858e18c7a0d75b2a12 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/14112996240a40858e18c7a0d75b2a12
I20260709 12:21:16.234781  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 14112996240a40858e18c7a0d75b2a12 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:17.290180  8146 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.298327  8216 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.300947  8065 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.301558  9149 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:17.304461  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eef17f41a1d74cc39da4096cfd1d9edd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.305797  9149 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.310874  9149 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.312445  8216 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.320276  8065 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.329511  8216 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.333770  7964 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:17.343065  8146 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.344767  9121 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.345386  8063 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.347965  9135 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:17.352280  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6f5552bf1b244738e961ee3f9a8554b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.358518  9135 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.360704  8146 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.361938  8063 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.397262  8142 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:17.419902  8109 consensus_peers.cc:597] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fae0a66399b64e649f375238dc4cbcde. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.424001  8216 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.425959  8062 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.426486  9043 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.428259  9043 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:17.434351  7963 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.463573  9149 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.465282  8062 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.468106  8220 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.486707  7963 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.498615  8142 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:17.506826  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc07fb1a83da4d4a9ab7b5ef8e9f7f10. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.508085  8220 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.509708  8063 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:17.510105  9146 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.518119  9146 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.551000  9146 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.553088  8062 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.560691  8220 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.572531  7963 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:17.756914  9169 ts_tablet_manager.cc:933] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:17.764506  9169 tablet_copy_client.cc:323] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:17.766940  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet eef17f41a1d74cc39da4096cfd1d9edd from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:17.767621  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet eef17f41a1d74cc39da4096cfd1d9edd from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-eef17f41a1d74cc39da4096cfd1d9edd
I20260709 12:21:17.776054  8156 tablet_copy_source_session.cc:215] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:17.779520  9169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef17f41a1d74cc39da4096cfd1d9edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:17.796490  9169 tablet_copy_client.cc:806] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:17.797290  9169 tablet_copy_client.cc:670] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:17.804612  9169 tablet_copy_client.cc:538] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:17.826203  9169 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:17.851050  9169 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:17.851799  9169 tablet_bootstrap.cc:492] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:17.852355  9169 ts_tablet_manager.cc:1403] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 12:21:17.855207  9169 raft_consensus.cc:359] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.855957  9169 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:17.856577  9169 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.859807  9169 ts_tablet_manager.cc:1434] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:17.861783  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-eef17f41a1d74cc39da4096cfd1d9edd received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:17.862272  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-eef17f41a1d74cc39da4096cfd1d9edd on tablet eef17f41a1d74cc39da4096cfd1d9edd with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:17.892740  9169 ts_tablet_manager.cc:933] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:17.897897  9169 tablet_copy_client.cc:323] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:17.899808  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet c6f5552bf1b244738e961ee3f9a8554b from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:17.900372  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet c6f5552bf1b244738e961ee3f9a8554b from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-c6f5552bf1b244738e961ee3f9a8554b
I20260709 12:21:17.913757  8230 tablet_copy_source_session.cc:215] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:17.916826  9169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f5552bf1b244738e961ee3f9a8554b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:17.931074  9174 ts_tablet_manager.cc:933] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:17.931816  9169 tablet_copy_client.cc:806] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:17.932613  9169 tablet_copy_client.cc:670] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:17.933147  9174 tablet_copy_client.cc:323] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:17.934922  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet fae0a66399b64e649f375238dc4cbcde from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:17.935530  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet fae0a66399b64e649f375238dc4cbcde from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-fae0a66399b64e649f375238dc4cbcde
I20260709 12:21:17.937386  9169 tablet_copy_client.cc:538] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:17.943768  8156 tablet_copy_source_session.cc:215] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:17.947515  9174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0a66399b64e649f375238dc4cbcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:17.948591  9169 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:17.974382  9169 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:17.975385  9169 tablet_bootstrap.cc:492] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:17.976117  9169 ts_tablet_manager.cc:1403] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 12:21:17.979110  9169 raft_consensus.cc:359] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.980029  9169 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:17.980788  9169 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:17.982167  9174 tablet_copy_client.cc:806] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:17.982792  9174 tablet_copy_client.cc:670] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:17.983747  9169 ts_tablet_manager.cc:1434] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:21:17.986001  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-c6f5552bf1b244738e961ee3f9a8554b received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:17.986454  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-c6f5552bf1b244738e961ee3f9a8554b on tablet c6f5552bf1b244738e961ee3f9a8554b with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:17.989953  9174 tablet_copy_client.cc:538] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:18.003495  9174 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:18.024281  9174 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:18.025244  9174 tablet_bootstrap.cc:492] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:18.025936  9174 ts_tablet_manager.cc:1403] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:21:18.028930  9174 raft_consensus.cc:359] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:18.029791  9174 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:18.030449  9174 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:18.036495  9174 ts_tablet_manager.cc:1434] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:18.038515  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-fae0a66399b64e649f375238dc4cbcde received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:18.038968  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-fae0a66399b64e649f375238dc4cbcde on tablet fae0a66399b64e649f375238dc4cbcde with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:18.105542  9174 ts_tablet_manager.cc:933] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:18.107841  9174 tablet_copy_client.cc:323] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:18.109494  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:18.110025  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-fc07fb1a83da4d4a9ab7b5ef8e9f7f10
I20260709 12:21:18.119990  8156 tablet_copy_source_session.cc:215] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:18.122905  9174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.136504  9174 tablet_copy_client.cc:806] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:18.137148  9174 tablet_copy_client.cc:670] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:18.140898  9174 tablet_copy_client.cc:538] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:18.148610  9174 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:18.168565  9174 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:18.169708  9174 tablet_bootstrap.cc:492] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:18.170508  9174 ts_tablet_manager.cc:1403] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.008s
I20260709 12:21:18.173779  9174 raft_consensus.cc:359] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:18.174772  9174 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:18.175575  9174 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:18.178210  9174 ts_tablet_manager.cc:1434] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:18.187106  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-fc07fb1a83da4d4a9ab7b5ef8e9f7f10 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:18.188463  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-fc07fb1a83da4d4a9ab7b5ef8e9f7f10 on tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:18.312734  8764 raft_consensus.cc:1217] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:18.413823  8764 raft_consensus.cc:1217] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:18.430255  8764 raft_consensus.cc:1217] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:18.677444  8764 raft_consensus.cc:1217] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:18.918545  9144 raft_consensus.cc:1064] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:18.921703  9144 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:18.929993  8764 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.930287  8216 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.932314  8063 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.932134  9144 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:18.933902  9043 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:18.936149  9149 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:18.941525  9043 raft_consensus.cc:1064] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:18.946223  9043 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:18.978802  9149 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:18.983639  8220 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.984973  8063 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:18.987236  9043 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:18.988392  8764 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.993741  8062 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:18.999773  8762 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.004266  9182 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.016803  7964 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.027622  9158 raft_consensus.cc:1064] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:19.037094  9043 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.041118  9158 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:19.104247  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 89284.9us
I20260709 12:21:19.125226  8146 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.126911  9158 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.127310  8062 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.132581  8217 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.144804  8762 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.147596  8066 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.125087  9043 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.167693  9190 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:19.171245  9190 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.177313  8762 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.187803  8220 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.205502  9180 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.208213  8762 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.212471  8062 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.235962  8142 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.238516  7967 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.240481  7967 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.240334  8146 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.252645  8764 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.253221  8220 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.255045  9188 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.256953  9188 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.265933  9182 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.268044  8220 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.281594  8762 raft_consensus.cc:2955] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.295987  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fae0a66399b64e649f375238dc4cbcde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:19.299674  9149 raft_consensus.cc:1064] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:19.302532  9149 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.312098  8146 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.312986  7966 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.313344  8220 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.325125  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet fae0a66399b64e649f375238dc4cbcde with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:19.326736  8762 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.327049  8062 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.330514  9190 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.331964  9187 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.333041  9205 tablet_replica.cc:333] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:19.333984  9205 raft_consensus.cc:2243] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.334759  9205 raft_consensus.cc:2272] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.341776  9205 ts_tablet_manager.cc:1916] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:19.341269  9187 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.344499  8762 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.351920  8062 raft_consensus.cc:2955] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.353582  8764 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.360471  9205 ts_tablet_manager.cc:1929] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:19.361099  9205 log.cc:1199] T fae0a66399b64e649f375238dc4cbcde P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/fae0a66399b64e649f375238dc4cbcde
I20260709 12:21:19.362833  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet fae0a66399b64e649f375238dc4cbcde (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:19.363874  8063 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.375263  7966 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.388564  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6f5552bf1b244738e961ee3f9a8554b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:19.391036  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet c6f5552bf1b244738e961ee3f9a8554b with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:19.395565  9043 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:19.398789  8220 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.400312  8762 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.402333  9188 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.402658  8063 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:19.408172  9200 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:19.410936  9200 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.422749  9208 tablet_replica.cc:333] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:19.424532  9188 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:19.429258  9149 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.441542  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eef17f41a1d74cc39da4096cfd1d9edd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:19.445540  8063 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.449673  8764 raft_consensus.cc:2955] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.466907  7966 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.471252  9149 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.478653  8764 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.483958  9208 raft_consensus.cc:2243] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.484614  9208 raft_consensus.cc:2272] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.490123  9208 ts_tablet_manager.cc:1916] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:19.500965  8220 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.507113  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet eef17f41a1d74cc39da4096cfd1d9edd with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:19.516230  7964 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.523176  9208 ts_tablet_manager.cc:1929] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:19.523675  9208 log.cc:1199] T c6f5552bf1b244738e961ee3f9a8554b P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/c6f5552bf1b244738e961ee3f9a8554b
I20260709 12:21:19.525614  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet c6f5552bf1b244738e961ee3f9a8554b (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:19.526312  9212 tablet_replica.cc:333] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:19.527571  9212 raft_consensus.cc:2243] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.528601  9212 raft_consensus.cc:2272] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.534504  8063 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.538151  9212 ts_tablet_manager.cc:1916] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:19.549028  8146 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.568955  8762 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.569747  8063 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:19.574409  9188 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.576385  9212 ts_tablet_manager.cc:1929] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:19.576845  9144 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:19.577486  9212 log.cc:1199] T eef17f41a1d74cc39da4096cfd1d9edd P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/eef17f41a1d74cc39da4096cfd1d9edd
I20260709 12:21:19.579480  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet eef17f41a1d74cc39da4096cfd1d9edd (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:19.585206  9043 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.589852  8066 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.591755  8762 raft_consensus.cc:2955] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.602276  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:19.609481  7963 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:19.622637  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:19.623759  9212 tablet_replica.cc:333] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:21:19.624857  9212 raft_consensus.cc:2243] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.625628  9212 raft_consensus.cc:2272] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.628888  9212 ts_tablet_manager.cc:1916] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:19.643370  9212 ts_tablet_manager.cc:1929] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:19.643720  9212 log.cc:1199] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/fc07fb1a83da4d4a9ab7b5ef8e9f7f10
I20260709 12:21:19.645112  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet fc07fb1a83da4d4a9ab7b5ef8e9f7f10 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:19.828800  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:19.886281  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:19.887054  8142 raft_consensus.cc:606] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:19.890035  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:19.890540  8142 raft_consensus.cc:606] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:19.893241  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:19.893745  8142 raft_consensus.cc:606] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:19.896080  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea9fb7818f049248d8577e73c087888"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:19.896528  8142 raft_consensus.cc:606] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:19.898685  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:19.899091  8142 raft_consensus.cc:606] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:19.900043  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:19.901254  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:19.901957  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:19.963061  9200 raft_consensus.cc:993] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:19.963657  9043 raft_consensus.cc:1081] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:19.965353  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:21:19.965937  8762 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:19.966300  8762 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.970909  8762 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.973760  8762 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:19.974447  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:19.974377  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:19.975260  8063 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.975366  8142 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:19.975772  8142 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:19.976485  8142 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.977600  8142 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:19.980749  8063 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:19.981961  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:19.982822  9172 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:19.984511  8142 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:19.985075  9172 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:19.986188  9172 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:19.994066  7963 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.073457  9200 raft_consensus.cc:993] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.073997  9200 raft_consensus.cc:1081] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.075681  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:21:20.076210  8762 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:20.076563  8762 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.082666  8762 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.084976  8762 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:20.085335  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:20.085582  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:20.085951  8066 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.086135  8146 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:20.086362  8146 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:20.086886  8146 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.087703  8146 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.091593  8066 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.092849  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:20.093775  9172 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:20.094218  9200 raft_consensus.cc:993] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.094241  9172 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:20.094859  9200 raft_consensus.cc:1081] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.094988  8146 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.095463  9172 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.096786  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea9fb7818f049248d8577e73c087888"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:21:20.097388  8762 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:20.097774  8762 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.104549  8762 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.106771  8762 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:20.107313  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:20.108669  8066 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.108166  7963 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.108156  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:20.112515  8146 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:20.112833  8146 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:20.113545  8146 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.115901  8066 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.116457  8146 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.117115  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:20.122738  8146 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.125691  9172 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:20.126284  9172 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:20.127211  9172 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.143023  7963 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.228137  9200 raft_consensus.cc:993] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:20.228709  9043 raft_consensus.cc:1081] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:20.230335  8063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:20.230794  8063 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:20.231060  8063 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.236516  8063 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:20.239603  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:20.240198  8146 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:20.240305  8063 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:20.240551  8146 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:20.240487  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:20.241317  8212 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.241523  8146 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:20.242517  8146 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.248381  8212 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:20.249338  8146 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:20.249871  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:20.250752  9215 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:20.251151  9215 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:20.252444  9215 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:20.261482  7963 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.397383  9200 raft_consensus.cc:993] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.397930  9144 raft_consensus.cc:1081] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:20.399272  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:21:20.399731  8762 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:20.400027  8762 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.406020  8762 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.407847  8762 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:20.408502  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:20.409054  8146 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:20.409241  8146 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:20.409840  8146 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.410753  8146 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.412966  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:20.413426  8212 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:20.415894  8146 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.417191  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:20.418090  9172 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:20.418485  9172 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:20.419276  9172 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:20.421375  8212 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:20.427016  7963 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.460851  8062 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.462162  9172 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:20.472307  8142 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.482121  9224 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:20.486572  8146 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.488077  9224 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:20.501415  8062 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.506115  9216 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:20.690852  8015 auto_rebalancer.cc:629] Failed to schedule move for tablet 753bdf66ab9c48ceb9558028f4bcf7e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:20.695333  8146 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:20.702666  8220 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:20.703343  8109 consensus_peers.cc:597] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c7fc19421924a9a9d7c350bf097e173. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.703552  8062 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:20.705147  9200 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.706255  9144 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.714063  8146 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.715397  9216 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:20.715289  9043 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:20.718967  8062 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:20.728385  8212 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:20.729833  8063 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.731338  9216 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:20.736904  8220 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:20.738395  9221 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.755137  8217 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:20.782307  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab203f6136b5456cacf2c4f8c664004b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.785290  8065 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:20.792408  9187 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:21:20.850389  8220 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.859567  9172 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:20.860217  8142 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:20.852205  7963 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:20.881867  8145 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:20.885301  9207 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:20.900805  9187 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:20.914464  8141 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:20.917629  9216 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:20.941524  9187 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:20.947059  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.963351  8063 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:21.025557  8141 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:21.054004  8145 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:21.065080  7967 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.085599  8212 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:21.087852  8109 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72a3a306870b4fb1b1c3a1860a643731. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:21.088359  9200 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.089707  8062 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:21.102502  9200 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.118963  8141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:21.119690  8141 raft_consensus.cc:606] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:21.124464  8141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31800511c940e48a418a30b32976fd"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:21.125137  8141 raft_consensus.cc:606] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:21.125742  9235 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:21.131489  8141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:21.132171  8141 raft_consensus.cc:606] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:21.135746  8062 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:21.131074  8212 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:21.151760  8141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:21.152459  8141 raft_consensus.cc:606] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:21.156582  7964 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.158397  9144 raft_consensus.cc:993] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.162056  9144 raft_consensus.cc:1081] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.162799  8141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:21.164834  8141 raft_consensus.cc:606] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:21.169704  8063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:21.170285  8063 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.170653  8063 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.171564  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:21.173323  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:21.181847  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:21.185534  9200 raft_consensus.cc:993] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.186008  9235 raft_consensus.cc:1081] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.187072  8063 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.187877  9200 raft_consensus.cc:993] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:21.188122  8065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a31800511c940e48a418a30b32976fd"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:21.188338  9200 raft_consensus.cc:1081] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:21.188762  8065 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.189167  8065 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.190155  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:21.190790  8141 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.191109  8141 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:21.191946  8141 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.196820  8141 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.199342  8065 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.206866  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:21.207517  8145 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.207819  8145 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:21.208556  8145 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.205745  8065 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:21.209702  8145 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.206885  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:21.213306  8216 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.215241  8141 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.216878  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:21.218065  9207 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.218596  9207 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:21.219550  9207 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.220319  8216 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.221563  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:21.223385  9221 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.223881  9221 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:21.224815  9221 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.232903  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:21:21.234520  8212 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.234902  8212 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.233493  8063 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:21.235836  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:21.236377  8220 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.243345  8145 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.250836  8220 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.271607  9255 ts_tablet_manager.cc:933] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:21.276532  8212 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.279775  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:21.280010  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:21.281550  8063 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.281599  8141 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.282078  8141 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:21.282840  8141 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.283996  8141 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.291123  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:21.292230  8212 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:21.292448  7966 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.299844  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:21.303323  8141 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:21.304951  9255 tablet_copy_client.cc:323] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:21.306869  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet ab203f6136b5456cacf2c4f8c664004b from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:21.307463  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet ab203f6136b5456cacf2c4f8c664004b from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-ab203f6136b5456cacf2c4f8c664004b
I20260709 12:21:21.314354  9243 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.314989  9243 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:21.315649  9235 raft_consensus.cc:993] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.316162  9235 raft_consensus.cc:1081] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:21.316036  9243 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.327924  9259 ts_tablet_manager.cc:933] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:21.329149  8065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:21.329749  8065 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.330108  8065 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.331957  8230 tablet_copy_source_session.cc:215] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:21.342342  8065 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.354104  9144 raft_consensus.cc:993] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:21.354576  9144 raft_consensus.cc:1081] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:21.355441  8065 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:21.355324  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:21.356885  8141 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.357254  8141 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:21.357681  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:21:21.358208  8212 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.358599  8212 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.358080  8141 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.355988  9255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab203f6136b5456cacf2c4f8c664004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.355334  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:21.363001  8220 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.347384  7966 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:21.365007  7964 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.366984  8141 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.370612  8212 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.374622  8141 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.376102  8220 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:21.377425  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:21.378502  9221 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.379041  9221 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:21.379966  9221 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.382735  8212 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:21.383711  9259 tablet_copy_client.cc:323] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:21.384806  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:21.385491  8065 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.394228  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 0c7fc19421924a9a9d7c350bf097e173 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:21.394996  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 0c7fc19421924a9a9d7c350bf097e173 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-0c7fc19421924a9a9d7c350bf097e173
I20260709 12:21:21.395570  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:21.396190  8141 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.396482  8141 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:21.396576  8065 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:21.400525  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:21.400312  8141 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.403630  8141 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.408304  9243 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.408919  9243 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:21.410025  9243 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:21.414438  8141 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:21.428130  9255 tablet_copy_client.cc:806] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:21.428911  9255 tablet_copy_client.cc:670] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:21.437934  9255 tablet_copy_client.cc:538] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:21.438911  8156 tablet_copy_source_session.cc:215] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:21.447948  9259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7fc19421924a9a9d7c350bf097e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.453889  9255 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:21.508080  7966 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:21.509783  7964 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.525965  9259 tablet_copy_client.cc:806] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:21.526842  9259 tablet_copy_client.cc:670] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:21.761653  8212 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.772831  8143 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.773029  8213 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.773351  9207 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:21.778082  8141 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.779253  9241 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:21.779713  9268 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:21.782668  9221 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:21.808997  9259 tablet_copy_client.cc:538] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:21.810631  9255 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:21.811563  9255 tablet_bootstrap.cc:492] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:21.812212  9255 ts_tablet_manager.cc:1403] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.359s	user 0.038s	sys 0.042s
I20260709 12:21:21.829486  8141 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.848379  9207 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.889380  8146 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:21.894284  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45549.9us
I20260709 12:21:21.906313  9259 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:21.921404  8065 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.930538  8065 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.864100  9255 raft_consensus.cc:359] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:21.897418  9215 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.933756  9255 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:21.958844  9243 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.962282  9243 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.934453  9255 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:21.967060  8213 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.968796  9275 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:21.979847  9255 ts_tablet_manager.cc:1434] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.000s
I20260709 12:21:21.981532  8143 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:22.015278  9259 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:22.028570  9259 tablet_bootstrap.cc:492] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:22.029292  9259 ts_tablet_manager.cc:1403] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.007s
I20260709 12:21:22.033561  9243 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:22.037006  9259 raft_consensus.cc:359] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:22.037958  9259 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:22.038614  9259 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:22.025465  9274 ts_tablet_manager.cc:933] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:22.041890  9259 ts_tablet_manager.cc:1434] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:21:22.043569  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-0c7fc19421924a9a9d7c350bf097e173 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:22.043962  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-0c7fc19421924a9a9d7c350bf097e173 on tablet 0c7fc19421924a9a9d7c350bf097e173 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:22.046250  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-ab203f6136b5456cacf2c4f8c664004b received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:22.046718  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-ab203f6136b5456cacf2c4f8c664004b on tablet ab203f6136b5456cacf2c4f8c664004b with peer 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:22.092284  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47843.7us
I20260709 12:21:22.097400  9274 tablet_copy_client.cc:323] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:22.100149  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 72a3a306870b4fb1b1c3a1860a643731 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:22.100714  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 72a3a306870b4fb1b1c3a1860a643731 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-72a3a306870b4fb1b1c3a1860a643731
I20260709 12:21:22.108251  8156 tablet_copy_source_session.cc:215] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:22.111403  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a3a306870b4fb1b1c3a1860a643731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.128926  9274 tablet_copy_client.cc:806] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:22.129597  9274 tablet_copy_client.cc:670] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:22.135707  9274 tablet_copy_client.cc:538] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:22.147310  9274 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:22.167764  9274 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:22.168685  9274 tablet_bootstrap.cc:492] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:22.169351  9274 ts_tablet_manager.cc:1403] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 12:21:22.172300  9274 raft_consensus.cc:359] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:22.173137  9274 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:22.173789  9274 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:22.179396  9274 ts_tablet_manager.cc:1434] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:22.181524  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-72a3a306870b4fb1b1c3a1860a643731 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:22.181573  8765 raft_consensus.cc:1217] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:22.181903  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-72a3a306870b4fb1b1c3a1860a643731 on tablet 72a3a306870b4fb1b1c3a1860a643731 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:22.300071  8761 raft_consensus.cc:1217] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:22.360054  8761 raft_consensus.cc:1217] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:22.385398  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:22.435308  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273de299acf94214b44aab4591da9b3a"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:22.435986  8145 raft_consensus.cc:606] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:22.438650  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:22.439268  8145 raft_consensus.cc:606] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:22.441741  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:22.442237  8145 raft_consensus.cc:606] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:22.444512  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:22.444984  8145 raft_consensus.cc:606] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:22.447124  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:22.447566  8145 raft_consensus.cc:606] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:22.448665  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:22.450296  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:22.450867  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:22.475422  9242 raft_consensus.cc:993] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:22.475931  9242 raft_consensus.cc:1081] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:22.482146  8065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:22.485558  8065 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.486269  8065 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.494786  8065 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.498497  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:22.499099  8220 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.502764  8065 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:22.504045  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:22.504751  8145 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:22.505144  8145 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:22.505455  8220 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:22.506109  8145 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.506811  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:22.507500  8145 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.507956  9275 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:22.508555  9275 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:22.509550  9275 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.518157  8145 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:22.539523  7964 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:22.566695  7998 debug-util.cc:398] Leaking SignalData structure 0x7b0800034a20 after lost signal to thread 6877
W20260709 12:21:22.567796  7998 debug-util.cc:398] Leaking SignalData structure 0x7b0800035100 after lost signal to thread 8001
W20260709 12:21:22.569064  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd420 after lost signal to thread 8094
W20260709 12:21:22.570153  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08002c72e0 after lost signal to thread 8170
W20260709 12:21:22.571218  7998 debug-util.cc:398] Leaking SignalData structure 0x7b0800341de0 after lost signal to thread 8244
W20260709 12:21:22.572271  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080033a020 after lost signal to thread 8790
I20260709 12:21:22.608908  9242 raft_consensus.cc:1064] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:22.618031  9242 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:22.681022  8765 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:22.684753  8062 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:22.690461  8213 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:22.701006  9242 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:22.701709  9043 raft_consensus.cc:993] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:22.702265  9240 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:22.705687  9043 raft_consensus.cc:1081] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:22.715953  9235 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:22.725453  9298 raft_consensus.cc:993] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:22.726065  9298 raft_consensus.cc:1081] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:22.738051  8220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:21:22.738737  8220 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.739157  8220 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.745860  8065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "273de299acf94214b44aab4591da9b3a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:22.746634  8065 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.747895  8065 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.758262  9242 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:22.760041  8220 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.763206  8062 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:22.765280  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:22.765990  8145 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:22.766348  8145 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:22.767233  8145 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.768316  8145 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.772420  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:22.773061  8220 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:22.773142  8066 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.783161  8066 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:22.785524  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:22.786357  9296 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:22.786906  9296 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:22.787848  9296 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.792907  8145 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:22.813676  8065 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.833377  8216 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:22.835458  8065 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:22.836467  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:22.837110  8217 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.825197  7964 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:22.866483  8217 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:22.869068  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:22.865223  9298 raft_consensus.cc:993] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:22.870335  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:22.871053  8145 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:22.871436  8145 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:22.875197  8145 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.880278  8145 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.887599  8145 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:22.878562  9275 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:22.883541  9298 raft_consensus.cc:1081] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:22.897380  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:21:22.900839  8212 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.901430  8212 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:22.900686  8761 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:22.897745  9275 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:22.907284  7964 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.915983  8212 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.935488  9043 raft_consensus.cc:993] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:22.936101  9043 raft_consensus.cc:1081] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:22.936692  9200 raft_consensus.cc:1064] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:22.961602  8212 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:22.965304  9200 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:22.983001  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:22.986622  8763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
W20260709 12:21:22.987712  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118724us
I20260709 12:21:23.011384  8763 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:23.100811  8763 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.011439  8062 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.044514  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:23.104429  8143 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:23.104883  8143 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:23.105805  8143 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:23.107133  8143 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.037923  9275 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:22.987447  8145 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:23.117578  8062 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:21:23.130722  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65747.3us
I20260709 12:21:23.134701  8763 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:23.148824  8762 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:23.151938  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:23.155418  8765 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.157099  8763 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:23.158442  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:23.161550  8216 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.159227  8143 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:23.161778  8145 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:23.162616  8145 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:23.171952  8145 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:23.173147  8145 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:23.180663  8216 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:23.182304  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:23.183199  9305 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:23.189154  9305 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:23.192682  8062 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:23.190379  9305 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:23.208123  8145 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
W20260709 12:21:23.210331  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 94368.7us
I20260709 12:21:23.220835  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:23.221619  9190 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:23.222062  9190 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:23.226099  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 285634us
I20260709 12:21:23.232096  8143 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.169584  9303 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:21:23.244832  9304 raft_consensus.cc:1064] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:23.246397  9240 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:23.258864  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 113406us
I20260709 12:21:23.262046  9190 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:23.247712  9304 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:23.270087  9314 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:23.273842  7964 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:23.275745  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52663.9us
W20260709 12:21:23.277055  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 66687.9us
I20260709 12:21:23.293953  8062 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.301234  8220 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.306442  9324 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:21:23.309456  7967 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.312999  8212 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.328305  8062 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:23.326956  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126140us
I20260709 12:21:23.337716  9200 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:23.352010  8142 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:23.352573  9303 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:23.388716  8761 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.390678  8145 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.392802  9190 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:23.394870  9190 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:23.375077  9200 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:23.405117  9321 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:21:23.410224  9266 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:21:23.432250  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 86767.4us
I20260709 12:21:23.443216  9221 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:23.459880  8062 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:23.462255  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72a3a306870b4fb1b1c3a1860a643731 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:21:23.466190  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 90659.1us
I20260709 12:21:23.477176  8763 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:23.481617  9190 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:23.500942  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.573657  8070 raft_consensus.cc:2955] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:23.614406  7967 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:23.715384  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 203125us
I20260709 12:21:23.747983  8216 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:23.856510  9216 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:21:23.679749  9298 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:23.914314  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 202196us
W20260709 12:21:23.966405  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 87195.8us
I20260709 12:21:24.010499  8140 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:24.086360  7964 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:24.087924  9313 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:21:24.145632  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 370579us
W20260709 12:21:24.147297  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 432305us
I20260709 12:21:24.216665  8218 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:24.224121  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 72a3a306870b4fb1b1c3a1860a643731 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49226
I20260709 12:21:24.230791  8069 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:24.311890  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 48085.8us
I20260709 12:21:24.326933  8214 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:24.348372  9346 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:21:24.369616  8145 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:24.373354  9216 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:24.449991  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 61906.2us
I20260709 12:21:24.347214  8760 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:24.594975  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53886.6us
I20260709 12:21:24.597044  9313 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:24.596215  8062 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:24.601028  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 80174.1us
W20260709 12:21:24.655021  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 385962us
I20260709 12:21:24.686959  9333 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:24.715520  8139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.015s	sys 0.029s
W20260709 12:21:24.716133  8139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.015s	sys 0.030s
I20260709 12:21:24.715785  8138 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:24.734856  9347 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:24.735877  9347 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:24.765600  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 452197us
I20260709 12:21:24.773046  9318 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:24.775938  8220 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.017s	sys 0.035s
W20260709 12:21:24.785058  8220 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.017s	sys 0.036s
W20260709 12:21:24.784811  9304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.033s
I20260709 12:21:24.773845  9318 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:24.790901  9357 tablet_replica.cc:333] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
W20260709 12:21:24.798400  9304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.034s
W20260709 12:21:24.860308  9346 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:21:24.868402  9318 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:24.872301  9347 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.012050  9043 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.012714  9043 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.014295  9043 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:25.014390  8141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.010s	sys 0.005s
W20260709 12:21:25.014796  8141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.010s	sys 0.005s
W20260709 12:21:25.092065  8760 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
W20260709 12:21:25.100077  8017 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.016s	sys 0.023s
W20260709 12:21:25.100657  8017 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.017s	sys 0.023s
I20260709 12:21:25.106215  9221 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.106933  9221 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:25.108245  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.007s	sys 0.013s
I20260709 12:21:25.109877  9221 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.111397  8070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:25.112046  8070 raft_consensus.cc:606] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:21:25.106217  8145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.053s
W20260709 12:21:25.113576  8145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.001s	sys 0.054s
W20260709 12:21:25.108589  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.009s	sys 0.013s
I20260709 12:21:24.732889  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 699) took 1094 ms. Trace:
I20260709 12:21:25.128686  8062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:25.129525  8062 raft_consensus.cc:606] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:25.127725  8139 rpcz_store.cc:276] 0709 12:21:23.635957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.645667 (+  9710us) service_pool.cc:224] Handling call
0709 12:21:23.655804 (+ 10137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.656022 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:23.999919 (+343897us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.716599 (+716680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:24.720258 (+  3659us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:24.722165 (+  1907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.724018 (+  1853us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.727939 (+  3921us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1527,"prepare.queue_time_us":465029,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":16863,"raft.queue_time_us":28390,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1715,"thread_start_us":1056414,"threads_started":2}
I20260709 12:21:25.134138  9309 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.134730  9309 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.137972  9309 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:25.139945  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.148510  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:25.152168  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 385316us
W20260709 12:21:25.154119  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.021s	sys 0.025s
W20260709 12:21:25.154536  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.021s	sys 0.025s
I20260709 12:21:25.168660  9311 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:25.169324  9311 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.171351  9311 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.178349  9374 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.178962  9374 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.192597  9345 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.192974  9235 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.193244  9345 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.193522  9235 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.195390  9345 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.195422  9235 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.227046  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.227253  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:25.227960  8765 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:25.229295  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.232620  9305 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.235869  9305 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.242498  9305 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.243137  9305 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.243877  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:25.234335  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56200.7us
I20260709 12:21:25.243711  9305 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.247663  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.249682  9221 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.250510  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.255270  9305 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.232836  9374 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:25.258484  9374 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.259104  9374 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.262718  8142 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:25.268886  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.253749  9221 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:25.273298  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52940.9us
I20260709 12:21:25.273509  9374 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:25.275112  9221 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.276882  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.284117  9367 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.285748  9347 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.324129  9347 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.326684  9347 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.327286  9347 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.327864  9347 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.288705  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 740) took 1823 ms. Trace:
I20260709 12:21:25.330464  8220 rpcz_store.cc:276] 0709 12:21:23.464926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.467316 (+  2390us) service_pool.cc:224] Handling call
0709 12:21:23.467606 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.480795 (+ 13189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.480822 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.508061 (+ 27239us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.982474 (+474413us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:24.786764 (+804290us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.288263 (+501499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.288353 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.288399 (+    46us) raft_consensus.cc:1685] finished
0709 12:21:25.288412 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.288594 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":503606,"prepare.queue_time_us":610286,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":544481,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8516,"thread_start_us":1213242,"threads_started":3,"wal-append.queue_time_us":603422}
I20260709 12:21:25.290807  9330 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.332682  9330 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.335006  9305 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.335716  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.336328  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:25.272033  9380 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.337076  9380 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:25.287096  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 115667us
I20260709 12:21:25.300406  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.292985  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.337786  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:25.343916  9330 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.344487  9330 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:25.344911  9330 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.344807  9296 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.323170  9367 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.347654  9347 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.353123  9367 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:25.354796  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.354029  8068 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:25.356340  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.356961  8220 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:25.359419  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.362356  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.335523  9305 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.373911  9380 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.373939  9305 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.374215  7964 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:25.379168  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 72716.8us
I20260709 12:21:25.380757  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:25.382077  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.383230  9242 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:25.383652  9242 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:25.384037  9242 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:25.389065  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 115099us
I20260709 12:21:25.389905  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:25.345541  9330 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.390692  8142 raft_consensus.cc:606] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.389309  9378 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.396956  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:25.411672  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 141063us
I20260709 12:21:25.413421  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.415059  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.419401  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.421582  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.394702  9305 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.426409  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.393635  9378 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.429591  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2102) took 1205 ms. Trace:
I20260709 12:21:25.432952  8214 rpcz_store.cc:276] 0709 12:21:24.224540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.231887 (+  7347us) service_pool.cc:224] Handling call
0709 12:21:24.232227 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.232455 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:24.379198 (+146743us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.429145 (+1049947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:25.429216 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:25.429277 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.429375 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.429520 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167702,"raft.queue_time_us":183908,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":93,"thread_start_us":879806,"threads_started":2,"wal-append.queue_time_us":490709}
I20260709 12:21:25.430687  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.442322  9384 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.444339  8186 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.445554  9364 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.452108  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.453449  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.454276  9357 raft_consensus.cc:2243] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:25.455053  9357 raft_consensus.cc:2272] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:25.455245  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.456837  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.457175  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.462280  9357 ts_tablet_manager.cc:1916] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:25.467414  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.467348  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.465385  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.473557  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.430025  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.476954  9320 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:25.479408  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:25.431874  9305 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:25.477018  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55338.3us
I20260709 12:21:25.486122  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.487627  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.489775  9314 raft_consensus.cc:993] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:25.490350  9314 raft_consensus.cc:1081] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:25.491089  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.490211  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.494566  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.495795  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.496960  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c14c286147e549768b521ff92a61fec9"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:25.477591  9320 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.499933  9345 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.472817  8765 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:25.496793  9380 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.502810  8142 raft_consensus.cc:606] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.503414  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.499841  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.505234  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.516402  9383 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.517122  9382 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.473064  9235 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:25.523150  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.523977  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.525192  9347 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.530010  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:25.529011  9332 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:25.538031  8214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:21:25.538663  8214 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.539044  8214 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.528852  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:25.539547  9354 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.554418  8214 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.541841  9305 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.561213  8216 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:25.563699  9242 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.546558  9380 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.566316  8214 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.567317  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:25.569585  8145 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.575868  9377 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:25.576872  9311 raft_consensus.cc:993] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
W20260709 12:21:25.578912  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73994.1us
I20260709 12:21:25.579885  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.572108  9378 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.589720  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.589999  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:25.573063  9314 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:21:25.594641  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.596716  9242 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.597687  9242 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:25.576464  9377 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.600762  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:25.607121  9395 raft_consensus.cc:1081] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:25.612146  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:25.613524  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92513us
I20260709 12:21:25.615141  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.616364  9380 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.616573  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.619295  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:25.619410  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.629184  9296 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.620829  9314 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.635730  9377 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.631974  9313 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.672727  9215 raft_consensus.cc:993] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:25.673533  9215 raft_consensus.cc:1081] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:25.684415  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:25.685179  8069 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:25.685550  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.685827  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:25.686051  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:25.685562  8069 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:25.693295  9296 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:25.693832  9296 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:25.693975  8146 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:25.699615  8216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:21:25.700228  8216 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.700670  8216 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.694082  8069 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.714334  8069 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.714646  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.726467  9296 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.696177  9380 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.727747  9380 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:25.732548  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:25.658684  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:25.742077  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.746500  8216 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.749554  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.750283  8211 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:25.750741  9330 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.716805  9320 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:25.753204  8066 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:25.741109  9367 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.761627  8216 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.759858  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:25.737071  9380 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.766001  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:25.766716  8142 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.763970  9190 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.768843  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:25.760991  9378 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.763689  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:25.764083  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 110260us
I20260709 12:21:25.767647  9305 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:25.760823  9367 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.894130  9308 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.853046  9330 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.892349  9305 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.920432  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.923230  8142 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:25.929390  8065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:25.940584  8065 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.941040  8065 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.933764  9386 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.916299  9317 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.947274  9367 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:25.924942  9305 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.929163  9393 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:25.926009  9320 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.925946  9383 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.953688  8212 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:25.929580  9402 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.960186  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:25.957711  9320 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.943351  9364 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.928473  9308 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.947795  9317 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.957063  9380 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:25.962888  9306 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:21:25.976558  9308 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.978092  9353 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:25.960618  9402 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.995093  8065 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:25.979682  9306 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:25.960132  9383 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.004081  8065 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.006235  9383 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.010761  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:26.011472  8212 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.978910  9353 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.012980  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:25.981412  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:26.014454  9353 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:26.014464  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45307.4us
I20260709 12:21:26.014971  9383 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.017692  9402 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:25.942545  9386 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.023869  8212 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:26.025499  8035 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:25.982550  9380 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.002643  9306 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:26.031653  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.035405  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:26.027714  9405 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:21:26.036890  9386 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:26.038455  9357 ts_tablet_manager.cc:1929] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:26.050980  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:25.967926  9364 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.048949  9316 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:26.066138  9316 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:26.052944  9393 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:26.056034  9317 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:26.060961  8212 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.061069  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:26.052394  9380 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.048452  9377 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:26.079448  9377 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.081729  9377 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:26.058499  9364 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:26.064224  9320 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:26.050472  9357 log.cc:1199] T 72a3a306870b4fb1b1c3a1860a643731 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/72a3a306870b4fb1b1c3a1860a643731
I20260709 12:21:26.068558  9353 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:26.067618  8069 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:26.094661  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.094936  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.078054  9393 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.095513  8212 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:26.098052  9357 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49226 (request call id 75) took 1882 ms. Trace:
I20260709 12:21:26.098230  9330 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:26.038693  9306 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:26.097106  9332 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:21:26.067427  9316 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.101861  9330 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.104429  9306 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.105181  9392 raft_consensus.cc:993] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:26.112246  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:26.092672  9320 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:26.108407  9393 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.117012  9330 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:26.100960  9357 rpcz_store.cc:276] 0709 12:21:24.218595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.221918 (+  3323us) service_pool.cc:224] Handling call
0709 12:21:24.775928 (+554010us) ts_tablet_manager.cc:1151] Deleting tablet 72a3a306870b4fb1b1c3a1860a643731
0709 12:21:24.776468 (+   540us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:25.751998 (+975530us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:26.038310 (+286312us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:26.097976 (+ 59666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":591270,"tablet-delete.queue_time_us":540730,"thread_start_us":402417,"threads_started":1}
I20260709 12:21:26.120231  8146 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:26.118799  9235 raft_consensus.cc:1081] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:26.122484  9305 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.123996  8757 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.124845  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.127123  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.127219  9305 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.127789  8214 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:26.128307  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:26.128834  8220 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.133303  9309 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:26.133858  9309 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.141458  9309 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:26.143814  8069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c14c286147e549768b521ff92a61fec9"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:26.144515  8069 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.144919  8069 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.130695  9393 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:26.146139  9393 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.159766  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:26.161262  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.170521  9308 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:26.172181  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.171944  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:26.172850  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:26.175755  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.185272  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:26.185441  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.190277  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.191310  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:26.192234  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.184842  9393 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.177178  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:26.178592  8220 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:26.198709  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:26.199520  9305 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:26.200083  9305 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:26.201141  9305 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.202001  9339 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:26.202462  9339 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:26.204105  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.204711  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:26.205515  8761 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:26.205353  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:26.215829  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.189565  9318 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:26.187958  9330 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:26.224588  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2520 after lost signal to thread 6877
W20260709 12:21:26.232064  8787 debug-util.cc:398] Leaking SignalData structure 0x7b080022e9a0 after lost signal to thread 8001
I20260709 12:21:26.233215  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:26.233594  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08003800c0 after lost signal to thread 8094
W20260709 12:21:26.234848  8787 debug-util.cc:398] Leaking SignalData structure 0x7b0800380900 after lost signal to thread 8170
W20260709 12:21:26.236145  8787 debug-util.cc:398] Leaking SignalData structure 0x7b0800285f60 after lost signal to thread 8244
I20260709 12:21:26.241832  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:26.222759  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48005.2us
I20260709 12:21:26.229810  9360 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:26.244140  9320 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.244735  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.210450  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.221560  8140 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.243363  9318 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:26.259105  8212 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.261178  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.241019  9235 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:26.260185  9398 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:21:26.252734  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.122391  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 72a3a306870b4fb1b1c3a1860a643731 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
W20260709 12:21:26.273744  7953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 151369us
I20260709 12:21:26.277671  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.253304  8140 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:26.256611  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:26.264434  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08002b52c0 after lost signal to thread 8790
I20260709 12:21:26.295128  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.300961  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.351312  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:26.352105  8765 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:26.353477  8034 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:26.324832  9313 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:26.361366  9313 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:26.362533  9313 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.367372  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:26.368065  8218 raft_consensus.cc:606] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:26.368338  9313 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.370070  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:26.372738  9221 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:26.373189  9221 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:26.373593  9221 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.376824  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.377856  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.378331  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.379737  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:26.380306  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.382639  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.386416  8759 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.388147  9305 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.390450  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:26.365927  9318 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.394311  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:26.395283  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.395924  7966 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.383423  8140 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.463246  7967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 246) took 1159 ms. Trace:
I20260709 12:21:26.464099  8140 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.303997  9339 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.463677  7967 rpcz_store.cc:276] 0709 12:21:25.303826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.304103 (+   277us) service_pool.cc:224] Handling call
0709 12:21:26.463151 (+1159048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75142,"reported_tablets":5}
W20260709 12:21:26.472810  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 75487.7us
I20260709 12:21:26.477800  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:26.461647  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.380970  9412 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:21:26.462304  9360 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.515645  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.496845  9310 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:26.522905  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.529872  8068 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.506699  9360 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:26.518044  9339 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.526355  9215 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.534698  9330 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.524168  9411 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:21:26.586941  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64093.3us
I20260709 12:21:26.589529  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:26.590951  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 112145us
I20260709 12:21:26.592540  9411 consensus_queue.cc:1243] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:26.597237  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:26.602382  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68889.6us
I20260709 12:21:26.607515  9221 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.609138  9421 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.609949  9421 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.619361  8069 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.621794  8069 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:26.622964  8062 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.625247  8140 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
W20260709 12:21:26.625818  9043 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:21:26.632752  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:26.633741  8140 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.634203  8140 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:26.634666  9360 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.635841  9360 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.635610  8140 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.642877  8066 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:26.656939  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.642031  8140 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.671800  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:26.672366  8220 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.676872  8220 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:26.685066  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.667382  9364 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:26.686852  8140 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:26.697065  8143 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.701274  8214 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:26.702878  9347 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.705089  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.706204  9364 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.704473  9380 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:21:26.709463  9221 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:26.711580  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.712513  9380 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.712549  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.719069  9318 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.719224  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.722553  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.722929  9339 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.723613  9318 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.724146  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:26.725179  9318 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.765027  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:26.778091  8067 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.780596  8143 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:21:26.790693  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66449.6us
I20260709 12:21:26.809688  9221 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:26.811133  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:26.813148  9305 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:26.816968  9339 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.817703  8214 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.821667  7966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 239) took 1307 ms. Trace:
I20260709 12:21:26.825564  7967 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.832957  9221 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:26.834448  8214 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:26.837436  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:26.839574  8759 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:26.839710  9354 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:26.857017  8138 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.877508  9235 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:26.844723  9221 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:26.850165  8144 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.852926  7965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 230) took 1461 ms. Trace:
I20260709 12:21:26.924002  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:26.924678  7965 rpcz_store.cc:276] 0709 12:21:25.392375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.392742 (+   367us) service_pool.cc:224] Handling call
0709 12:21:26.840568 (+1447826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24236,"reported_tablets":2}
I20260709 12:21:26.934868  9339 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.935446  9349 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.840971  7966 rpcz_store.cc:276] 0709 12:21:25.514153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.516084 (+  1931us) service_pool.cc:224] Handling call
0709 12:21:26.821371 (+1305287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:26.539020 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:26.614056 (+ 75036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:26.614098 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:21:26.614116 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:26.614495 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:26.614559 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:26.614587 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:26.614771 (+   184us) tablet.cc:701] Row locks acquired
0709 12:21:26.614785 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:21:26.614942 (+   157us) write_op.cc:270] Start()
0709 12:21:26.615071 (+   129us) write_op.cc:276] Timestamp: P: 1783599686614897 usec, L: 0
0709 12:21:26.615092 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:26.615770 (+   678us) log.cc:844] Serialized 599 byte log entry
0709 12:21:26.721902 (+106132us) op_driver.cc:464] REPLICATION: finished
0709 12:21:26.730855 (+  8953us) write_op.cc:301] APPLY: starting
0709 12:21:26.730946 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:26.731081 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:26.731225 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:26.731489 (+   264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:26.731631 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:26.731685 (+    54us) write_op.cc:312] APPLY: finished
0709 12:21:26.731931 (+   246us) log.cc:844] Serialized 23 byte log entry
0709 12:21:26.732083 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.732172 (+    89us) write_op.cc:454] Released schema lock
0709 12:21:26.732214 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:26.732457 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.732511 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67548,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":8716,"apply.run_cpu_time_us":1624,"apply.run_wall_time_us":1625,"num_ops":1,"prepare.queue_time_us":54021,"prepare.run_cpu_time_us":3224,"prepare.run_wall_time_us":93878,"replication_time_us":106634,"thread_start_us":44580,"threads_started":2}]]}
I20260709 12:21:26.970836  8215 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:27.013679  8062 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:27.055651  9360 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:21:27.067530  8036 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:27.069695  9221 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:21:27.070700  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63165us
I20260709 12:21:27.103223  8764 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:27.205892  8064 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:27.205617  9304 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:21:27.212996  9438 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:21:27.179935  9422 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 12:21:27.216454  9441 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:21:27.234153  9423 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:27.275355  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78335.8us
I20260709 12:21:27.278407  8756 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.298103  7964 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:21:27.301000  7964 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:21:27.300104  9339 raft_consensus.cc:993] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:27.317262  9339 raft_consensus.cc:1081] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:27.353060  8140 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:27.369586  9354 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:27.407471  8215 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:27.411113  9314 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:27.448712  8138 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:27.460845  9318 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
W20260709 12:21:27.469894  9443 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:27.462038  8764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:21:27.478021  8764 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:27.478749  8764 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:27.495999  9364 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:21:27.519347  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0c7fc19421924a9a9d7c350bf097e173 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:27.550994  9339 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.561029  9339 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.563217  9339 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:27.571187  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:27.572070  8066 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:27.572224  8764 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:27.600445  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:27.608692  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:27.612931  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:27.613222  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:27.613584  8218 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:27.613958  8066 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:27.613957  8218 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:27.615350  8218 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:27.616362  8218 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:27.627790  8764 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:27.641950  8066 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:27.643771  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.653707  8214 raft_consensus.cc:2955] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.666368  8069 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:27.675920  9445 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:27.675794  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:27.677404  9347 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:27.677953  9347 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:27.678885  9347 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:27.676453  9445 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.696960  9445 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:27.698495  9339 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.714226  8761 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.727778  9304 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:27.728497  9304 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.730531  9304 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:27.737372  8218 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:27.750520  9445 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.753340  9449 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:27.754297  8064 raft_consensus.cc:2955] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.761410  9445 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:27.768329  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:27.768869  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:27.769761  8139 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:27.754309  9449 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.769033  8069 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:27.766971  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:27.773744  8067 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:27.775178  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:27.772833  9449 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:27.790788  8069 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:27.794436  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:27.797945  8137 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:21:27.795027  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 157259us
I20260709 12:21:27.805430  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:27.825907  8218 raft_consensus.cc:2368] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:27.823532  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab203f6136b5456cacf2c4f8c664004b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:27.824990  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:27.830772  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:27.831862  9340 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:27.839975  9340 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:27.843297  7966 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.830756  9339 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:27.846854  9339 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:27.847498  9339 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:27.833806  8110 leader_election.cc:400] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:27.855861  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c7fc19421924a9a9d7c350bf097e173 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33994
I20260709 12:21:27.857934  8110 leader_election.cc:403] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:27.857000  8137 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:27.861945  9401 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:27.863508  9340 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.890192  9339 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.901120  7967 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.903210  7967 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 3 to 4, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 1 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:27.906140  7965 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.919073  9339 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:27.920786  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:27.922079  8137 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:27.890228  9463 tablet_replica.cc:333] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:21:27.895044  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:27.937911  8069 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:27.939482  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:27.940768  9339 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:27.941329  9339 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:27.942456  9339 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:27.944164  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet ab203f6136b5456cacf2c4f8c664004b with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51460
I20260709 12:21:27.948175  9465 tablet_replica.cc:333] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:21:27.964715  9465 raft_consensus.cc:2243] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:27.970700  9465 raft_consensus.cc:2272] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:27.974472  9465 ts_tablet_manager.cc:1916] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:27.997778  9463 raft_consensus.cc:2243] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:27.999123  9463 raft_consensus.cc:2272] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:28.021612  9463 ts_tablet_manager.cc:1916] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:28.029332  9401 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.029950  9401 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:28.032226  9401 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:28.035006  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:28.050850  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:28.052772  8069 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:28.057313  9463 ts_tablet_manager.cc:1929] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:28.090659  9465 ts_tablet_manager.cc:1929] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:28.099277  9465 log.cc:1199] T ab203f6136b5456cacf2c4f8c664004b P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/ab203f6136b5456cacf2c4f8c664004b
I20260709 12:21:28.082046  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:28.092888  9463 log.cc:1199] T 0c7fc19421924a9a9d7c350bf097e173 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/0c7fc19421924a9a9d7c350bf097e173
I20260709 12:21:28.103204  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 0c7fc19421924a9a9d7c350bf097e173 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:28.104852  9401 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:28.105415  9401 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.105736  9401 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:28.104853  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet ab203f6136b5456cacf2c4f8c664004b (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:21:28.115747  7965 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:28.121838  9401 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:28.129838  7965 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:28.132205  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:28.132864  8067 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:28.137876  9401 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:28.141970  8067 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:28.147943  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:28.149017  9411 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:28.149513  9411 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:28.150374  9411 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:28.151345  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:28.177142  7965 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.212064  8217 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:28.213974  9383 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:28.260296  8069 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:28.262300  9383 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:28.354849  8143 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:28.359535  9445 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:28.388410  8064 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:28.390074  8139 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:28.389958  9445 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:28.394294  9422 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:28.395089  9422 consensus_queue.cc:1243] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:21:28.395735  9422 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:28.396246  9422 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:28.397455  9422 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:28.399312  9422 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:28.415126  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 97269.6us
I20260709 12:21:28.633462  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.634776  8067 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:28.656002  8218 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:21:28.657843  8218 pending_rounds.cc:85] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
I20260709 12:21:28.658222  8218 pending_rounds.cc:107] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:21:28.658617  8218 raft_consensus.cc:2889] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:28.671177  9401 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:28.763695  9235 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:28.834175  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:28.834913  8214 raft_consensus.cc:606] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:28.848860  8143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:28.849486  8143 raft_consensus.cc:606] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:28.852538  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:28.853148  8214 raft_consensus.cc:606] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:28.856056  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:28.856673  8214 raft_consensus.cc:606] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:28.861611  8069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:28.862255  8069 raft_consensus.cc:606] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:28.865744  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:28.867936  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:28.869050  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.086954  8064 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:29.137189  8034 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa46cdee469046e0a85f4a03d2e03f92. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.148744  8214 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:29.151218  9340 raft_consensus.cc:993] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:29.151463  9215 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:21:29.151835  9340 raft_consensus.cc:1081] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:29.171739  8760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:21:29.172421  8760 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.172874  8760 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.207122  8760 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.210448  8143 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:29.232201  9314 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.235664  9354 raft_consensus.cc:993] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:29.264834  9479 raft_consensus.cc:993] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:29.265396  9401 raft_consensus.cc:1081] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:29.270270  8067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:29.271000  8067 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.271515  8067 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.297744  8760 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:29.305757  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:29.306624  8218 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.307041  8218 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:29.315327  9487 raft_consensus.cc:1081] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:29.316565  9487 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:29.309825  8218 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.324790  9340 raft_consensus.cc:993] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:29.329361  9340 raft_consensus.cc:1081] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:29.290719  8214 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:29.321808  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63392.2us
I20260709 12:21:29.329392  8218 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.340200  8067 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.351596  8064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:34012
I20260709 12:21:29.352278  8064 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.352699  8064 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.338253  7965 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.364236  9340 raft_consensus.cc:993] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:29.364943  9340 raft_consensus.cc:1081] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:29.365434  8217 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:29.372013  8760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:21:29.372882  8760 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.373437  8760 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.377710  8067 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:29.350833  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68725.3us
I20260709 12:21:29.380226  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:21:29.380874  8215 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.381253  8215 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.390429  8215 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.393826  8215 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:29.394135  8139 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.397040  9445 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:29.403439  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:29.404107  8069 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.404259  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:29.404556  8069 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:29.404965  8765 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.405481  8069 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.406801  8069 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.413700  8064 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:29.416221  8064 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:29.350834  8218 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:29.417953  9364 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.426442  8067 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:29.431753  8069 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:29.420606  8138 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:21:29.424464  8184 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7490a68a6eb4ff18f8111dadec3d794. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.435007  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:29.443552  8760 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.438169  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:29.442252  8765 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:29.476569  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:29.477229  8138 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.477695  9460 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.478224  9460 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:29.479074  9460 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.484057  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:29.484797  8757 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.485415  8760 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:29.444034  9445 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.489004  9445 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:29.489219  8138 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:29.490111  9445 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.490691  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:29.493062  9383 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.493635  9383 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:29.494872  9383 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.436885  9340 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:29.445757  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91627.8us
I20260709 12:21:29.447256  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:29.450551  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:29.500871  8218 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.501187  8218 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:29.451257  8143 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.501264  8062 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.506865  8069 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.509058  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:29.509869  8139 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.512854  8218 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:29.514189  8218 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.529310  8218 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:29.530506  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:29.530053  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:29.531383  8214 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.531810  8214 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:29.533452  8214 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.538336  7964 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 4, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.539381  9483 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.541548  9483 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:29.548132  8062 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:29.551246  9483 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:29.557399  8214 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.555105  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:29.559531  8138 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.559967  8138 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:29.579259  8214 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
W20260709 12:21:29.558359  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67767us
I20260709 12:21:29.589593  8218 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:29.561837  8757 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:29.602717  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:29.602881  7966 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.560879  8138 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.613287  9314 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.614161  9314 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:29.615581  9314 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:29.653101  8138 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.665791  8139 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
W20260709 12:21:29.695708  8184 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e200bb1befd04bcf9b902618b83b1f88. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.702216  8069 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:29.704512  9445 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:29.708531  8139 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:29.711244  9364 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:29.713304  8138 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:29.771395  9445 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.773440  8139 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.777170  9503 ts_tablet_manager.cc:933] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:29.786408  7964 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.788723  9503 tablet_copy_client.cc:323] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:21:29.793066  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet aa46cdee469046e0a85f4a03d2e03f92 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:21:29.793675  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet aa46cdee469046e0a85f4a03d2e03f92 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-aa46cdee469046e0a85f4a03d2e03f92
I20260709 12:21:29.803524  8080 tablet_copy_source_session.cc:215] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:29.799635  8138 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:29.814718  9503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa46cdee469046e0a85f4a03d2e03f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:29.816331  7966 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.819550  8062 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.824110  7967 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.825836  7967 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.853302  7966 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 3, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.861653  9503 tablet_copy_client.cc:806] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:29.862496  9503 tablet_copy_client.cc:670] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:29.872241  9503 tablet_copy_client.cc:538] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:29.876003  8218 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:29.879284  9401 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:29.886413  8069 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:29.897668  9503 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
W20260709 12:21:29.897845  8109 consensus_peers.cc:597] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 767edb8a304f440591a33aae36a36252. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.901381  9449 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:29.907275  9401 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.908493  8218 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.914525  8062 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:29.916038  9383 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.932380  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.933652  7964 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 1 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:29.947439  8138 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:29.949234  9491 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.954557  8218 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:29.961647  9383 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:29.971002  8139 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.971446  8764 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:29.972564  9483 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:29.973941  9445 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:30.009758  8066 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:30.011770  8214 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:30.012261  9340 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:30.013217  9484 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:30.043401  8215 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:30.045253  9491 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:30.051666  8764 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:30.054692  9483 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:30.108760  8139 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:30.110240  9486 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:30.121942  9509 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:21:30.126719  8069 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:21:30.146059  8138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:30.155848  8138 raft_consensus.cc:606] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:30.161654  8069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:30.163892  8069 raft_consensus.cc:606] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:30.174834  9514 ts_tablet_manager.cc:933] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:30.186486  9503 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:21:30.188310  9503 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:30.196671  9514 tablet_copy_client.cc:323] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:30.206391  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet f7490a68a6eb4ff18f8111dadec3d794 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:30.206683  9503 tablet_bootstrap.cc:492] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:30.206992  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet f7490a68a6eb4ff18f8111dadec3d794 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-f7490a68a6eb4ff18f8111dadec3d794
I20260709 12:21:30.207543  9503 ts_tablet_manager.cc:1403] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.310s	user 0.020s	sys 0.013s
I20260709 12:21:30.209092  8138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:30.209724  8138 raft_consensus.cc:606] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:30.211197  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:30.212896  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:30.221063  8230 tablet_copy_source_session.cc:215] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:30.223757  9529 ts_tablet_manager.cc:933] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:30.224766  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.226464  9514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7490a68a6eb4ff18f8111dadec3d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.232959  9529 tablet_copy_client.cc:323] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:21:30.235244  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet e200bb1befd04bcf9b902618b83b1f88 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:21:30.235900  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet e200bb1befd04bcf9b902618b83b1f88 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-e200bb1befd04bcf9b902618b83b1f88
I20260709 12:21:30.238029  9503 raft_consensus.cc:359] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.238965  9503 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:30.239626  9503 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.260183  8760 raft_consensus.cc:1217] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:21:30.281418  9503 ts_tablet_manager.cc:1434] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 12:21:30.283463  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-aa46cdee469046e0a85f4a03d2e03f92 received from {username='slave'} at 127.0.0.1:34594
I20260709 12:21:30.283962  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-aa46cdee469046e0a85f4a03d2e03f92 on tablet aa46cdee469046e0a85f4a03d2e03f92 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:30.310633  8230 tablet_copy_source_session.cc:215] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:30.314415  9529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e200bb1befd04bcf9b902618b83b1f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.315266  9514 tablet_copy_client.cc:806] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:30.315882  9514 tablet_copy_client.cc:670] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:30.332752  9514 tablet_copy_client.cc:538] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:30.336404  9529 tablet_copy_client.cc:806] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:30.349251  9529 tablet_copy_client.cc:670] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:30.355170  9529 tablet_copy_client.cc:538] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:30.364280  9514 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:30.364550  9529 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:30.366182  9503 ts_tablet_manager.cc:933] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:30.428360  9529 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:30.429383  9529 tablet_bootstrap.cc:492] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:30.430119  9529 ts_tablet_manager.cc:1403] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.029s
I20260709 12:21:30.437589  9529 raft_consensus.cc:359] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.438593  9529 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:30.439424  9529 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.442432  9529 ts_tablet_manager.cc:1434] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:30.457669  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-e200bb1befd04bcf9b902618b83b1f88 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:30.458171  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-e200bb1befd04bcf9b902618b83b1f88 on tablet e200bb1befd04bcf9b902618b83b1f88 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:30.482892  9479 raft_consensus.cc:993] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:30.497741  9449 raft_consensus.cc:1081] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:21:30.499441  8757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:21:30.500036  8757 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:30.500387  8757 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.520463  9514 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:30.521389  9503 tablet_copy_client.cc:323] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:21:30.523098  8757 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.532680  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 767edb8a304f440591a33aae36a36252 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:21:30.533228  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 767edb8a304f440591a33aae36a36252 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-767edb8a304f440591a33aae36a36252
I20260709 12:21:30.537010  8757 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:30.536809  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:30.539963  8138 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:30.540318  8138 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:30.541086  8138 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.542143  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:30.544152  8214 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.543085  8156 tablet_copy_source_session.cc:215] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:30.530726  9514 tablet_bootstrap.cc:492] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:30.542155  8138 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.550719  9514 ts_tablet_manager.cc:1403] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.187s	user 0.028s	sys 0.005s
I20260709 12:21:30.552316  9503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767edb8a304f440591a33aae36a36252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:30.564301  9514 raft_consensus.cc:359] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.571012  9514 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:30.571872  9514 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:30.585228  8757 raft_consensus.cc:1217] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:21:30.604329  8214 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:30.606523  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:30.608371  9517 raft_consensus.cc:993] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:30.608954  9517 raft_consensus.cc:1081] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:21:30.593210  9514 ts_tablet_manager.cc:1434] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:21:30.617920  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-f7490a68a6eb4ff18f8111dadec3d794 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:21:30.618376  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-f7490a68a6eb4ff18f8111dadec3d794 on tablet f7490a68a6eb4ff18f8111dadec3d794 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:30.625000  9383 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:30.625638  9383 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:30.626626  9383 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.631011  8067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:21:30.631664  8067 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:30.632042  8067 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.633100  9503 tablet_copy_client.cc:806] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:30.633756  9503 tablet_copy_client.cc:670] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:30.635260  8138 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:30.647316  8067 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.654436  8067 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:30.655460  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:30.656368  8757 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.675840  9486 raft_consensus.cc:993] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:30.676556  9484 raft_consensus.cc:1081] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:30.678925  8218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:21:30.679603  8218 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:30.680050  8218 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.698975  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:30.699723  8141 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:30.700062  8141 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:30.699715  8757 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:30.701593  8141 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.703052  8141 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.701970  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:30.705880  9483 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:30.706423  9483 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:30.719259  9483 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.726924  9354 raft_consensus.cc:1064] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:30.730072  9354 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:30.731456  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:30.755851  9503 tablet_copy_client.cc:538] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:30.776851  9503 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:21:30.781543  8218 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:30.795439  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48539.7us
I20260709 12:21:30.819653  8218 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:30.764019  8141 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:30.820935  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:30.829324  8137 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.834601  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:30.835315  8067 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:30.835692  8067 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:30.836556  8067 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:30.837819  8067 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.839592  8137 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:30.850366  8757 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:21:30.864410  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:30.869822  9364 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:30.870523  9364 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:30.872407  9364 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:30.861090  9486 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:30.898079  8067 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:30.919031  7966 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.927038  7964 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:31.001360  9546 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:31.057475  8756 raft_consensus.cc:1217] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 12:21:31.053778  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44034.8us
I20260709 12:21:31.084182  8218 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:21:31.098465  9545 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:21:31.243263  8214 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:31.272040  8139 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:31.272897  8137 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:21:31.307376  8761 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:31.307509  9422 raft_consensus.cc:1064] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:31.314039  9383 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.318460  9422 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:31.319521  9503 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:31.320818  9503 tablet_bootstrap.cc:492] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:21:31.321594  9503 ts_tablet_manager.cc:1403] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.554s	user 0.033s	sys 0.008s
I20260709 12:21:31.326611  9536 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.357033  9503 raft_consensus.cc:359] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:31.358124  9503 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:21:31.358907  9503 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:31.376129  9503 ts_tablet_manager.cc:1434] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.001s
I20260709 12:21:31.379151  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-767edb8a304f440591a33aae36a36252 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:21:31.379639  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-767edb8a304f440591a33aae36a36252 on tablet 767edb8a304f440591a33aae36a36252 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:31.399504  8137 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:21:31.401623  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 160576us
I20260709 12:21:31.403307  9547 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.399510  8760 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:21:31.411195  9547 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:31.412345  9364 raft_consensus.cc:1064] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:31.414652  9364 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:31.431595  8760 raft_consensus.cc:1217] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:21:31.561813  9562 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:21:31.604285  9561 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 12:21:32.505764  8091 debug-util.cc:398] Leaking SignalData structure 0x7b080009d4a0 after lost signal to thread 6877
I20260709 12:21:32.564328  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 557) took 1142 ms. Trace:
I20260709 12:21:32.565081  8760 rpcz_store.cc:276] 0709 12:21:31.422326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.430492 (+  8166us) service_pool.cc:224] Handling call
0709 12:21:31.431417 (+   925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.434987 (+  3570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.563728 (+1128741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.563833 (+   105us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:32.563912 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.564018 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.564213 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1937,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10935}
I20260709 12:21:32.574724  9569 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.575328  9569 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.576776  9556 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.577378  9556 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.577965  9569 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.579706  9556 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.581300  9569 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.581900  9569 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.585091  9422 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.585896  9422 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.594919  9568 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.595525  9568 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.596972  9517 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.597560  9517 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.599875  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.600283  9517 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:32.600410  8756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.008s	sys 0.016s
I20260709 12:21:32.600587  8143 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:32.602828  9568 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.588519  9422 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:32.604115  9556 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:32.604820  9556 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.605245  9569 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.607685  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.608678  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.608983  8143 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:32.609373  8145 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:32.609896  9517 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.610550  9569 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.610812  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.611637  9422 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:32.611795  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.612167  9422 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.612690  9568 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:32.612804  9422 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:32.612525  9517 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.613330  9568 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.614064  9568 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:32.615157  9517 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.615778  9517 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.616044  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.607281  9556 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:32.616720  8756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.008s	sys 0.017s
I20260709 12:21:32.621598  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 352) took 1199 ms. Trace:
I20260709 12:21:32.621999  8756 rpcz_store.cc:276] 0709 12:21:31.421943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.422128 (+   185us) service_pool.cc:224] Handling call
0709 12:21:31.424419 (+  2291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.424895 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.424930 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.432692 (+  7762us) log.cc:844] Serialized 564 byte log entry
0709 12:21:32.621199 (+1188507us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.621249 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.621330 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.621382 (+    52us) raft_consensus.cc:1685] finished
0709 12:21:32.621401 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.621534 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1188076,"threads_started":1,"wal-append.queue_time_us":647407}
I20260709 12:21:32.611274  9569 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.623755  9568 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.624740  9556 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.620427  9445 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.627275  9556 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.627373  9445 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.633720  9568 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.635202  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:32.635833  8143 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:32.634794  9556 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.638393  9556 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.638929  9556 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.643045  9445 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.646562  9422 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.634822  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.648720  8145 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:32.650141  9556 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:32.652432  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.653535  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.653720  9422 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.654467  9422 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:32.654876  9422 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.658798  9422 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:32.616365  9517 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.666493  9517 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.656400  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:32.672324  8145 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:32.679343  9422 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.626588  9571 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:32.680267  9571 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.680507  8143 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:32.680768  9571 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:32.682034  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.683082  9445 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:32.683887  9445 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:32.684998  9445 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.685885  8145 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:32.628707  9569 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.690429  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.691444  9569 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:32.692538  9569 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:32.693284  9422 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.694028  9569 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.700925  9536 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.701900  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 993) took 1280 ms. Trace:
I20260709 12:21:32.707710  9536 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.722191  9536 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:32.708460  8140 rpcz_store.cc:276] 0709 12:21:31.421695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.424372 (+  2677us) service_pool.cc:224] Handling call
0709 12:21:31.425021 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.425459 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.425500 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.618762 (+1193262us) log.cc:844] Serialized 564 byte log entry
0709 12:21:32.693554 (+ 74792us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.693607 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.693742 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.701638 (+  7896us) raft_consensus.cc:1685] finished
0709 12:21:32.701667 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.701813 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":74429,"threads_started":1,"wal-append.queue_time_us":73616}
I20260709 12:21:32.717182  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:32.729594  8143 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:32.731449  9411 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.731789  9553 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.708376  9571 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.735599  9553 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.735986  9517 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.736209  8143 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:32.738003  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.739143  9517 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.737893  9411 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.741498  9553 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.742246  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:32.742624  9517 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.742822  8143 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:32.743388  9554 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:32.743520  9411 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.743949  9554 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:32.750852  8143 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:32.754422  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:32.744834  9571 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.746356  9536 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.753634  9445 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.756227  9555 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:32.744838  9554 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.769939  9411 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.770682  9479 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:32.779945  9570 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.780233  9449 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:32.767511  9553 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.780905  9571 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:32.776836  9568 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.768689  9556 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.790414  9411 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.791199  9449 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.796171  9571 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.784528  9555 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:32.778525  9536 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.792058  9517 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.788700  9479 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.817800  9422 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.781584  9445 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:32.816311  9364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.000s	sys 0.017s
I20260709 12:21:32.797425  9575 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.837553  9552 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.791318  9570 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.838686  9536 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.795334  9553 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:32.831187  9364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.004s	sys 0.017s
I20260709 12:21:32.798089  9568 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.858516  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 113) took 1510 ms. Trace:
I20260709 12:21:32.801708  9556 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.854183  9573 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.839339  9581 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.878373  8217 rpcz_store.cc:276] 0709 12:21:31.345137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.345275 (+   138us) service_pool.cc:224] Handling call
0709 12:21:31.345611 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.346267 (+   656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.346300 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.346812 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.362610 (+ 15798us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:31.362671 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.362775 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.854816 (+1492041us) raft_consensus.cc:1685] finished
0709 12:21:32.854837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.854984 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":15439,"threads_started":1,"wal-append.queue_time_us":13911,"wal-append.run_cpu_time_us":2999,"wal-append.run_wall_time_us":1203933}
I20260709 12:21:32.858474  9578 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.887403  9578 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.889312  9573 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.860237  9449 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:32.830461  9422 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.839901  9517 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.865211  9536 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.899232  9571 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:32.901275  9593 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:32.916165  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.919612  9517 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.892599  9411 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.942345  9411 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.928575  9589 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.943019  9411 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.893800  9577 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:32.943517  9589 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.858012  9552 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.926023  9573 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.926614  9479 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:32.927106  9591 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.927570  9553 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.927750  9583 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.928184  9422 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.892726  9449 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:32.929020  9578 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.940116  9517 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:32.940677  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800139fe0 after lost signal to thread 8001
W20260709 12:21:32.948910  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 1.54634e+06us
I20260709 12:21:32.607081  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:32.947382  9571 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:32.944733  9577 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.958212  7965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 170) took 1876 ms. Trace:
I20260709 12:21:32.855015  9575 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.980590  7965 rpcz_store.cc:276] 0709 12:21:31.082158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.082570 (+   412us) service_pool.cc:224] Handling call
0709 12:21:32.958140 (+1875570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225013,"reported_tablets":1}
I20260709 12:21:32.987640  7964 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 264) took 1574 ms. Trace:
I20260709 12:21:32.967427  9583 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.994076  9589 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:32.988071  7964 rpcz_store.cc:276] 0709 12:21:31.413687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.415394 (+  1707us) service_pool.cc:224] Handling call
0709 12:21:32.987578 (+1572184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415214,"reported_tablets":1}
I20260709 12:21:32.948501  9555 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.932898  9536 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.965770  9547 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.967656  9449 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.005828  9573 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.006392  9573 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.006753  9536 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.007283  9536 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.007668  9449 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.007746  9536 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:32.892081  9581 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.008765  9576 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:21:32.988683  8138 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.026s	sys 0.031s
I20260709 12:21:33.009301  9576 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.012442  9536 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:33.014768  8138 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.026s	sys 0.031s
I20260709 12:21:32.989881  9568 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.025977  9568 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.026635  9568 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.028038  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:32.972690  9517 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.028735  8141 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:33.030411  8137 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:33.013020  9581 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.030342  9422 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.031698  9579 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.032007  9422 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:33.033699  9556 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.035081  9445 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.035633  9445 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.035820  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.036121  9445 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.008430  9573 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:32.946852  9593 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.037606  9536 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:32.999011  9571 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:32.959223  9591 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.032194  9579 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.014088  9547 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.093048  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.036572  8761 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:33.122390  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:33.156791  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 368909us
I20260709 12:21:33.158510  9607 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.159035  9607 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.161954  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.163002  8066 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:33.164135  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.164775  8217 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:33.173333  9552 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.176052  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.176448  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.176867  8137 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:33.177301  9552 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.177744  9552 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.178143  9552 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.063621  9588 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.145280  9584 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.138899  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.086187  9573 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.123997  9576 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.193638  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.193950  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.194644  8067 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
W20260709 12:21:33.186731  8091 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7760 after lost signal to thread 8094
I20260709 12:21:33.181959  9568 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.182217  9599 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.214885  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.205047  9573 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.216981  9577 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.217674  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.161355  9536 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.219528  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.220149  8143 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:33.222267  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.204797  8064 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:33.221391  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.227475  9601 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.212291  9589 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.230029  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.230885  8141 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:33.188138  9588 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.222414  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.219534  9479 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.234184  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.281206  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.281569  9606 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.279245  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.281958  8213 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:33.275890  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.281968  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.283563  8145 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:33.274727  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.289008  9587 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.230751  9364 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:33.270440  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800380320 after lost signal to thread 8170
I20260709 12:21:33.227692  8140 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:21:33.289749  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800380380 after lost signal to thread 8171
I20260709 12:21:33.289644  9587 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.231266  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 174) took 1833 ms. Trace:
I20260709 12:21:33.233774  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.291572  9592 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.292048  9592 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.292388  9592 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:33.292574  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.279136  9603 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.204752  9584 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.324656  9479 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.331300  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.324998  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.326996  9609 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.332927  9540 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.328348  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.334496  8212 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:33.335758  9571 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.336406  9364 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.284839  9568 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.234526  9589 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.284583  9598 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.323735  9576 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.213189  9599 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.332815  9609 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.377485  9608 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.372608  9547 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.379172  9586 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.333570  9540 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.370952  9576 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.272848  9601 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.371088  9598 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.282130  9606 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.368448  9603 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.379757  9586 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.410733  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.413017  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.413815  8141 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:33.393419  9576 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:33.385265  9573 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.393239  9547 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.290815  8138 rpcz_store.cc:276] 0709 12:21:31.395762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.416744 (+ 20982us) service_pool.cc:224] Handling call
0709 12:21:31.417578 (+   834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:31.418283 (+   705us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:33.087866 (+1669583us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.215646 (+127780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.215778 (+   132us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:33.215887 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.219498 (+  3611us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.229294 (+  9796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3280,"prepare.queue_time_us":265530,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":7724,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1666440,"threads_started":2,"wal-append.queue_time_us":182126}
I20260709 12:21:33.421271  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.421649  8143 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:33.387290  8140 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:33.387771  9556 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.401419  8215 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:33.388799  9536 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.385259  9587 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.374584  9597 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.374379  9604 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.368176  9568 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.373366  9548 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.380144  9589 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.398362  9543 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:33.399861  9605 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:33.383677  9364 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.425294  9601 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:33.416383  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 446577us
W20260709 12:21:33.384358  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800344c20 after lost signal to thread 8244
I20260709 12:21:33.416657  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.418409  9540 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.385511  9575 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.422940  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.421903  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:33.485222  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63376.2us
I20260709 12:21:33.406543  9579 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.412410  9484 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:21:33.437372  9616 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.437960  9571 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.378043  9608 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.440188  9545 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.430752  9577 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.448559  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.444357  9604 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.469264  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:33.415820  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 201658us
W20260709 12:21:33.471907  9600 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:21:33.430215  9547 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.429267  9556 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.487455  9593 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.487438  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:33.474814  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800330bc0 after lost signal to thread 8245
I20260709 12:21:33.492107  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.466872  9588 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.503860  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.493358  9601 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.490183  9540 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.484119  9606 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:33.523873  8091 debug-util.cc:398] Leaking SignalData structure 0x7b0800213300 after lost signal to thread 8790
I20260709 12:21:33.535296  9609 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.495765  9591 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.507680  9364 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.543892  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.555701  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:33.552740  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78928.2us
I20260709 12:21:33.568275  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.569042  8218 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:33.571185  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.572599  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.573133  8141 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:33.573441  9568 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.574415  8143 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:33.575497  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.575980  8140 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:33.576448  8145 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:33.576596  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.583071  8213 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:33.587040  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.578064  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.588289  9612 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.588845  9612 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.589341  9612 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:33.532927  9601 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.501570  9571 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.371672  9596 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:33.509275  9587 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:21:33.467571  9597 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.565717  8217 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:33.494576  9543 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.549382  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.545042  9611 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.603679  9603 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.550173  9584 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.556761  9364 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.505844  9545 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.505900  9577 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:21:33.612352  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 83384.3us
I20260709 12:21:33.599452  9601 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.600061  9483 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.565572  9540 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.549098  9617 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.626391  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:33.600222  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 87441.4us
I20260709 12:21:33.631820  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:33.635705  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.611967  9586 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.639151  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:33.620223  9364 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:33.618049  9549 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.507381  9616 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.483901  9548 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.651674  9620 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.653108  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.627633  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.656672  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.644948  9543 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.626730  9598 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.593480  9619 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.667291  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.630859  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.677089  9614 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.668834  8064 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:21:33.712325  9618 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.714003  9615 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.657925  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.658093  9536 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.713032  9610 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:33.654624  9581 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:33.738279  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71093.6us
W20260709 12:21:33.747484  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.748533  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.748853  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.660025  9594 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.754757  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.754731  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.662526  9483 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.798625  8218 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:33.801973  9616 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.782879  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.665573  9617 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:33.809458  8066 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:33.810835  9617 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.677304  9549 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.813689  9549 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.815181  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.751134  9584 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:33.782621  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.793056  9536 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.753985  9614 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:33.836807  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 228435us
I20260709 12:21:33.783874  8757 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:33.798995  9547 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.839488  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:33.841501  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.621594  9611 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.804759  9615 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:33.804591  9594 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.803525  8756 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:33.828743  9584 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:33.852818  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:33.859550  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:33.835297  9536 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.834264  9608 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:33.836371  9617 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.836876  9616 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.868722  9483 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.802567  9581 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.860412  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.115873  9583 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.128389  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.015213  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.128942  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.127674  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.034044  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.131042  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:33.934749  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78013.1us
I20260709 12:21:34.126914  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.869796  8758 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.110658  9411 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.002492  9630 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:21:34.088097  9517 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:33.945813  9545 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.878589  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.015591  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:33.994015  9576 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
W20260709 12:21:34.019991  9592 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.000s
I20260709 12:21:33.993378  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.133948  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:33.844805  9549 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:33.956348  9597 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.990278  9622 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:33.815217  9618 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:33.729854  9619 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:33.868919  9621 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:33.969429  9540 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.726919  9620 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.090639  8760 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:33.939455  9586 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:33.991986  9604 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:33.983253  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:33.853946  9615 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:34.146790  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.007s
I20260709 12:21:33.853540  9594 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:33.860852  9584 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:34.146327  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 270482us
I20260709 12:21:34.104503  9556 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.040917  9570 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:34.043445  9607 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.045866  9548 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.042044  9445 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:34.074399  9633 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:34.488852  8145 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:34.490399  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.244966  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.493240  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.014s	sys 0.007s
W20260709 12:21:34.493959  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 854858us
I20260709 12:21:34.498874  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.495265  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:34.493291  8070 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.164288  9617 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.181562  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.516554  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.518309  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.021s
I20260709 12:21:34.525462  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.518610  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.525339  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.000s	sys 0.021s
W20260709 12:21:34.526695  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 729261us
I20260709 12:21:34.521322  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.514991  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.528587  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.525787  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1013) took 1307 ms. Trace:
I20260709 12:21:34.529238  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.533216  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.535828  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.536103  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:34.536491  8138 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.529970  8139 rpcz_store.cc:276] 0709 12:21:33.218377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.221544 (+  3167us) service_pool.cc:224] Handling call
0709 12:21:34.015053 (+793509us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:34.525695 (+510642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4237184}
I20260709 12:21:34.537781  9602 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:34.538177  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.450881  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.400113  9625 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:34.451164  9613 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:34.534960  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.539562  8145 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:34.493091  9586 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:34.228425  9611 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.544858  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.496570  9577 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.548599  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.227974  9614 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.521322  8140 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:34.576570  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:34.502422  9596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.003s	sys 0.004s
I20260709 12:21:34.568327  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.570384  8217 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:34.579123  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.577519  8068 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:34.540398  9621 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.185207  9616 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.589075  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.538218  9602 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:34.570273  9612 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.003s
I20260709 12:21:34.583312  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.585179  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 362) took 1528 ms. Trace:
I20260709 12:21:34.515731  9540 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:21:34.583132  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.605105  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.605623  8211 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:34.517104  9592 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.606988  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2276) took 1278 ms. Trace:
I20260709 12:21:34.637012  8069 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:34.607069  8062 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:34.532522  9548 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:21:34.517146  9576 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.540881  9637 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:34.573580  9586 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.609552  8765 rpcz_store.cc:276] 0709 12:21:33.056791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.584379 (+1527588us) service_pool.cc:224] Handling call
0709 12:21:34.584708 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.584882 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.584906 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:34.584945 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:34.584974 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.585025 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.585126 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:34.629040  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.624522  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 87556.6us
I20260709 12:21:34.571060  9628 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:21:34.606597  9616 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.576671  9593 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.589128  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.521731  9549 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:34.583796  9422 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:34.610793  9613 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.640719  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.611440  9602 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.633389  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.658313  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.607470  9581 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.666689  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.666941  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.669085  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:34.673208  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.653220  9552 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.475s	user 0.004s	sys 0.012s
I20260709 12:21:34.643064  9598 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.647718  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:34.678817  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45543.1us
W20260709 12:21:34.678822  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 143898us
I20260709 12:21:34.641332  8215 rpcz_store.cc:276] 0709 12:21:33.328279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.330924 (+  2645us) service_pool.cc:224] Handling call
0709 12:21:34.606771 (+1275847us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54000e6354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:34.606898 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143628032}
I20260709 12:21:34.684098  9620 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.684175  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.712147  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.712906  8139 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:34.686829  9613 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.599663  9625 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.654510  9637 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.693739  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.722656  8143 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
W20260709 12:21:34.723452  8034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.013s	sys 0.034s
W20260709 12:21:34.723834  8034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.013s	sys 0.034s
I20260709 12:21:34.723903  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:34.724242  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 750704us
I20260709 12:21:34.613767  9612 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.684114  9618 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.695787  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.701373  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 121) took 1106 ms. Trace:
I20260709 12:21:34.704344  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.706986  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.712863  8064 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:34.684559  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.698809  9575 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.706023  9641 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.674479  9593 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.725108  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:34.727072  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.728283  8214 rpcz_store.cc:276] 0709 12:21:33.595429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.596674 (+  1245us) service_pool.cc:224] Handling call
0709 12:21:33.596895 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.866759 (+269864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.866794 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.866844 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:33.866884 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.701152 (+834268us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540014ee54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:34.701195 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.701317 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620142336}
I20260709 12:21:34.709458  8140 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:34.726227  9578 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:34.725116  9637 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.711118  9549 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.734308  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:34.736212  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 183) took 1460 ms. Trace:
I20260709 12:21:34.790512  8143 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:34.753901  9619 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.730912  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.710359  9552 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.710845  8061 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.753970  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 124) took 1007 ms. Trace:
I20260709 12:21:34.791980  8212 rpcz_store.cc:276] 0709 12:21:33.747061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.749434 (+  2373us) service_pool.cc:224] Handling call
0709 12:21:33.795249 (+ 45815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.803210 (+  7961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.803253 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.803312 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:33.803355 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.753733 (+950378us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b5400373a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:34.753783 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.753893 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12130560}
I20260709 12:21:34.790851  8142 rpcz_store.cc:276] 0709 12:21:33.277080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.278342 (+  1262us) service_pool.cc:224] Handling call
0709 12:21:33.290151 (+ 11809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.290319 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.290343 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.290393 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:33.290442 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.290520 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.735906 (+1445386us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5400042750. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:34.736025 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5897600}
I20260709 12:21:34.731122  9575 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:34.755271  9618 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.745472  9598 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.797722  9556 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.805168  8137 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:34.805604  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.745254  9641 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.792600  9579 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.805929  9621 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:34.808061  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73837.8us
I20260709 12:21:34.798625  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.792721  9578 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.793066  9517 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:34.813596  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.812810  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.798382  9575 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:34.815141  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.505s (SENT) [suppressed 5 similar messages]
I20260709 12:21:34.804294  9618 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.820938  9552 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.821893  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.818652  9571 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.825129  8140 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:34.826306  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.810518  9617 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.832163  9578 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.834669  9592 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:34.835085  9625 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.817646  9517 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.837666  9517 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.838214  9550 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.838610  9550 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:34.839457  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.846505  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.857504  9612 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.822904  9618 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.859433  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.828823  9579 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.861938  8765 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:34.807364  9556 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:34.865587  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50493.1us
I20260709 12:21:34.819139  8144 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:34.875911  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:34.875798  9594 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.872192  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 186) took 1583 ms. Trace:
I20260709 12:21:34.876646  8144 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.872588  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.865028  9593 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.876895  8146 rpcz_store.cc:276] 0709 12:21:33.378798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.381190 (+  2392us) service_pool.cc:224] Handling call
0709 12:21:33.398450 (+ 17260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.540225 (+141775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.540297 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:33.540363 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:33.540418 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.871968 (+1331550us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001c2fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:34.872014 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.872138 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325410560}
I20260709 12:21:34.879582  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.874898  9556 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.878898  8070 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.873733  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.880174  8217 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:34.850152  9615 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.885175  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.885790  8063 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:21:34.888244  9601 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.239s	user 0.012s	sys 0.000s
I20260709 12:21:34.888680  9601 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:34.891601  9536 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.958s	user 0.010s	sys 0.000s
I20260709 12:21:34.891981  9536 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.892350  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:34.893746  9364 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.232s	user 0.008s	sys 0.004s
I20260709 12:21:34.894085  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.894166  9364 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.896178  9364 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.839387  9550 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.897050  9601 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:34.897297  9550 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.901036  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.901623  8070 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.903456  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.904699  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.904923  9615 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.905375  8762 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:34.905223  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.906937  8218 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:34.906854  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:34.880668  9641 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.897212  9543 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:34.904452  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.909948  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.898808  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.898718  9479 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:34.917309  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:34.906687  9556 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.919126  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.913800  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.921469  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.922664  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:34.926472  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.919806  8758 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:34.929836  8761 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:34.926532  9556 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.931233  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.934238  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.934435  9556 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.938746  9594 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.920192  9601 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.941260  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.942456  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:34.946465  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.942654  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.943843  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.947146  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.925599  8064 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:34.955031  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.957834  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.958549  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.927870  9584 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:34.944736  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.960405  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1103) took 1431 ms. Trace:
I20260709 12:21:34.967465  8067 rpcz_store.cc:276] 0709 12:21:33.524684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.524879 (+   195us) service_pool.cc:224] Handling call
0709 12:21:34.109839 (+584960us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800010598. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:21:34.110108 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:34.535429 (+425321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.535461 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:34.535502 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:34.535538 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.955521 (+419983us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001f7554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:34.955567 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.955685 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986249344}
I20260709 12:21:34.970619  9584 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:34.971498  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 367) took 1346 ms. Trace:
I20260709 12:21:34.971887  8759 rpcz_store.cc:276] 0709 12:21:33.624814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.625449 (+   635us) service_pool.cc:224] Handling call
0709 12:21:34.944551 (+1319102us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:34.971407 (+ 26856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16102784}
I20260709 12:21:34.961745  8730 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:34.973021  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.973527  9594 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:34.973876  9594 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:34.974225  9594 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.974169  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.962632  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.962819  8762 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:34.952956  9601 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.978411  9601 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.963271  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:34.963291  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.979539  8212 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:34.964476  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:34.956105  9644 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:34.983620  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:34.984162  9479 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:34.985543  9582 raft_consensus.cc:1064] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:21:34.985386  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.986976  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:34.987185  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.987437  8070 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:34.987545  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.990312  9479 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.990696  9479 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:34.991015  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.957330  9639 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:34.944440  9637 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.992097  9604 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:34.993192  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:34.993386  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.989770  8067 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:34.992534  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.995584  8212 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:34.997907  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:34.998270  9637 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:34.999176  9601 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.002228  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.002823  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.003883  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.003997  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.005373  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:35.005761  8218 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.006768  9573 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.007395  9582 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:34.991045  9479 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.004989  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.012009  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.013586  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.013746  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.014639  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.016002  8763 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:35.012368  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:34.996084  9639 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.022223  8214 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.024464  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:35.025398  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.026669  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.003348  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.029646  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.031539  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.023100  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.016242  9573 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.012938  9599 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.029065  8140 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:35.033228  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.040684  8763 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:35.041077  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.041368  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.041776  8062 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.042091  8064 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.042907  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.043077  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.043716  8064 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.011579  9586 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.050822  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.048894  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.060895  8757 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:35.061232  9616 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.061620  9616 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.054379  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.051717  9536 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.062587  9616 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.053664  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.063627  9616 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.057221  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.064706  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.065560  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.065817  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.069803  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1105) took 1524 ms. Trace:
I20260709 12:21:35.070286  8063 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:35.021777  9639 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.066192  8069 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:35.062629  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.066710  9601 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.028378  9593 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:35.068434  9575 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.069782  9618 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.071988  8065 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:35.044602  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.083039  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.083493  8064 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.066509  8143 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.084568  9479 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.063650  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.087639  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.065827  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.090106  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.060103  8067 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.074164  9577 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.070514  8066 rpcz_store.cc:276] 0709 12:21:33.545000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.545214 (+   214us) service_pool.cc:224] Handling call
0709 12:21:33.545511 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.809809 (+264298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.069585 (+1259776us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003219d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:35.069747 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606286080}
I20260709 12:21:35.091471  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.092079  8218 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:35.093364  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.093812  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.095265  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.095775  8069 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.097471  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:35.049261  9586 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.105944  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.106925  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.107450  8146 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.107999  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.109400  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.110380  9615 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.110785  9615 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:35.111194  9615 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.116835  9618 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.117908  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:35.123027  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.123627  8068 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:35.099401  9641 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.121013  8760 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.101506  9555 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.127631  9555 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:35.128057  9555 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.086628  9602 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.131762  8069 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:35.105203  9612 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.101944  9556 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.137691  8146 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:35.132310  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.051476  9594 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.134389  9581 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.128983  9364 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:21:35.087186  8144 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:35.137811  8063 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:35.140132  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:35.128826  9479 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.150110  8762 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.150642  8761 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.147795  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.141243  8764 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:35.149466  8144 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.151314  8143 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:35.153930  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.154492  8146 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.137156  9612 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:35.156714  9550 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.150286  9597 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.164661  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:35.167340  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.174821  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.162748  9609 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:21:35.165199  9575 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.164693  8218 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.167901  8145 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:35.170538  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:35.238652  9618 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:35.246193  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:35.246958  9651 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:21:35.248739  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69343.2us
W20260709 12:21:35.249153  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78705.4us
W20260709 12:21:35.239260  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51745.4us
I20260709 12:21:35.157686  9364 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.252526  9629 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:21:35.252988  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.254026  9543 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.254129  9637 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.254558  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.254647  9637 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.255697  9637 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.256819  9613 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.253131  9576 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.160599  9612 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.265657  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.260017  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.268293  8146 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:35.269397  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.272221  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.273661  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.275324  9639 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.157248  9577 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:21:35.282399  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.276500  8141 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:35.160193  9586 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
W20260709 12:21:35.285179  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.278340  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.259037  9364 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:35.286818  9578 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:35.287336  9578 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.287621  9617 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.288067  9617 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.280197  8211 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:35.288233  9578 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.288957  9617 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.282776  9576 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.290328  9617 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:35.286237  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 109922us
I20260709 12:21:35.266140  9594 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.293334  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.278636  9629 consensus_queue.cc:1243] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:35.271425  9575 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.238823  9550 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.281342  9609 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:35.269930  9588 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:21:35.303323  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.305794  8761 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.306198  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.306473  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.282712  9633 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:35.309088  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.307452  9602 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.312071  9601 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.325233  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.306849  9543 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.306990  9576 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:21:35.313791  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.298041  9628 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.298866  9364 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.318310  9545 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.338380  9545 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.310542  9548 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:21:35.339574  9548 consensus_queue.cc:1243] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:21:35.339221  9545 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.327766  9609 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:35.340440  9545 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.318506  9615 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.319243  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.320262  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.320611  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.362948  8219 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:35.363590  9615 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.323714  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:35.308472  8184 connection.cc:256] RPC call timeout handler was delayed by -1.2987027880003552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:21:35.327003  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:35.329332  9639 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.376497  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.329610  9602 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.330493  9543 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.337409  8145 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.341094  9609 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:35.351632  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1007) took 2162 ms (client timeout 2218 ms). Trace:
I20260709 12:21:35.352185  9550 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.352525  8138 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.354271  8139 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.354216  8144 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:35.327134  9601 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.397644  9601 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.399351  9601 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:35.356279  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.402923  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.357206  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:35.410493  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.328162  9622 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:35.376057  8184 connection.cc:256] RPC call timeout handler was delayed by -1.2749925760003862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:21:35.419935  8184 connection.cc:256] RPC call timeout handler was delayed by -1.1635665640001207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:21:35.420287  8184 connection.cc:256] RPC call timeout handler was delayed by -1.153632311000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:21:35.381029  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57370.4us
I20260709 12:21:35.381716  9629 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.380897  9543 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.382277  9602 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:35.431512  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.383080  8145 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.383211  9637 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:35.387207  8137 rpcz_store.cc:269] 0709 12:21:33.189226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.194962 (+  5736us) service_pool.cc:224] Handling call
0709 12:21:35.351390 (+2156428us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400254754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:35.351547 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3524485376}
I20260709 12:21:35.392557  9603 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.393541  9364 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.411921  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.411975  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:35.420572  8184 connection.cc:256] RPC call timeout handler was delayed by -1.1239212529999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 12:21:35.457288  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0782027880004534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:21:35.457829  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0782027880004534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:21:35.458246  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0577375040002153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:21:35.442056  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.460876  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:35.432322  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.457337  8070 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:35.451184  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.468772  9576 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.469374  9576 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.470510  9576 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.472235  9576 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.430759  9629 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.480918  9479 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:35.485524  9577 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.485802  9637 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.486676  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.428987  8064 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:35.437801  9616 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.491955  9603 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.492211  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:35.492904  8756 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:35.496346  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:35.526932  8217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.033s	sys 0.052s
W20260709 12:21:35.527272  8217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.033s	sys 0.052s
I20260709 12:21:35.501255  8730 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.426080  9622 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.447753  9582 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.520424  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.521306  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.528566  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.452978  9613 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.529958  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:35.535527  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.537891  8070 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:35.508155  9629 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.516182  9643 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.466262  9555 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.522369  9618 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:35.508374  9479 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.547176  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:35.538136  9584 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.537266  9601 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.516561  9577 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.525486  9603 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:35.555593  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123394us
I20260709 12:21:35.552672  9637 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.560873  9602 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:35.581991  9650 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:21:35.561812  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.584741  8063 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.585290  8762 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:35.562537  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.538532  9622 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.559149  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:35.591480  9612 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.547573  8070 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:35.593524  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.593245  9603 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.594425  9603 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.594635  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:35.548810  8066 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.538398  9582 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.573417  8062 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:35.577567  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.564738  9479 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:35.566097  9618 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.598394  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.600037  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:35.604857  8764 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:35.534050  9616 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:35.545104  9613 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.605180  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.608455  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:35.608676  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88372.8us
W20260709 12:21:35.615139  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 120827us
I20260709 12:21:35.612978  8764 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.619397  8762 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:35.576421  9577 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.620005  9588 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.620396  9588 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.620852  9588 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.623471  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.613251  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.585960  9364 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.627218  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:35.628854  8069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273de299acf94214b44aab4591da9b3a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:35.603837  9582 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.629864  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:35.627864  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.607488  9618 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:35.568409  9643 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.609166  9545 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.635825  8213 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.616544  9601 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.635339  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 927) took 1024 ms. Trace:
I20260709 12:21:35.639618  9634 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:35.640178  8218 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.639420  8138 rpcz_store.cc:276] 0709 12:21:34.611235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.751995 (+140760us) service_pool.cc:224] Handling call
0709 12:21:35.352330 (+600335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.387403 (+ 35073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.635103 (+247700us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400254750. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:35.635269 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379987200}
I20260709 12:21:35.634917  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.632062  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:35.612772  9617 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.640501  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.627806  9596 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.629671  9637 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.655299  8068 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.665484  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.662348  9536 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.616289  9623 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:21:35.665833  8068 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.633184  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.668833  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.669792  9596 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.636011  9545 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.680259  8763 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.642596  8212 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:35.639370  9601 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.687505  8068 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.685110  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.656845  8139 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.655855  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.640196  9634 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.637544  9659 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.711995  9643 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.712734  9550 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:35.713330  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.714109  9581 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.673499  9579 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:35.708616  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.702097  9536 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.708040  8068 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.680459  9583 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.707993  9601 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.749480  9536 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.672534  9617 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:35.716157  9556 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.005s
I20260709 12:21:35.699936  9545 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.699075  9596 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:35.745378  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.743548  9634 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.734350  9612 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:35.754695  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 122712us
I20260709 12:21:35.739709  9581 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:35.728613  9543 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.772181  9581 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.729878  9588 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.773483  9581 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.745586  8064 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.763748  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:35.746734  9657 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.775045  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:35.764155  9596 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.764853  9619 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.766366  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.768734  9582 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.758774  9583 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.771201  8759 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:35.780088  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.782250  9577 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.783179  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:35.783706  9612 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:35.779410  9549 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:21:35.785506  9583 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.783250  9617 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:35.787139  9588 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.779227  9633 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.798251  9643 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:35.779557  9550 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.799242  9550 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.799326  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.799901  9550 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.800071  8765 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:35.800603  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.761169  9556 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.788544  9613 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.793505  8217 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:35.756860  9645 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:21:35.766426  9555 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:35.803185  8145 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.804972  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:35.808760  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.811638  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:35.807989  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.793198  9664 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.817621  9664 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.818069  9628 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.818368  9664 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.814440  8141 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.816035  9645 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.821173  9645 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:35.822116  9645 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.797073  9619 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:21:35.818529  9628 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.825838  9616 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.795266  9629 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.828799  9629 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.829860  9643 consensus_queue.cc:1243] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:35.830425  9643 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:35.830735  9643 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.831557  9643 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.817678  9577 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:35.834055  9619 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.834486  9619 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:35.835342  9619 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.836495  9422 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.839433  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:35.840076  8070 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
W20260709 12:21:35.849210  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69213.1us
I20260709 12:21:35.850015  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.851265  8216 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.852176  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:35.812454  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.859678  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:35.862246  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:35.889236  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.890355  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:35.900563  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92615.2us
I20260709 12:21:35.901476  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.843426  9619 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.901446  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:35.851918  9645 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.873158  9643 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.910732  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.887588  9629 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.888763  9555 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.917915  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.904281  8064 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:35.922557  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.893556  9549 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.897475  9603 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:35.861196  9618 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.936276  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:35.900440  9659 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.942803  9670 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.948608  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:35.943436  9570 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:35.917378  9577 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:35.911772  9588 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:35.871145  9601 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:35.954308  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:35.959836  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.961174  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.963564  8139 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:35.908977  9612 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:35.912216  9584 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:36.021731  8761 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:35.975512  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:36.022943  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47503.1us
I20260709 12:21:36.023885  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:35.931581  9629 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:35.899039  9622 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:35.910616  9665 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:35.893190  9579 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:21:35.985641  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.964775  9670 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:36.016695  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:35.964402  9658 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:36.018674  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 575) took 1092 ms. Trace:
I20260709 12:21:35.964303  9583 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:21:36.013935  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82295.4us
I20260709 12:21:36.020841  8216 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:35.946168  9602 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:35.969547  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.025120  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.059636  8213 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:36.027310  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73133us
I20260709 12:21:35.934708  9555 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.922851  9623 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:21:35.947021  9603 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:35.937299  9549 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.039777  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:35.948169  9659 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:36.016767  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.014360  9586 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:36.037703  9665 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:36.038017  9517 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:35.977357  9577 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.016820  9666 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.030239  9584 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.055088  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:36.058123  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.072999  9665 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.021764  8066 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:36.060801  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:36.123769  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 63150.2us
I20260709 12:21:36.033429  9556 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.034584  9629 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.033018  9604 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:36.065663  8070 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.032251  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:36.053031  8756 rpcz_store.cc:276] 0709 12:21:34.926730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.927571 (+   841us) service_pool.cc:224] Handling call
0709 12:21:35.320113 (+392542us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:36.018416 (+698303us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400750154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:36.018599 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304987904}
I20260709 12:21:36.071247  9517 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.054466  9658 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.049531  9670 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:36.108328  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.069166  9659 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.066865  9603 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:36.066974  9549 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.063009  9582 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.064862  9555 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.073761  9577 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:36.119859  8068 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:36.045177  9607 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:21:36.015098  9588 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:36.122807  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 67859.7us
I20260709 12:21:36.154330  9658 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.130401  9517 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.133172  8213 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:36.136655  8062 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.139204  8069 raft_consensus.cc:606] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:36.140209  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2293) took 1147 ms. Trace:
I20260709 12:21:36.141324  9622 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.147055  8070 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:36.154050  8065 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:36.125412  9479 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.005s
I20260709 12:21:36.153703  9628 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.170034  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.170890  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:36.176488  9667 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:21:36.125303  9570 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:36.180244  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.205101  8141 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.126618  9634 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:36.190433  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:36.129984  8758 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.156698  8064 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.189944  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:36.211223  9681 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.211493  8142 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:36.194428  8067 rpcz_store.cc:276] 0709 12:21:34.992694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.013522 (+ 20828us) service_pool.cc:224] Handling call
0709 12:21:36.140007 (+1126485us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54000fdcd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:36.140115 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105336576}
I20260709 12:21:36.125501  9597 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:21:36.214345  9601 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.219769  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.197484  9623 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:36.192307  9588 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:36.190853  9548 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:21:36.207842  9618 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.197573  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.203063  8138 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.277721  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1131) took 1691 ms. Trace:
I20260709 12:21:36.278172  8065 rpcz_store.cc:276] 0709 12:21:34.586099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.118834 (+532735us) service_pool.cc:224] Handling call
0709 12:21:36.141964 (+1023130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.198726 (+ 56762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.277513 (+ 78787us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000fdcd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:36.277661 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336554368}
I20260709 12:21:36.227859  9628 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.227566  9623 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:36.340785  9623 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.342278  9623 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.205304  9479 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.316284  9640 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.317094  9578 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:36.321528  9543 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:36.314294  9661 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:21:36.357600  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 167246us
I20260709 12:21:36.378123  8146 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:36.375885  9364 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:36.380275  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.355599  9640 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:36.400727  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 276337us
I20260709 12:21:36.381120  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.401824  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.402426  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.402527  8213 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:36.405967  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:36.403092  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 371223us
I20260709 12:21:36.357386  9578 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:36.416893  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.420433  8218 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:36.423621  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 196124us
I20260709 12:21:36.426649  8211 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.399058  9609 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:21:36.432246  8212 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.399055  9570 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:21:36.434785  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.444950  8141 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:21:36.445627  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.446763  9645 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.016s
I20260709 12:21:36.432740  8140 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.454566  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:36.461848  9653 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.902s	user 0.002s	sys 0.005s
I20260709 12:21:36.463831  8144 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.464783  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:36.466521  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:36.468258  9364 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:36.473451  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.473996  8218 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:36.450203  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.478816  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.475389  9681 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.468163  9682 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.483558  9681 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:36.488379  9602 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.444437  9640 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.490025  8137 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:36.496572  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.498649  8218 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.488615  9663 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:36.492973  9637 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:21:36.481879  9422 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.499868  9663 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:36.500247  9422 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:36.500911  9663 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.501134  9422 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:36.496755  9643 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.574s	user 0.002s	sys 0.012s
I20260709 12:21:36.508569  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.518353  9422 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:36.506407  9664 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.687s	user 0.019s	sys 0.004s
I20260709 12:21:36.519815  9663 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.496006  9602 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:36.534188  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:36.536180  8070 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:21:36.536777  8070 pending_rounds.cc:85] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 4
I20260709 12:21:36.537087  8070 pending_rounds.cc:107] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:21:36.537398  8070 raft_consensus.cc:2889] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:36.539975  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.540373  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.540891  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:36.559442  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.509369  9581 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.735s	user 0.005s	sys 0.014s
I20260709 12:21:36.455981  9578 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.508054  9640 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:36.530918  9550 consensus_meta.cc:287] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.008s
I20260709 12:21:36.570026  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.523597  9479 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.562886  9670 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:36.580725  9545 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.020s
I20260709 12:21:36.581225  9545 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.582377  8063 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.584872  8220 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.498315  9603 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:36.586735  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45935us
I20260709 12:21:36.587689  8141 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:36.588212  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54580.1us
I20260709 12:21:36.593564  9545 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:36.595221  9555 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:36.564824  9570 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:21:36.601663  8214 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:36.607465  9629 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.640926  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.633957  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:36.646972  8212 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:36.586169  9643 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:36.506901  9681 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.584509  9517 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.557580  9584 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.633431  9543 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:36.731329  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:36.783406  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 198870us
I20260709 12:21:36.783901  8218 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
W20260709 12:21:36.709425  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.655877  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.700943  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.678014  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:36.718159  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.717507  8142 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.587085  9550 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:36.800144  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166263us
I20260709 12:21:36.792376  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:36.794950  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:36.638058  9619 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.726s	user 0.015s	sys 0.001s
I20260709 12:21:36.803514  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.804272  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:36.801164  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.805320  8218 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:36.633175  9545 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:36.791345  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.806981  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:36.809814  8761 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:36.811767  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.812263  8765 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.519794  9664 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.639223  9555 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:36.717207  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:36.816260  8145 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.817013  9682 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:36.813483  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.789917  9643 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:36.818140  8066 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 2: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:36.643383  9686 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:36.781958  9629 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:36.602104  9549 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.798352  9618 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.645519  8064 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:36.818470  9666 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:36.641510  9670 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:36.681234  9622 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.815383  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.826112  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.831737  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.830090  8215 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.812007  9581 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:36.708906  9616 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:21:36.907019  9581 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.907529  9581 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.907567  9616 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:36.908079  9616 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:36.908861  9616 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.910040  9616 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:36.820762  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:36.832857  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:36.910648  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 90074.1us
I20260709 12:21:36.910987  8758 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.817224  9628 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.649917  9548 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.216s
I20260709 12:21:36.911713  9586 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:36.912295  9586 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:36.912504  9548 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:36.912930  9548 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:36.913214  9586 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.913708  9548 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.782001  9543 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.914927  9548 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.916548  9543 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:36.917155  9634 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:36.917759  9634 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.918773  9664 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:36.868687  8218 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:36.866282  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59273.9us
I20260709 12:21:36.832105  9643 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.870148  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.926477  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.870821  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:36.842243  9665 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.008s
I20260709 12:21:36.871057  9584 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:36.843662  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:36.844776  9612 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.815s	user 0.016s	sys 0.001s
I20260709 12:21:36.873198  9549 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:36.847002  9618 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.873723  9666 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:36.878644  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.878896  8220 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:36.834450  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:36.880609  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.883396  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.885195  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2311) took 1074 ms. Trace:
I20260709 12:21:36.817925  9582 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:21:36.891511  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:36.896297  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.900014  9680 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.897795  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:36.901757  9622 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:36.866847  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 56350.7us
W20260709 12:21:36.978519  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.978958  9364 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:36.979326  9364 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:36.824494  9552 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:21:36.972817  9619 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:36.840034  8216 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:36.980309  9619 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:36.981541  9549 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:36.981938  9680 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.982075  9549 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.678580  9602 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:36.884162  9682 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:36.921435  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.984720  8218 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:36.985634  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:36.818971  9545 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:36.962512  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 128148us
W20260709 12:21:36.988740  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.965004  8212 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:36.961544  8063 rpcz_store.cc:276] 0709 12:21:35.811184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.835843 (+ 24659us) service_pool.cc:224] Handling call
0709 12:21:35.836181 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.582744 (+746563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.884967 (+302223us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54001f6654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:36.885132 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715718400}
I20260709 12:21:36.925282  9634 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:36.972028  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53753.3us
I20260709 12:21:36.992805  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:36.945278  9596 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.152s	user 0.012s	sys 0.006s
I20260709 12:21:36.973166  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:36.974718  9666 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.957314  9612 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.957016  9665 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:36.976375  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:36.978396  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 81090.7us
I20260709 12:21:36.999859  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.001117  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:37.002378  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:36.979660  9364 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:36.981196  9619 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:36.940212  8110 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.505s (SENT)
W20260709 12:21:36.940897  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.990931  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.007696  8141 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:36.914945  9411 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:21:37.009907  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:37.010442  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:36.997224  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.011001  8218 raft_consensus.cc:606] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.011337  8212 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:37.005975  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 988) took 1972 ms (client timeout 2098 ms). Trace:
W20260709 12:21:36.988130  9659 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.806s	user 0.021s	sys 0.007s
W20260709 12:21:37.011731  8214 rpcz_store.cc:269] 0709 12:21:35.033621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.034384 (+   763us) service_pool.cc:224] Handling call
0709 12:21:35.922398 (+888014us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:37.005784 (+1083386us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:37.005918 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583544832}
I20260709 12:21:36.991815  9680 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.011515  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:37.012331  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 208127us
I20260709 12:21:37.013176  8220 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
W20260709 12:21:37.057487  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 129935us
I20260709 12:21:37.060357  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.061029  8146 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:37.055172  8138 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:37.071702  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.971379  9581 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.000097  9689 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.080963  8219 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:37.079284  9364 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:37.010119  9588 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.745s	user 0.015s	sys 0.000s
I20260709 12:21:37.077219  8212 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:37.087574  8212 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.087670  9364 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.066569  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:37.082542  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71095.6us
I20260709 12:21:36.997908  9603 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.005023  9549 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.089952  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.016263  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.090628  9550 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.016543  9552 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:37.091228  9664 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:37.093788  9581 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.094202  9588 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.094915  9689 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.076083  9629 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:21:37.000398  9596 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.016384  9570 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:37.015897  9609 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:37.056288  9693 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:37.066313  9582 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.019143  9543 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:21:37.100392  9593 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:37.118180  9588 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.118399  9689 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.109089  9664 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:37.119433  9618 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.119875  9596 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.112449  9609 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:37.107650  9603 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.067622  9659 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.124348  9665 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.125097  9593 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.133203  9593 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:37.133692  9640 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
W20260709 12:21:37.134760  9658 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.012s
I20260709 12:21:37.112697  9693 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.135161  9658 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.132608  9609 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.121681  9643 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.137981  9693 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.139570  9693 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:37.121658  9663 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.601s	user 0.015s	sys 0.000s
W20260709 12:21:37.135629  9694 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 12:21:37.132128  9664 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.142403  9643 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:37.182236  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123074us
I20260709 12:21:37.184808  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:37.246357  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62077.6us
I20260709 12:21:37.140021  9659 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.098740  8211 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:37.249420  9640 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:37.187772  8144 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.099426  8142 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.252779  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:37.254170  8211 raft_consensus.cc:606] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.254777  8211 raft_consensus.cc:614] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:37.189858  8758 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
W20260709 12:21:37.188915  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 98846.8us
I20260709 12:21:37.191785  8217 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:37.192672  8220 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:37.195516  8110 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.851s (SENT)
I20260709 12:21:37.256754  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.257117  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:37.198537  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125483us
I20260709 12:21:37.259203  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:37.090665  9422 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:37.260457  9681 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.261461  9681 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.261879  9658 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:37.249403  9699 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:21:37.112124  9517 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.263640  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.219640  9543 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.264808  9543 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.266584  9422 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.266534  9543 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.129273  9545 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.219357  9701 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:37.111616  9552 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.112601  9570 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:21:37.233501  9577 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.042s	user 0.014s	sys 0.011s
I20260709 12:21:37.233865  9550 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:37.238646  9619 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.091423  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.107239  8757 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.274134  9619 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.286530  9422 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:37.287729  9422 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.287634  9619 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.288201  9422 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:37.289501  9619 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.290724  8211 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.289978  9422 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.291128  8211 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:37.273408  9577 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.296234  9577 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.297640  9604 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:37.273136  9570 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.292553  8211 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.298615  9604 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.304008  9604 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.304384  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 946) took 1095 ms. Trace:
I20260709 12:21:37.304903  8138 rpcz_store.cc:276] 0709 12:21:36.208978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.302765 (+ 93787us) service_pool.cc:224] Handling call
0709 12:21:36.376788 (+ 74023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.061766 (+684978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.303798 (+242032us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400312c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:37.304157 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559697152}
I20260709 12:21:37.306972  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:37.308846  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.273969  9550 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.312902  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.298818  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:37.315212  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.316538  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 121227us
I20260709 12:21:37.270220  9701 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.320199  9701 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.321593  9701 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.271706  9640 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.326128  9640 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.327190  9571 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:37.327689  9571 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:37.329272  9658 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:37.329273  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45336us
I20260709 12:21:37.331491  9578 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.334069  9550 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.300087  9552 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.336263  9422 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.324224  9701 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.268610  9543 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.340962  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.342129  8756 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:37.346041  9692 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.375s	user 0.000s	sys 0.003s
I20260709 12:21:37.345741  9593 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.338807  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.351011  9550 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:37.358776  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:37.356909  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62074.9us
I20260709 12:21:37.363183  9571 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.353665  9593 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.369930  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.373041  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 152) took 1234 ms. Trace:
I20260709 12:21:37.373464  9604 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.373687  8215 rpcz_store.cc:276] 0709 12:21:36.138112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.138273 (+   161us) service_pool.cc:224] Handling call
0709 12:21:36.138604 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.907767 (+769163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.372339 (+464572us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:37.372759 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555683712}
I20260709 12:21:37.374369  9604 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.372483  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.376132  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.377642  9545 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.378194  8213 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.378072  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1006) took 1417 ms. Trace:
I20260709 12:21:37.381456  8219 rpcz_store.cc:276] 0709 12:21:35.960492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.967476 (+  6984us) service_pool.cc:224] Handling call
0709 12:21:37.377300 (+1409824us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540017ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:37.377707 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301853952}
I20260709 12:21:37.384387  8219 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.376143  9571 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.390617  8064 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.392987  8063 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.398815  8062 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.400112  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1056) took 1235 ms. Trace:
I20260709 12:21:37.400899  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.400745  8145 rpcz_store.cc:276] 0709 12:21:36.165037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.167544 (+  2507us) service_pool.cc:224] Handling call
0709 12:21:36.180913 (+ 13369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.821932 (+641019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.399559 (+577627us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400311854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:37.399884 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460758400}
W20260709 12:21:37.402462  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.398649  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.406483  8067 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.406699  9634 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.406848  8063 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.407488  8069 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.408290  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2301) took 1002 ms. Trace:
I20260709 12:21:37.411587  8065 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.411722  8070 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.407516  9634 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.409822  8217 rpcz_store.cc:276] 0709 12:21:36.402083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.402667 (+   584us) service_pool.cc:224] Handling call
0709 12:21:36.402915 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.256024 (+853109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.404372 (+148348us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:37.404602 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813005568}
I20260709 12:21:37.415446  9586 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.415984  9586 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.419627  9666 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:37.420965  9637 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.421296  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.421533  9666 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.421651  9637 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.423650  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.424356  8062 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.420982  9586 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.425606  9586 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.425998  9666 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:37.429700  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.429957  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:37.430255  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.430770  8069 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:37.431028  8067 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.432600  9634 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.434532  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.434442  9597 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.435424  8065 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.435961  9597 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.436394  9597 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:37.437003  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.437060  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.438166  8070 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.438616  9641 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.440017  9552 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.440169  9700 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.440613  9552 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.440789  9700 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.440932  9684 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.442327  9684 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.442099  9552 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.442775  9684 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.443357  9700 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.446573  9641 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.448698  9696 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.449227  9696 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:37.434587  9602 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.450678  9634 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:37.450502  9696 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.444329  9684 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.452049  9680 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.452487  9680 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:37.452663  9696 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.453789  9680 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.454023  9597 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.455510  9597 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.429204  9637 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.457439  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.452989  9684 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.459272  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.460362  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.461633  8143 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:37.477362  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.462836  9604 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:37.483755  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69524us
I20260709 12:21:37.471820  9680 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.475060  9552 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:37.487308  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.486330  8064 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:37.493007  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.486135  8211 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.503525  8067 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:37.506016  8062 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:37.504616  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.509668  8759 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:37.497394  9570 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.502185  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.515733  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.516542  8064 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:21:37.512563  9570 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.518630  8070 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:37.515796  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.523679  9604 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.524734  8061 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.526521  8063 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:37.527456  8757 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:37.533389  8065 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:37.533764  8070 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:37.535439  8062 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:21:37.538393  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.538164  9609 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.539678  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.514763  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.567770  9609 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.569058  9700 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:37.569720  9700 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.570835  9700 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:37.571679  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.572602  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.577569  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.577899  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.578639  9550 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:37.573436  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73693.2us
I20260709 12:21:37.526948  8215 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.585605  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.586781  9634 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:37.588775  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.582589  8142 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:21:37.592242  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.595525  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.596174  9550 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.587881  9634 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.610929  8062 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:37.551785  9593 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:21:37.629933  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.631191  8142 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:37.634402  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.650703  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65237.2us
I20260709 12:21:37.651535  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.659250  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.671720  8065 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:37.679260  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.683916  8142 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:37.686410  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:37.669591  9550 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:37.693472  8759 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:37.694657  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.695393  8137 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.695526  9545 raft_consensus.cc:993] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:37.696139  9545 raft_consensus.cc:1081] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:21:37.696744  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.697443  8139 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.690863  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.691862  8143 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.708079  8137 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:37.709995  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.708110  9570 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:37.711397  9664 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.004s
I20260709 12:21:37.711844  9664 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.713429  8212 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:37.713305  9689 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.714181  9664 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.714807  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2326) took 1034 ms. Trace:
I20260709 12:21:37.715229  8212 rpcz_store.cc:276] 0709 12:21:36.680859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.089282 (+408423us) service_pool.cc:224] Handling call
0709 12:21:37.089512 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.713877 (+624365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.714551 (+   674us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000e6d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:37.714753 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434121600}
I20260709 12:21:37.711869  9570 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.718037  9570 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:37.718199  9640 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:37.718923  9640 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.719312  9570 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.720662  9570 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.722935  9634 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.726398  9640 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.726965  9709 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.727613  9709 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.730526  9709 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.731056  9709 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.731499  9709 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.737826  8143 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.686638  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:37.757023  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.759065  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.763669  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.763960  8065 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:37.760288  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.764403  8219 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.737897  9543 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.768563  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:37.778993  8212 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.788733  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.789717  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:37.779570  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91950.9us
W20260709 12:21:37.791540  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 242327us
I20260709 12:21:37.799198  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.775563  9604 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.803297  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:37.788806  8140 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:37.803766  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:37.762559  9684 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:21:37.798897  9700 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:37.821323  9422 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:21:37.838557  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:37.839053  9664 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:37.840022  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:37.844763  9670 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.845356  9670 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:37.845222  9578 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.009s
I20260709 12:21:37.819887  9619 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:37.826356  9640 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.832463  8757 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:37.865783  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.867542  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68414.5us
I20260709 12:21:37.847607  9634 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.856138  9689 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.829114  9571 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:37.871343  9634 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.859863  9700 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.892745  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:37.892920  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:37.893230  8758 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
W20260709 12:21:37.894461  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 103126us
I20260709 12:21:37.868331  9550 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:37.906021  8063 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:37.908865  9709 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.904403  9670 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.905190  9545 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:37.913463  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.907732  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:37.918839  9711 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:37.919399  9711 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.919816  9711 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:37.921021  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:37.921653  8142 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:37.911564  9550 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:37.925618  9634 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.926518  9550 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:37.928821  9706 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:21:37.929613  9704 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 12:21:37.930574  9707 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:21:37.933732  9700 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.928610  9619 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:37.937419  9619 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.946144  9637 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:37.946826  9637 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:37.950203  9689 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:37.948951  7967 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:37.950820  9689 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.951810  7967 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:21:37.953208  7967 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:37.958914  9701 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:21:37.960059  9597 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.960608  9597 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.962061  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.962626  9597 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:37.963201  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.965209  9593 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.965400  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:37.915791  9571 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:37.966017  9593 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:37.958645  7967 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:37.967258  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:37.967741  9571 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:37.948246  9637 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:37.972653  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.968493  9593 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:37.969578  7967 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.913429  9545 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:37.984467  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66039.1us
W20260709 12:21:37.986269  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78664.4us
W20260709 12:21:37.987440  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 183755us
I20260709 12:21:37.989101  8066 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:37.997128  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:37.991200  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:37.968442  9571 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.006388  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.008206  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:37.990703  9684 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:38.005276  9634 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.010428  7967 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:21:38.019954  9593 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.020872  9593 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:38.021974  9593 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.026885  9637 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.027693  9545 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.010157  9709 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:38.029584  8110 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.069s (SENT)
W20260709 12:21:38.030009  9708 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.313s	user 0.000s	sys 0.004s
W20260709 12:21:38.030848  8110 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.149s (SENT)
I20260709 12:21:38.031230  9545 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:38.031293  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:38.032253  9696 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:38.031980  9545 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.036137  9545 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.032393  9619 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:38.036828  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45754.4us
I20260709 12:21:38.037686  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.038497  9696 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.038704  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.039153  9696 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:38.039566  9586 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.040100  9586 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:38.041062  9586 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.040184  9696 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.044778  9571 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:38.046283  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.023442  9640 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.023856  9712 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.023980  9597 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:38.050518  9712 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.054364  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.054612  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.055348  8064 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.055371  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:38.055819  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 220846us
I20260709 12:21:38.056869  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.022895  7967 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.055485  8062 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 2: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:38.059345  8063 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:38.060884  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.061239  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.061880  8067 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.024391  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.013866  9634 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.062664  9634 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.064016  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.025235  9684 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:38.065114  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.065730  8141 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.066026  8061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:21:38.065827  9684 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.067684  8062 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:38.067696  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.069355  8142 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:38.070472  9619 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.071005  9619 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.073136  9712 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.073941  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.074128  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.066630  8061 raft_consensus.cc:606] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:38.074756  8140 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:38.075071  8061 raft_consensus.cc:614] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:38.077625  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.071936  9602 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:38.085183  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.085994  8066 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:38.088438  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.091094  9619 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.091645  9619 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.097172  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.097992  8066 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:38.100363  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:38.109350  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.076812  7967 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:21:38.137276  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 88112.1us
I20260709 12:21:38.092105  9619 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:38.141506  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 122525us
W20260709 12:21:38.147675  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 123361us
I20260709 12:21:38.144305  8064 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:38.149181  8065 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:38.156847  8067 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.141484  7967 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:38.169891  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 77211us
I20260709 12:21:38.168784  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.191727  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:38.201555  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 102037us
I20260709 12:21:38.145697  9571 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.202630  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.141090  9597 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:38.206176  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67865.9us
I20260709 12:21:38.212930  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.214735  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.215591  8765 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
W20260709 12:21:38.203150  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45182.1us
I20260709 12:21:38.217317  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.212249  7967 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.157346  9712 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.170099  9545 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.224489  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 79342.4us
I20260709 12:21:38.226514  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.228641  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.235785  8219 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.141331  9711 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.157542  9689 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.250578  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:38.251276  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:38.251765  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.249465  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:38.252209  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.170274  9604 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:21:38.249396  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.240443  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.254885  9693 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.255435  9693 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:38.255561  8140 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.256170  9693 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.212381  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.262122  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:38.251299  8146 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:38.212378  9700 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:38.193475  9666 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:21:38.221186  9712 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.263149  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:38.263911  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.274938  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:38.264824  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.255360  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:38.241255  9640 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.292817  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.274420  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.262012  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.300545  8143 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:38.265185  9552 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.282375  9712 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:38.293557  9680 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.000s
W20260709 12:21:38.336998  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.296438  9689 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:38.300459  9666 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.300928  9684 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:38.282336  8061 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.313164  9637 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.293197  8144 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:38.263593  9545 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.296950  9640 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:38.404507  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 153879us
I20260709 12:21:38.377310  9689 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:38.410346  9744 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.410615  9689 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.411216  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:38.411816  9619 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:38.412982  9715 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:21:38.413753  9684 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:38.414960  9726 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:38.415644  9726 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.370808  8215 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:38.392599  9666 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:38.409529  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 172870us
I20260709 12:21:38.325932  9552 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.425271  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.425539  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.402130  9593 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.406430  9422 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:38.426172  8070 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:38.427124  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:38.423753  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.428987  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.431808  9725 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.434132  9725 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.434527  9725 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.435340  8143 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:38.435837  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.438161  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.325421  9700 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.442888  9422 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.443012  8067 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.443462  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.443874  9709 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:38.426693  9666 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.410512  9637 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.426440  9619 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.456218  9641 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:38.401044  9597 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.441943  9680 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.465075  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.447016  9550 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.438755  8061 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 1.
I20260709 12:21:38.476235  8143 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:38.485199  9737 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:21:38.485054  9422 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.486850  9743 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:21:38.494083  8070 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:21:38.497056  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 140517us
I20260709 12:21:38.497968  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:38.518818  8218 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:38.519053  9738 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.519508  9738 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.519881  9738 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.520452  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.522027  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.522775  8218 raft_consensus.cc:2376] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3. Re-sending same reply.
I20260709 12:21:38.523718  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.472056  9711 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.524487  8218 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:38.494158  9543 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.004s
I20260709 12:21:38.541066  9640 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.541600  9727 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.543546  9670 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:38.544016  9670 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.492841  9680 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.545123  9634 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.546830  9680 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.547539  9634 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.547753  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.482555  9619 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.549238  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.550784  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.551677  8215 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.553062  9670 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.553900  9637 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.554652  9670 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.561394  9723 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:38.562114  9723 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.563380  9552 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:38.564327  8211 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.051s	user 0.009s	sys 0.005s
I20260709 12:21:38.565059  8211 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:38.565774  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 154) took 1770 ms. Trace:
I20260709 12:21:38.568028  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:38.555724  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.566123  8211 rpcz_store.cc:276] 0709 12:21:36.795734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.289782 (+494048us) service_pool.cc:224] Handling call
0709 12:21:37.290451 (+   669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.565451 (+1275000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.565710 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:38.569445  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:38.570230  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.570815  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.571540  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.571918  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.572336  8756 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:38.572675  8757 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.572976  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.573722  8765 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:38.573642  9750 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.574266  9750 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.574672  9750 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.574935  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:38.577730  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 152690us
I20260709 12:21:38.578922  8761 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:38.588260  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.577129  9543 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.596320  8211 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:38.623427  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 323724us
W20260709 12:21:38.624655  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 178773us
I20260709 12:21:38.493520  9550 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.613088  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.642400  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:38.642903  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51173us
I20260709 12:21:38.637684  8064 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:38.638808  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.640071  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.647341  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.651401  8765 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:38.652956  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.653663  9747 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.654074  9730 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.663504  8759 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:38.663681  9730 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:38.663641  9666 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.664417  9730 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.667963  9725 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.659011  9689 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.660228  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.649708  9726 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.652127  9637 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:38.676837  8211 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.677400  9723 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.677897  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.677918  9701 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:21:38.676535  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.679893  8765 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:38.680833  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:38.681361  8212 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.681721  8212 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.682040  9689 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.669966  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:38.682552  8212 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.683897  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.684092  9701 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:38.684825  9680 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.685382  9680 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.668354  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:38.685760  9680 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.686061  8765 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:38.686609  9570 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:38.686995  9570 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.687395  9722 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:38.687798  9722 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.688195  9722 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.689465  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:38.675820  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:38.645421  9738 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.678591  8211 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.663498  9747 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:38.684875  9634 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.671275  9729 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.689551  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.691634  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.670641  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.693506  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:38.702145  8761 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:38.693940  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.693935  8758 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:38.703047  8219 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.704017  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.705157  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.706151  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.707161  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.707825  8219 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.694459  8757 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.675454  8216 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:38.698232  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.708532  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.710065  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.687942  9570 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.711515  8066 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.713119  9738 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.713943  8070 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:38.714759  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.710222  9641 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:38.713789  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.716979  8062 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:38.716115  9641 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.718426  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:38.717711  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.701545  8214 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:38.701082  9747 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.723865  8068 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.724435  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.725101  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:38.726127  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.648854  9709 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:21:38.729784  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.730304  8214 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:38.700981  9634 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.731757  8219 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.731719  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.733428  9634 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:38.734129  9756 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:38.736096  8757 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.736937  9757 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.737576  9693 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.739642  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.740023  9693 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.729038  9729 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.742076  9748 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.742244  9709 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:38.743033  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.743242  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.737530  9757 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.726938  9550 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.762796  8211 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:38.732375  9738 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.752558  9757 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.752791  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:38.752828  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:38.753434  8759 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.745582  9570 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.753803  9712 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.745042  9711 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:21:38.786731  9759 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.787286  9759 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:38.788849  8762 raft_consensus.cc:2368] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4.
I20260709 12:21:38.788475  9759 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.754783  8218 raft_consensus.cc:2376] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2. Re-sending same reply.
I20260709 12:21:38.790674  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.791859  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.755506  9725 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.757938  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.758446  9723 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:38.796101  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1084) took 1337 ms. Trace:
I20260709 12:21:38.796824  9723 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.761783  9748 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.761933  9641 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.763213  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.752075  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.749655  9666 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.729138  8061 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:38.818092  8219 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.818346  9735 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:38.765106  9634 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.818941  9571 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:38.820124  9571 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.817903  8211 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.820921  9659 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.821297  9659 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.821601  8214 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.822268  8211 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:38.822348  9659 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.823083  8214 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:38.823828  9659 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.767172  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.819695  9735 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:38.765151  9722 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.752293  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.759408  9680 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.825158  9736 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:38.826328  9736 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.826664  9736 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.826747  9680 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.806248  8215 raft_consensus.cc:2410] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:38.820554  9571 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.796875  8144 rpcz_store.cc:276] 0709 12:21:37.458793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.458938 (+   145us) service_pool.cc:224] Handling call
0709 12:21:38.795795 (+1336857us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54002f1a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:38.795959 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774147968}
I20260709 12:21:38.826766  9722 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.827653  9736 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.807152  9729 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.807312  9723 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:38.807560  9730 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.808123  9619 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.783217  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.810494  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.816185  9747 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.783380  9550 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:38.830617  8065 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:38.835405  9550 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.835855  9550 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.836730  9747 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.837978  9619 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:38.840319  9744 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.828688  9571 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.840809  9744 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:38.841506  9571 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.843104  9545 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.844834  8211 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:38.831179  9721 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:38.790678  9664 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.816440  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.846302  9664 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.847448  8220 raft_consensus.cc:2376] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2. Re-sending same reply.
I20260709 12:21:38.848109  9666 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.848853  9721 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.848675  9666 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.847888  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.849510  9721 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.850203  9422 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:38.850970  9666 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.850589  9721 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.853960  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.854884  8213 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.855621  8756 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 3. Ops: []
I20260709 12:21:38.855829  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.857167  8216 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.857961  8765 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.858569  9634 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:38.860258  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.860378  9712 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.861125  9422 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:38.824506  8214 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:38.866544  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.818868  8219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "273de299acf94214b44aab4591da9b3a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:21:38.868643  8219 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.869000  8219 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.869357  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:38.870016  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.802210  9759 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.871941  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.872704  8141 raft_consensus.cc:2368] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3.
I20260709 12:21:38.871017  8142 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:38.862053  9570 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:38.883606  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.887673  8145 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.856419  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.889732  8220 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.874594  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.874815  9736 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.874902  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.875396  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.882611  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.883335  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:38.883606  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:38.833015  8218 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:38.884021  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:38.834920  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:38.924705  8213 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.935680  8146 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.919505  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.927310  8212 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.912340  9700 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:38.926015  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53329.3us
I20260709 12:21:38.910674  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:38.938622  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.939272  8141 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:38.910807  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:38.830813  9748 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.900475  8139 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:38.942660  8756 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:38.921427  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.924654  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.944307  8143 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:38.944736  9700 raft_consensus.cc:2764] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:38.884892  9570 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:38.945503  8219 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.946177  9570 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:38.947309  9570 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.834992  9750 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:38.951956  9750 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.832427  9730 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.953881  8213 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
W20260709 12:21:38.893067  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.944298  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.960232  8146 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:38.962462  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.963630  8213 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:38.963696  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.965126  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:21:38.959885  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68125us
W20260709 12:21:38.965628  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.969154  9750 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:38.935783  8140 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:38.970079  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.989084  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:38.971638  8141 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.975548  8763 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:38.966909  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:38.942998  9748 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:38.987677  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:38.995615  8139 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
W20260709 12:21:38.987986  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43759us
I20260709 12:21:38.992342  8218 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:38.906124  9552 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:38.997339  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.004576  8219 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.005851  8036 leader_election.cc:400] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3.
I20260709 12:21:39.007740  8036 leader_election.cc:403] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:39.008708  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:39.005301  8145 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:39.010538  9749 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.012094  8212 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:39.012903  9748 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:39.013487  9748 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.013928  9748 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.038821  9725 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.039628  9725 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.006644  9700 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.006821  9726 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:39.006863  8146 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:39.043315  9725 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:38.993098  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.006974  9552 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:39.045127  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52157.8us
I20260709 12:21:39.004920  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:39.047220  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:39.046149  8217 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.052692  9725 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:39.053699  9725 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.053069  9552 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.054646  9552 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:39.044198  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:39.056334  9726 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:39.006165  9750 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.057057  9726 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.059084  9726 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.062377  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.067055  9700 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.067775  9700 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.069031  9700 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.070235  8217 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.079991  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.081300  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.081913  8144 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:39.082700  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.004837  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.084789  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.085242  8140 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:39.085599  8143 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:39.087742  8143 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:39.088603  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.089184  8139 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:39.089448  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92191.1us
I20260709 12:21:39.090193  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:39.091962  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.092455  9664 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.001030  8213 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:38.994613  9659 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.001991  9740 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:39.002067  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:39.002835  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64311.9us
I20260709 12:21:39.003839  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:39.085517  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89773.7us
I20260709 12:21:39.113106  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.114122  8142 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.100100  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:38.998421  8220 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.097316  8218 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.097074  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.118350  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:39.118420  8212 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:39.118538  8138 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:39.119069  8217 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.119022  8212 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:39.120056  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 57772.5us
W20260709 12:21:39.119544  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 430110us
I20260709 12:21:39.124395  8139 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.118433  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.124684  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:39.120987  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.113312  9744 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.113011  9664 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:39.100286  9738 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.113097  9727 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:21:39.059175  9750 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.113189  9545 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:39.125267  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.136117  8143 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:39.166337  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.032188  9749 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3.
I20260709 12:21:39.149506  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.125703  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.175710  8145 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:39.175920  8213 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:39.150352  8212 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.156780  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.137130  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.130209  8139 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:39.177003  8212 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.135143  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.100097  9730 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.151805  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.173662  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:39.168917  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.118113  9637 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.177975  8141 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:39.181131  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.185968  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.054821  9725 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.183949  9543 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:39.187940  9543 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.187973  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.188822  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.187322  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:39.189412  8139 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.185747  8140 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.187343  9747 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:39.192641  9747 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.167904  9422 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.193017  9747 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.195649  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:39.183981  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66640.9us
W20260709 12:21:39.186825  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 59836.9us
W20260709 12:21:39.175625  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54735.8us
I20260709 12:21:39.198153  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.198712  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:39.179360  8142 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.180611  8138 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.189909  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.199841  8143 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.188436  9543 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.138624  9744 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.218523  9755 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:21:39.222326  8139 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.223134  9689 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.223578  9727 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:39.152797  9745 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.251183  9727 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.251448  9745 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.252089  9727 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.253350  9727 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.253566  9745 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.223749  9747 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.224934  9680 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:39.225037  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.168004  9664 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:39.227324  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.231643  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.231920  9543 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.271035  9765 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:39.266191  9422 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.154515  9719 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.237310  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.153187  9760 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:21:39.240024  8143 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.179697  9712 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.274166  9604 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:39.274403  9712 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.274784  9543 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.274749  9604 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.275624  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.239620  8138 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.180243  9759 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.226681  9701 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:39.274446  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:39.277324  9701 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.277115  9759 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.278012  9763 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.278362  9701 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.258553  9747 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.279392  9759 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.260339  9680 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.279699  9712 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.281327  9738 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.281683  9680 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.261559  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.282544  8139 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:39.261313  9552 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:39.286022  9552 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.189225  9609 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:39.286669  9609 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.287182  9609 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.286455  9664 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.194525  9550 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.184263  9634 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:39.289875  9634 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.290392  9634 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.290831  9550 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.213239  9637 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.293387  9422 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:39.293494  9637 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.296959  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.297724  8146 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:39.264429  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107861us
I20260709 12:21:39.300925  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.301923  8213 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:39.286479  9552 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:39.266808  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69396.1us
I20260709 12:21:39.306313  9765 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:39.271519  8140 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:39.276369  9543 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:39.250088  8217 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:39.307366  9765 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:39.308349  9765 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:39.309224  9765 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:39.309772  9760 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:39.308758  9763 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:39.310523  9763 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:39.310649  9619 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:39.283337  8219 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:39.309813  9543 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.125763  9740 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:39.311062  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 113024us
I20260709 12:21:39.313419  8212 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:39.320195  8146 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:39.319984  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:39.320906  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:39.160665  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.322881  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.311069  9619 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.323634  9719 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.323921  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:39.324151  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.324198  9619 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.324615  9719 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.325532  9619 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.326092  8143 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:39.326722  9763 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.327591  8065 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:39.327754  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:39.328014  9763 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.322453  9543 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.327118  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.333006  9543 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.323662  9760 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.333866  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.334024  9760 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.334522  8143 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:39.335577  9740 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.336045  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.336257  9760 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.310010  9765 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.337743  9765 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.338816  8141 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:39.339485  8139 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:39.340709  8138 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:39.315073  9550 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.345716  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.345662  9550 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.346452  8065 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.345749  9736 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:39.348402  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.349246  9736 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.349128  9570 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.348729  9550 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.354084  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.361016  8061 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.361760  9738 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.362747  9634 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.354422  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.355329  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:39.357574  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.365049  8062 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.358599  9755 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:39.365826  9755 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:39.366029  8762 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:39.366132  9755 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.366775  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.367328  9422 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.367972  9609 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.368845  8140 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
W20260709 12:21:39.323359  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 162820us
W20260709 12:21:39.380649  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44686.8us
I20260709 12:21:39.383790  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.381781  8062 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:39.388433  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.390161  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.390456  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.381656  9586 raft_consensus.cc:2764] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:21:39.392851  9736 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:39.393488  9736 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:39.393925  8061 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:39.393873  9570 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.394375  9736 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.395754  9755 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.392346  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.396932  9744 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.406662  9744 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.407078  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:39.408571  9619 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:39.409008  9744 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.409173  9738 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:39.406698  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:39.389170  8212 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:39.410583  8763 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:39.417771  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 97892.3us
I20260709 12:21:39.419219  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.412096  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.422125  8110 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:39.422428  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:39.422946  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.423713  9680 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.424443  9680 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.425025  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.425426  9680 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.426460  9604 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.427030  9604 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.427445  9604 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.430835  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.423647  9755 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.431489  8062 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:39.431640  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:39.433401  8110 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.509s (SENT)
I20260709 12:21:39.433504  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:39.434259  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.434950  8065 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
W20260709 12:21:39.410439  9735 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 12:21:39.385070  9760 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:39.387113  9550 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.435951  9745 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.452994  8065 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:39.454106  8070 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.447685  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.417985  9659 raft_consensus.cc:2764] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:21:39.449116  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.451017  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.457422  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.459875  9571 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:39.461902  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.463732  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.464744  8212 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:39.465893  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.429024  9619 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.445029  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.443068  9578 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:39.476205  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:39.478209  8220 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:39.442937  9586 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.479746  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:39.479872  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46491.1us
I20260709 12:21:39.449306  9689 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:39.449474  9749 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.446221  9760 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.441527  9744 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:21:39.505264  8765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.018s	sys 0.035s
W20260709 12:21:39.506220  8765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.035s
I20260709 12:21:39.494732  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.507171  8213 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:39.495890  8217 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:39.455179  9740 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:39.488783  8762 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:39.498844  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.509779  8065 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:39.442543  9747 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:21:39.505991  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:39.464104  8759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.016s	sys 0.027s
I20260709 12:21:39.482592  9578 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.480451  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:39.522183  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.526573  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.527338  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:39.537088  8139 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:39.476981  9634 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.428436  9604 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:39.503561  9761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.068s	sys 0.093s
W20260709 12:21:39.564477  9761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.068s	sys 0.094s
I20260709 12:21:39.384899  9609 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.563442  8757 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:39.538136  8759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.016s	sys 0.027s
I20260709 12:21:39.565012  9619 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.569180  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.570250  8762 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:39.505263  9760 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.572537  8146 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.492138  9422 raft_consensus.cc:2764] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:21:39.491484  9666 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:39.561645  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.562992  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.563800  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.593523  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.599879  8212 raft_consensus.cc:2410] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:39.466141  9550 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:39.600740  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.470111  9745 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.477355  9552 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:39.578676  9748 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 12:21:39.605733  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:39.598580  9634 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:39.613014  9634 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.613125  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.614853  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.615484  9745 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.615958  8061 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:39.593856  9740 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.616942  9740 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.596510  9666 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.618023  9666 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.618294  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.619079  9740 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:39.559762  9578 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.620934  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:39.622452  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.627331  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:39.628059  8065 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:39.628412  8065 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:39.629951  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:39.647208  8066 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:39.658195  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.626893  9545 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.654078  8065 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.560684  9593 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:39.512346  9749 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.670442  8065 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.651878  9659 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:39.630797  9748 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.669096  9545 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.636826  9609 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:39.682399  9765 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:39.700733  8066 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:39.699232  8146 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:39.705798  8069 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:39.695977  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.709316  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.709609  9422 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:39.710076  9422 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:39.710783  9422 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.711915  9422 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.680855  9593 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:39.688025  9659 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:39.704285  9760 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.729359  9763 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.729961  9763 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.731424  9749 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.734790  9422 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:39.735580  9552 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.736209  9763 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.724828  9659 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.743857  9593 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.744459  9748 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:39.707800  9765 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.712481  8066 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:39.748688  8216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.010s	sys 0.014s
W20260709 12:21:39.753975  8216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.014s
I20260709 12:21:39.742671  9550 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.809629  8065 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
W20260709 12:21:39.818724  9543 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:21:39.753412  9578 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:39.831297  9545 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:39.845769  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.837818  9765 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:39.859562  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.863714  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.864486  8139 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:39.868084  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.879030  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 229) took 1012 ms. Trace:
I20260709 12:21:39.879459  8765 rpcz_store.cc:276] 0709 12:21:38.866997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.867236 (+   239us) service_pool.cc:224] Handling call
0709 12:21:38.869036 (+  1800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.869448 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.869478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.869957 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.506931 (+636974us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:39.506974 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.507032 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.878821 (+371789us) raft_consensus.cc:1685] finished
0709 12:21:39.878842 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.878963 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2299,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1120,"thread_start_us":636560,"threads_started":1,"wal-append.queue_time_us":1006964}
W20260709 12:21:39.875272  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.885324  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.892894  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:39.893841  8145 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:39.895815  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:39.896724  8142 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
W20260709 12:21:39.869081  9750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.010s	sys 0.025s
W20260709 12:21:39.884171  9684 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.014s	sys 0.024s
W20260709 12:21:39.926695  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 492179us
I20260709 12:21:39.911957  8139 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:21:39.950549  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 469817us
W20260709 12:21:39.951511  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.609s (SENT)
W20260709 12:21:39.952728  8110 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.709s (SENT)
I20260709 12:21:39.953253  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:39.954059  8067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.016s	sys 0.021s
W20260709 12:21:39.954547  8067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.016s	sys 0.021s
I20260709 12:21:39.956772  8063 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:21:39.959357  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 432099us
I20260709 12:21:39.961831  8219 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:39.972862  9659 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.973690  9789 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.973623  9659 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:39.974416  9789 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:39.887437  9721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.007s	sys 0.023s
W20260709 12:21:39.979635  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.008s
W20260709 12:21:39.980088  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.009s	sys 0.008s
I20260709 12:21:39.980096  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:39.980899  9739 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:39.983314  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.008s
W20260709 12:21:39.986863  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.011s	sys 0.008s
W20260709 12:21:39.905359  9750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.011s	sys 0.025s
I20260709 12:21:39.985667  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:39.986364  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.892112  9709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.014s	sys 0.057s
W20260709 12:21:39.987797  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 538725us
W20260709 12:21:39.904325  8144 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.034s
I20260709 12:21:39.991300  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:39.908779  9712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.009s	sys 0.031s
I20260709 12:21:39.991703  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:39.919203  9684 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.014s	sys 0.024s
I20260709 12:21:39.994125  8220 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:40.006053  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:39.976826  9637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.015s	sys 0.020s
W20260709 12:21:39.908723  9700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.013s	sys 0.016s
W20260709 12:21:39.983675  9726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.018s	sys 0.045s
W20260709 12:21:40.066668  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 113969us
W20260709 12:21:40.005082  8144 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.006s	sys 0.035s
I20260709 12:21:40.009274  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:40.010617  8217 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:39.910637  9760 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:39.990769  9725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.007s
W20260709 12:21:39.987250  9721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.008s	sys 0.023s
W20260709 12:21:40.009557  9637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.015s	sys 0.021s
I20260709 12:21:40.060235  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:39.994747  9709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.017s	sys 0.057s
I20260709 12:21:40.061864  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:40.062877  9755 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.000s
W20260709 12:21:40.063092  9781 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:21:40.063531  8213 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:21:40.063966  8211 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:39.996515  9712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.009s	sys 0.032s
W20260709 12:21:40.067503  8110 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.791s (SENT)
I20260709 12:21:40.068212  8761 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:40.006665  8220 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.070560  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.004179  9748 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.121563  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:39.911327  9664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.026s	sys 0.038s
I20260709 12:21:40.109122  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:40.064945  9726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.018s	sys 0.046s
I20260709 12:21:40.064918  9659 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:40.110682  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50542.2us
W20260709 12:21:40.060233  9700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.013s	sys 0.017s
I20260709 12:21:40.004616  9604 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:21:40.115171  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:40.105993  9725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.003s	sys 0.008s
I20260709 12:21:40.113447  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:40.117162  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:40.065094  9689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.040s	sys 0.055s
I20260709 12:21:39.995915  9786 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:40.130136  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:40.120179  9759 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:40.133040  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:40.134020  9552 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:40.131099  9748 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.145742  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:40.146745  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:40.136677  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66183.6us
W20260709 12:21:40.135661  9689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.040s	sys 0.055s
W20260709 12:21:40.123008  9664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.026s	sys 0.045s
I20260709 12:21:40.151983  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.134160  8760 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:40.119308  9578 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:40.066920  9749 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:21:40.143328  8217 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:40.144344  8220 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:40.148770  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:40.135300  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:40.149237  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81769.1us
I20260709 12:21:40.150498  9765 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.150151  9586 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:40.213234  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.214356  8070 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
W20260709 12:21:40.236884  8061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.005s
I20260709 12:21:40.146625  8215 raft_consensus.cc:2368] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:40.158710  8145 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:40.150942  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:40.142663  9726 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.150067  9768 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:40.164561  8213 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
W20260709 12:21:40.164736  8110 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.799s (SENT)
I20260709 12:21:40.260383  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:40.136291  9763 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.165180  9659 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.160871  9609 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:40.166175  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.151440  9689 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:40.165555  8217 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:40.183872  8068 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:40.186455  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:40.238332  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.245364  9422 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.173903  9739 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:40.165735  9786 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:40.170239  9748 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:40.198271  9700 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:40.198508  9586 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.142740  9759 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:40.248620  9666 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.001s
I20260709 12:21:40.266731  9422 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.259788  9787 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:21:40.268225  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 121081us
I20260709 12:21:40.250272  9736 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.165023  9789 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.269371  9739 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.311339  9422 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:40.261811  8061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.005s
I20260709 12:21:40.290942  9609 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:40.244833  9545 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:40.297973  9586 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.295588  9748 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:40.307662  9775 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 12:21:40.332701  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167991us
I20260709 12:21:40.300499  9759 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:40.310303  9785 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:21:40.328315  9786 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:40.330065  9806 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:21:40.330892  9797 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:40.331727  9684 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.332072  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 156) took 1006 ms. Trace:
I20260709 12:21:40.304545  9666 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:40.347957  8110 leader_election.cc:336] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.872s (SENT)
I20260709 12:21:40.375826  8184 leader_election.cc:400] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4.
I20260709 12:21:40.353670  9759 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.354365  9680 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:40.380836  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 214731us
I20260709 12:21:40.346422  9739 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:40.352398  9802 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 12:21:40.372107  8063 rpcz_store.cc:276] 0709 12:21:39.325638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.325736 (+    98us) service_pool.cc:224] Handling call
0709 12:21:39.326020 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.957230 (+631210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.331795 (+374565us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400321ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:40.332008 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449923456}
I20260709 12:21:40.313277  9664 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:21:40.337674  9789 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.324383  9552 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:40.383072  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 208795us
I20260709 12:21:40.384080  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:40.405411  8763 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:40.341024  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 248) took 1199 ms. Trace:
I20260709 12:21:40.314774  9736 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.389081  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.382802  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.323282  9634 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.401526  8143 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:40.332316  9545 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.405877  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:40.406246  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:40.400486  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66803.1us
W20260709 12:21:40.425839  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.888s (SENT)
I20260709 12:21:40.380275  9768 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:40.429230  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 173) took 1576 ms. Trace:
I20260709 12:21:40.381699  9680 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:40.425033  8217 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:40.404855  9719 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:40.433557  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 163) took 1074 ms. Trace:
I20260709 12:21:40.429719  8216 rpcz_store.cc:276] 0709 12:21:38.852524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.859950 (+  7426us) service_pool.cc:224] Handling call
0709 12:21:38.860268 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:38.959085 (+ 98817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.959119 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:38.984747 (+ 25628us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.754560 (+769813us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:39.754619 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.754713 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.428989 (+674276us) raft_consensus.cc:1685] finished
0709 12:21:40.429011 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.429170 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32997,"raft.queue_time_us":100215,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16854,"thread_start_us":638439,"threads_started":1,"wal-append.queue_time_us":827920}
I20260709 12:21:40.435356  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.437557  9739 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:40.437737  9798 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.223s	user 0.004s	sys 0.000s
W20260709 12:21:40.438433  8110 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.908s (SENT)
I20260709 12:21:40.451812  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:40.433907  9768 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.431214  9740 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.454051  9422 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.454283  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2344) took 1020 ms. Trace:
I20260709 12:21:40.432788  9634 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.454711  8064 rpcz_store.cc:276] 0709 12:21:39.433893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.434017 (+   124us) service_pool.cc:224] Handling call
0709 12:21:39.465246 (+ 31229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.474401 (+  9155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.474454 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.494882 (+ 20428us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.983132 (+488250us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:39.983168 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.983231 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.437129 (+453898us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:21:40.452330 (+ 15201us) raft_consensus.cc:1685] finished
0709 12:21:40.452353 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.454220 (+  1867us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":16873,"spinlock_wait_cycles":11910528,"thread_start_us":406151,"threads_started":1,"wal-append.queue_time_us":563198}
I20260709 12:21:40.455885  9768 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.439960  9680 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.456375  9759 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.456979  9680 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:40.436357  8215 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:21:40.441664  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58975.1us
I20260709 12:21:40.450039  9749 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:40.453626  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.413532  9789 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.375175  9689 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.417817  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:40.428728  9684 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:40.464886  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.465003  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.467617  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.450685  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:40.475690  9811 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:21:40.433676  9570 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.456718  9719 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.431763  9578 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.431264  9721 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.447638  9712 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:40.495975  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.506953  8064 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:40.507014  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.497713  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.500105  9664 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:40.501590  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63184.6us
W20260709 12:21:40.503764  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.508188  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.509326  8758 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:40.426189  9609 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:40.510558  9814 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:40.496294  9768 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.528208  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 617) took 1176 ms. Trace:
I20260709 12:21:40.519263  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.517395  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:40.520126  9666 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.521826  9827 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:40.483095  9749 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.522796  9824 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:40.415711  8144 rpcz_store.cc:276] 0709 12:21:39.139536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.165362 (+ 25826us) service_pool.cc:224] Handling call
0709 12:21:39.194068 (+ 28706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.262499 (+ 68431us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:40.118352 (+855853us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.302720 (+184368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.310092 (+  7372us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:40.313488 (+  3396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.323673 (+ 10185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.338778 (+ 15105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":686962,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":33065,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":999116,"threads_started":2,"wal-append.queue_time_us":313426}
I20260709 12:21:40.506161  9570 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:40.524083  8110 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.909s (SENT)
I20260709 12:21:40.551501  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:40.524268  9664 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:40.512814  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.525007  9619 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:40.525373  9795 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:40.525763  9545 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.528188  9789 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.496493  9684 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:40.545270  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.530241  8761 rpcz_store.cc:276] 0709 12:21:39.352014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.354504 (+  2490us) service_pool.cc:224] Handling call
0709 12:21:39.354853 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.123186 (+768333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.527954 (+404768us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54005f0fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:40.528127 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640135424}
I20260709 12:21:40.523687  8760 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:40.550401  9740 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.517294  9712 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.524044  9586 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.554605  9739 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:40.515159  9700 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.514055  9578 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.574819  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.575508  8069 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:40.576264  9578 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.513919  9721 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.576591  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.576794  9813 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:40.577239  8069 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:40.577301  9813 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.578167  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:40.581259  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:40.582638  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:40.582953  9809 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:21:40.583348  8137 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:40.584141  9586 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.566996  9422 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.557405  9666 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.572751  9739 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.567731  9684 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:40.646708  8145 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:40.652819  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:40.655930  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152826us
I20260709 12:21:40.660595  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:40.654668  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:40.568293  9664 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:40.570322  9736 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:40.672603  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1040) took 1199 ms. Trace:
W20260709 12:21:40.676374  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152303us
I20260709 12:21:40.679821  9422 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.680351  9422 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.677143  8218 rpcz_store.cc:276] 0709 12:21:39.473661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.473767 (+   106us) service_pool.cc:224] Handling call
0709 12:21:39.474073 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.594400 (+120327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.594455 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.599161 (+  4706us) log.cc:844] Serialized 26 byte log entry
0709 12:21:40.118905 (+519744us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:40.258123 (+139218us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.258374 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.585216 (+326842us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18003af240. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419
0709 12:21:40.672166 (+ 86950us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:40.672248 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.672313 (+    65us) raft_consensus.cc:1685] finished
0709 12:21:40.672333 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.672532 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50664,"prepare.queue_time_us":148204,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4803,"raft.queue_time_us":29813,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":10353,"spinlock_wait_cycles":210582144,"thread_start_us":580101,"threads_started":2,"wal-append.queue_time_us":572274}
I20260709 12:21:40.684286  8220 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:40.646093  9739 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.687288  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:40.648721  9768 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.555969  9827 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.694981  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:40.685253  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.987s (SENT) [suppressed 32 similar messages]
I20260709 12:21:40.698169  9570 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:40.699383  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 107189us
I20260709 12:21:40.699980  9760 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:40.700148  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:40.700476  9760 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:40.700938  9760 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.701223  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:40.694228  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:40.702518  8220 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:40.703711  9422 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:40.682559  9578 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:40.559456  9824 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.712626  9725 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:40.707605  9619 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:40.705287  9730 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:40.705196  9586 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.692235  9550 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.687371  9822 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:40.773057  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 206954us
I20260709 12:21:40.714130  9578 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.691018  9666 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:21:40.741274  9726 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:40.784961  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99721.6us
I20260709 12:21:40.807299  9422 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.808014  9422 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:40.809360  8110 leader_election.cc:336] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.990s (SENT)
I20260709 12:21:40.781833  9789 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.786654  9578 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:40.709640  9768 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.787533  9712 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.780396  9586 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.817703  9721 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:40.825014  9764 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.825568  9764 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.826498  9586 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.827067  9586 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:40.827685  9764 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.827543  9586 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.810747  8215 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:40.783108  9550 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.829511  9832 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:21:40.830228  9550 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.780699  9822 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.831010  9822 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:40.839066  9812 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:21:40.783195  9786 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:21:40.814191  9664 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.815394  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:40.853106  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.856150  8064 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:21:40.847621  9826 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:21:40.863719  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 239) took 1704 ms (client timeout 1737 ms). Trace:
I20260709 12:21:40.865885  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.448058  8067 rpcz_store.cc:276] 0709 12:21:39.355260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.355374 (+   114us) service_pool.cc:224] Handling call
0709 12:21:39.355668 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.381748 (+ 26080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.381777 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.390425 (+  8648us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.955041 (+564616us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:40.400884 (+445843us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.429432 (+ 28548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.429511 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:40.429551 (+    40us) raft_consensus.cc:1685] finished
0709 12:21:40.429561 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.429661 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53978,"prepare.queue_time_us":352789,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":56361,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":36768,"thread_start_us":1009517,"threads_started":2,"wal-append.queue_time_us":563232}
I20260709 12:21:40.837585  9749 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:40.846895  9422 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:40.837903  9719 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:40.853359  9828 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:21:40.894999  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.896009  8064 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:40.913877  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:40.897450  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 88133us
W20260709 12:21:40.917225  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.919191  9684 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.919788  8144 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:40.920990  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:40.921721  8143 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:40.922501  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:40.922605  9787 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.923108  8145 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:40.849375  9813 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.931648  8066 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:40.898447  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:40.898859  9586 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:40.887351  8756 rpcz_store.cc:269] 0709 12:21:39.159327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.167678 (+  8351us) service_pool.cc:224] Handling call
0709 12:21:40.863360 (+1695682us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54002f94d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:40.863581 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167516032}
I20260709 12:21:40.823396  9789 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:40.940243  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.873174  9824 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:40.905586  9760 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:40.859256  9664 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:40.888948  8063 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:40.936206  8067 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:40.937821  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:40.938715  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:40.952337  8143 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:21:40.959880  9788 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:21:40.962634  9664 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:40.971406  8066 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:21:40.978592  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 265489us
I20260709 12:21:40.979925  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:40.948462  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:40.994378  9749 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:40.994997  9749 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:40.969367  9765 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.977874  9822 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:41.057051  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60765.8us
W20260709 12:21:41.057894  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 109570us
I20260709 12:21:41.060917  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.062222  9422 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:41.063350  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.071118  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.080767  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.065277  9749 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:41.073271  9829 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.186s	user 0.002s	sys 0.003s
I20260709 12:21:41.110725  8069 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:41.111357  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 218851us
W20260709 12:21:41.077430  9680 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.003s
I20260709 12:21:41.114374  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.113094  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.083137  9571 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:41.074536  9760 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.123675  9666 consensus_queue.cc:1243] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:41.125690  9793 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:21:41.126233  9760 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.127120  9793 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:41.126796  9760 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.127517  9793 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:41.107151  9827 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.129185  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.069919  9765 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.125949  9664 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:41.083467  9725 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:21:41.113102  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.131044  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.115016  9609 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:41.085294  8137 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:41.128305  9793 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.133247  9684 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.143649  9721 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:41.124421  9593 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.154335  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.176656  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.132079  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.156560  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.157802  8141 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:41.158677  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:41.178218  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46221.1us
I20260709 12:21:41.178459  8217 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.121590  9619 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:41.123998  9571 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.179805  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.132922  9664 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.169533  8139 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:41.170862  9422 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.173834  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.174861  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.175035  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.185797  8213 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.186029  8214 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.176059  8138 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:41.177855  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.187351  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:41.180657  8219 raft_consensus.cc:2393] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:41.157367  9609 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.190141  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.147719  9570 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:41.179944  8757 raft_consensus.cc:2410] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:41.185595  9422 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.176707  9721 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.183172  9571 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.202593  9422 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:41.184269  9634 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:41.216707  8213 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:41.186558  9664 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:41.208148  8217 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
W20260709 12:21:41.208617  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 513628us
I20260709 12:21:41.195189  9609 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.191442  9789 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.195356  9793 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.224519  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.225083  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.232409  8217 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 2: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:41.233151  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.225329  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.225785  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.195654  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.206830  9721 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.180823  9739 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.244269  9836 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:41.244812  9834 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:21:41.235150  8139 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:41.246174  8211 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:41.246737  9570 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.247414  9844 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:41.251631  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.253618  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:41.207252  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.218422  9760 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.272562  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.196520  9725 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.276281  9854 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:41.283099  8139 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.258628  9789 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:41.273609  9570 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.287495  9854 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.279811  9659 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:41.271755  9836 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.289826  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.294926  8756 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:41.299605  9835 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:21:41.302826  9768 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.321979  9570 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.325132  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.305433  9836 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.344408  8139 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:41.278177  9619 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.272161  9578 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.329845  9765 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.293110  9789 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.348824  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.394112  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.394765  8137 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:41.363452  9721 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.277704  9844 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.364488  9803 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:21:41.373497  9768 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:41.401436  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.401600  9768 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.402169  8211 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.395773  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.406308  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.407116  8137 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:41.407124  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.408064  8213 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:41.409101  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:41.410012  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.380129  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1187) took 1893 ms. Trace:
I20260709 12:21:41.386340  9739 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.441108  9803 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.441766  9803 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.390515  9854 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:41.391278  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.457664  8211 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:41.390658  9571 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.465520  9735 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:41.466126  9735 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:41.369314  9849 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:21:41.394855  9578 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.396003  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:41.469064  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73148.4us
I20260709 12:21:41.469823  9730 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:41.470235  9730 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.470587  9730 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.470671  9739 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.471165  9739 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.409401  9749 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:41.476006  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67803us
I20260709 12:21:41.476226  8759 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:41.476961  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 245) took 1095 ms. Trace:
I20260709 12:21:41.414636  8213 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.477473  9844 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.479497  9739 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.467972  9571 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:41.481518  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.412714  8061 rpcz_store.cc:276] 0709 12:21:39.486684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.623484 (+136800us) service_pool.cc:224] Handling call
0709 12:21:39.623907 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.624202 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.624249 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.635617 (+ 11368us) log.cc:844] Serialized 26 byte log entry
0709 12:21:40.335320 (+699703us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:40.403319 (+ 67999us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.440911 (+ 37592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.453287 (+ 12376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:41.370112 (+916825us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b54001ad720. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca01dbe 00007f498ca0c930 00007f498ca0c8d8 00007f498ca0c858 00007f498ca0c813 00007f498ca0ba9c 00007f49928f72f6 00007f49928f1aa8 00007f498ca487cb 00007f498ca4b2c0
0709 12:21:41.379642 (+  9530us) raft_consensus.cc:1685] finished
0709 12:21:41.379790 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.380035 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57489,"prepare.queue_time_us":45711,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":64,"raft.queue_time_us":20510,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12294,"spinlock_wait_cycles":10954112,"thread_start_us":616603,"threads_started":1,"wal-append.queue_time_us":591863}
I20260709 12:21:41.465623  8212 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:41.396528  8220 raft_consensus.cc:2368] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:41.467020  9735 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.399401  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.482208  8140 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:41.497478  8139 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.499387  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:41.500272  9422 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:41.501305  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 89949.1us
I20260709 12:21:41.494607  9570 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:41.504026  9570 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.502816  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.395102  9836 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.521775  8213 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:41.526813  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:41.527119  8110 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.233s (SENT)
I20260709 12:21:41.527762  8145 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:41.527788  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:41.533984  8139 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:41.536741  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:41.537922  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:41.499161  9749 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.541354  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.541517  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.536365  9853 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:41.477260  8759 rpcz_store.cc:276] 0709 12:21:40.381892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.383680 (+  1788us) service_pool.cc:224] Handling call
0709 12:21:41.475814 (+1092134us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:21:41.476023 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.476700 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.476906 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15421312}
W20260709 12:21:41.546288  8110 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.234s (SENT)
I20260709 12:21:41.550895  9855 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:41.551261  9768 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.542968  9545 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:41.536582  9739 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.539958  9684 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:41.529316  9735 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:41.551719  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.550107  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.552475  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:41.509680  9659 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:21:41.537308  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.554644  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:41.545601  9824 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:41.580924  9824 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:41.581630  9570 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.581728  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.581943  9824 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.582481  9789 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.557870  8145 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:41.584923  9863 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.585635  9863 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.553606  9759 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.586617  9659 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:41.586675  9759 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.587409  9659 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.587848  9863 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.552786  9803 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.587884  9659 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.559571  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.555577  9545 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.599995  9759 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.604578  9664 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.630843  9664 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:41.631665  8138 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:41.557446  9721 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:41.611212  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64972.8us
I20260709 12:21:41.613020  9836 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:41.614593  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:41.635972  9847 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.476s	user 0.000s	sys 0.002s
I20260709 12:21:41.615566  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.598030  9684 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:41.636569  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.638881  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.639932  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.637650  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.640694  9730 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.641285  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.641665  8215 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:41.642012  8216 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:41.642459  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.642716  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:41.642908  9730 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.643375  8216 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:41.643565  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:41.640460  8214 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:21:41.647833  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4158458470001278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:21:41.648890  8110 connection.cc:256] RPC call timeout handler was delayed by -1.3794272740001361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 12:21:41.626188  9659 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.652429  8143 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:41.627746  9593 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:41.557490  8137 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:41.652863  8143 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:41.623507  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.660274  8213 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:41.648371  9736 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.669203  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.671291  8065 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:41.675753  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:41.677940  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.680665  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:41.681407  8063 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.560035  9739 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.684617  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.656006  9545 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.665714  9684 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:21:41.682778  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.689743  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.691103  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:41.684197  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.664923  9839 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:41.692142  8139 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.695004  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.697703  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.698326  8765 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:41.665966  9759 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:21:41.699331  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.701542  8067 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:41.702407  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:41.703038  8065 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.705662  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:41.706336  8067 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.674562  9768 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:41.711558  8215 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:41.711653  9768 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:41.688668  9840 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:41.715441  8067 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:41.701462  8061 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:41.698351  9609 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.718954  9609 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.683180  9738 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:21:41.720666  9738 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:41.721549  9795 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:41.723474  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.679111  9736 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.697161  9749 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:41.728695  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.735769  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.737547  9749 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:41.699618  9765 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:21:41.773749  8065 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:41.814087  8139 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:41.702057  9839 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.815836  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:41.739291  9701 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:41.833638  9422 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:41.882745  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50008.9us
W20260709 12:21:41.898931  8034 connection.cc:256] RPC call timeout handler was delayed by -1.106614312000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 12:21:41.833189  9550 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:41.833352  9609 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.904654  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.907567  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.909230  9422 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:41.909756  9422 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.910236  9422 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:41.914330  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:41.914958  8067 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.737094  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:41.919101  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:41.919745  8070 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.922039  8062 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:41.920168  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.932253  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:41.935755  8067 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:41.936930  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.947525  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:41.948220  8145 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.950074  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:41.906227  9700 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.909266  9795 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.955034  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:41.910712  9550 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:41.960608  9795 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.961498  9550 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.962841  9795 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.963112  9701 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:41.964396  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:41.965221  9701 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:41.965618  9701 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.965958  9701 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:41.968075  9795 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:41.958859  8760 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:21:41.968950  8760 pending_rounds.cc:85] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 4
I20260709 12:21:41.969209  8760 pending_rounds.cc:107] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:21:41.969556  8760 raft_consensus.cc:2889] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.916888  9726 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:41.948920  9824 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:41.959730  9700 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.970790  9726 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.972093  9736 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:41.972487  9700 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.897796  9789 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:21:41.973076  9726 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.970682  9839 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.974251  8067 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:41.979363  8218 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:41.950724  9759 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.981999  9759 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.905323  9609 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:41.987411  9609 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:41.988955  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:41.988657  9749 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:41.993430  9739 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:41.917213  9844 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:21:41.998755  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48820.2us
I20260709 12:21:41.981007  9726 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:42.000360  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:41.952232  9721 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:42.004254  8063 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:41.997781  9759 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:42.013742  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.015251  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:41.998932  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.033455  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:42.034314  8760 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:42.034464  9545 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.033450  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.037338  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:42.038406  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:42.016285  8070 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:41.955431  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.017179  8065 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:21:42.016597  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.048260  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.048964  8142 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:42.049177  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.049866  8144 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:42.049957  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:42.050977  8142 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:42.050899  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.054752  8212 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:21:42.067876  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.998531  9865 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:42.059407  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:42.008858  9609 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:42.012787  9721 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.101240  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:21:42.128451  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 433772us
W20260709 12:21:42.106544  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47269.7us
I20260709 12:21:42.100806  8212 pending_rounds.cc:85] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:21:42.131582  8212 pending_rounds.cc:107] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:42.131893  8212 raft_consensus.cc:2889] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:42.134483  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.135290  8145 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:42.136437  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.139570  8145 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:42.110371  8142 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:42.031811  9422 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.143385  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.143884  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.144188  9422 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:42.144241  9739 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:42.148460  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:42.150693  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:42.151046  8110 leader_election.cc:400] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:42.003784  9844 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.099130  9759 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:42.151326  8145 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:42.163224  8110 leader_election.cc:403] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:42.132383  9721 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:42.104410  9789 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.167641  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.151934  8061 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:42.177336  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.129549  9609 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:42.145397  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:42.128989  8144 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:42.133980  9619 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:42.167451  9545 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:42.173120  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.014s	sys 0.039s
W20260709 12:21:42.214731  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.039s
I20260709 12:21:42.175081  9840 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:42.169790  9865 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:42.145056  9739 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:42.170159  8142 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:42.189895  9726 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:42.222914  9822 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:42.184477  9867 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:42.164047  9684 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:21:42.184470  9793 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:42.228761  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.226249  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:42.188319  9609 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:42.231967  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 494946us
I20260709 12:21:42.164279  9765 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:21:42.275126  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 243267us
I20260709 12:21:42.233649  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.275877  8063 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:42.198169  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.177179  9759 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.206878  9619 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:42.274854  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48694.9us
I20260709 12:21:42.283020  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:42.277113  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:42.227865  9726 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.189157  9789 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.229874  9634 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:21:42.280323  9727 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:42.291225  9878 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:42.287276  9619 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:42.293251  9824 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:42.293285  9735 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:42.293998  8763 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:42.294516  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:42.295343  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 242) took 1914 ms (client timeout 2025 ms). Trace:
I20260709 12:21:42.295972  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:42.323544  8219 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:42.283535  9793 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.298704  9609 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.299134  9725 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:42.300765  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.301450  9844 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:42.302125  9739 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.287889  9867 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:42.234834  9836 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:42.335059  8070 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:42.306563  9701 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:42.317765  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 207712us
I20260709 12:21:42.268052  9545 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:42.280784  9740 raft_consensus.cc:476] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:21:42.325379  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 401) took 1047 ms. Trace:
I20260709 12:21:42.326247  8063 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:42.318202  9726 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:42.319237  9727 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.320446  9684 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:42.321262  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.340894  8763 rpcz_store.cc:276] 0709 12:21:41.278230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.284477 (+  6247us) service_pool.cc:224] Handling call
0709 12:21:42.293614 (+1009137us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:21:42.293816 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.325048 (+ 31232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.325309 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13860608}
I20260709 12:21:42.333232  9700 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:42.349591  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:42.352674  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.358654  8063 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.332943  9725 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:42.337698  9836 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:42.364478  8765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.028s
I20260709 12:21:42.335314  9735 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:42.366859  8765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.011s	sys 0.028s
W20260709 12:21:42.373212  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 195952us
I20260709 12:21:42.350118  9727 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:42.374351  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:42.348801  9867 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:42.365592  8061 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:42.402581  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 268890us
W20260709 12:21:42.324654  8757 rpcz_store.cc:269] 0709 12:21:40.380908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.386905 (+  5997us) service_pool.cc:224] Handling call
0709 12:21:42.295115 (+1908210us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54005f1c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:42.295278 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456115456}
I20260709 12:21:42.370060  9836 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:42.350986  9545 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.374792  9736 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:42.363282  9684 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:42.406963  8063 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:21:42.425879  8763 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:42.356500  9749 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:21:42.340564  9865 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.466303  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:42.441957  9859 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:21:42.459233  9846 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.317s	user 0.005s	sys 0.028s
W20260709 12:21:42.461694  9875 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 12:21:42.370862  9735 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.474923  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:42.483171  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:42.494426  8763 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:42.497709  9871 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:21:42.498278  8759 raft_consensus.cc:1217] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:21:42.499047  8759 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:21:42.500422  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 302316us
I20260709 12:21:42.501312  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.501814  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 202) took 1091 ms. Trace:
I20260709 12:21:42.502400  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:42.502323  8216 rpcz_store.cc:276] 0709 12:21:41.409974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.643907 (+233933us) service_pool.cc:224] Handling call
0709 12:21:41.644189 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.644557 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.644585 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.649172 (+  4587us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.955391 (+306219us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:41.955429 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.955492 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.501530 (+546038us) raft_consensus.cc:1685] finished
0709 12:21:42.501557 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.501743 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":305857,"threads_started":1,"wal-append.queue_time_us":543412}
I20260709 12:21:42.467134  9891 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:42.506346  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:42.508860  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 179117us
I20260709 12:21:42.517376  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.518711  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.519855  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.523309  9736 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:42.523897  9736 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:42.527384  9422 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:42.527832  9422 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:42.528223  9422 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:42.530874  9853 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:42.533550  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.534466  8070 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:42.535362  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.535993  8070 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
W20260709 12:21:42.538718  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2369) took 1383 ms (client timeout 1587 ms). Trace:
W20260709 12:21:42.539179  8220 rpcz_store.cc:269] 0709 12:21:41.155820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.156238 (+   418us) service_pool.cc:224] Handling call
0709 12:21:42.538492 (+1382254us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54002251d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:42.538637 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502291072}
I20260709 12:21:42.541607  8138 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:21:42.543115  8138 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:42.549221  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 170) took 1990 ms. Trace:
I20260709 12:21:42.549700  8069 rpcz_store.cc:276] 0709 12:21:40.558446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.698877 (+140431us) service_pool.cc:224] Handling call
0709 12:21:40.699216 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.113554 (+414338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.548967 (+1435413us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001f7f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:42.549147 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890814208}
I20260709 12:21:42.566334  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.572431  8143 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.573683  8143 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:42.575136  9881 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.575744  9881 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.576802  9824 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:42.577420  9824 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.580225  9824 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:42.590683  9881 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:42.604614  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:42.605348  8762 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:42.608551  8140 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:21:42.623353  9886 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 12:21:42.627084  9866 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.627861  9866 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.629055  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:42.631989  8762 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:42.633615  9730 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:42.634135  9730 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.634510  9730 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:42.639180  9768 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:42.663040  9664 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:42.669893  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.674085  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.676791  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.677220  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.678352  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.678629  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.679343  8069 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:42.679718  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.632510  8762 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:42.684769  8062 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:42.690016  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.686990  8762 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.693781  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:42.696139  8762 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:42.702468  7964 catalog_manager.cc:5697] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.694165  9866 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:42.694227  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:41.491791  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:42.680298  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:42.665995  9664 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:42.744782  9881 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:42.744411  8062 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:42.745848  9881 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:42.753572  8064 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:42.763034  8762 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:42.763170  7964 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.766738  8069 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:42.767895  8762 pending_rounds.cc:85] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 5
I20260709 12:21:42.769688  8762 pending_rounds.cc:107] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:42.772322  8762 raft_consensus.cc:2889] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:42.443640  9725 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:42.771085  9870 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 12:21:42.506222  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:42.504494  9873 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:42.508939  9700 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:42.478392  9867 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:42.856748  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 480741us
I20260709 12:21:42.861728  8070 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:42.924593  9422 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:43.060114  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.968402  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 262) took 1983 ms. Trace:
W20260709 12:21:43.052435  8731 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.629s (SENT)
I20260709 12:21:43.075455  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:43.074079  8143 rpcz_store.cc:276] 0709 12:21:40.990033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.994149 (+  4116us) service_pool.cc:224] Handling call
0709 12:21:40.994650 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.652344 (+657694us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000ba2a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:21:42.571996 (+919652us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54000ba2a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca0a06f 00007f498ca82f60 00007f498ca847de 00007f498ca8eb49 00007f498ca8f416 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62
0709 12:21:42.891748 (+319752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.891793 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.967952 (+ 76159us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:42.968032 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.968133 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.968315 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361663616}
I20260709 12:21:42.777042  9759 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:42.810053  9839 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.014010  9552 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:21:42.879312  9875 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:21:42.968971  9765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.008s	sys 0.046s
I20260709 12:21:42.782889  9891 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:43.107546  9422 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.106963  7965 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 3, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.817759  9824 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.298s
I20260709 12:21:42.777525  9684 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:42.922755  9748 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.023s
W20260709 12:21:43.156085  9748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.022s	sys 0.024s
I20260709 12:21:43.157385  9593 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:43.158969  9893 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 12:21:43.160241  9885 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:43.161491  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 208) took 1186 ms. Trace:
I20260709 12:21:43.161866  8217 rpcz_store.cc:276] 0709 12:21:41.975198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.975359 (+   161us) service_pool.cc:224] Handling call
0709 12:21:41.975704 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.976043 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.976074 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.976548 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.373031 (+396483us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:42.373081 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.373213 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:43.161280 (+788067us) raft_consensus.cc:1685] finished
0709 12:21:43.161306 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.161433 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1169,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":396037,"threads_started":1,"wal-append.queue_time_us":853052}
W20260709 12:21:43.173588  9895 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:21:42.969370  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.829543  8760 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:21:43.047161  9789 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:42.924510  9609 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.117812  9571 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:43.003844  9664 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.156358  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1056) took 1758 ms. Trace:
I20260709 12:21:42.843684  9822 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:43.134553  7965 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 2 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.109108  7967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 265) took 5277 ms. Trace:
I20260709 12:21:43.148998  9422 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:43.214262  9422 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.839699  9738 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.284s
I20260709 12:21:43.179414  8760 pending_rounds.cc:85] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 4
W20260709 12:21:43.153553  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 101152us
W20260709 12:21:43.117964  9765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.011s	sys 0.048s
I20260709 12:21:43.123468  9586 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:43.135314  8756 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:43.181119  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:43.187395  9736 consensus_meta.cc:287] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.005s
I20260709 12:21:43.084710  9700 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:42.969187  9793 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.132031  9759 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:43.156351  9891 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.196554  9545 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.222802  8760 pending_rounds.cc:107] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:43.208541  9571 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.220096  9422 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.118371  9839 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.214550  7965 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.229683  9586 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:43.237066  9873 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:43.213646  7967 rpcz_store.cc:276] 0709 12:21:37.832126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.871107 (+ 38981us) service_pool.cc:224] Handling call
0709 12:21:43.108991 (+5237884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:38.631960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:38.632800 (+   840us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:38.632851 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:21:38.632883 (+    32us) tablet.cc:662] Decoding operations
0709 12:21:38.634024 (+  1141us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:38.634119 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:38.634146 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:21:38.635054 (+   908us) tablet.cc:701] Row locks acquired
0709 12:21:38.635114 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:21:38.635263 (+   149us) write_op.cc:270] Start()
0709 12:21:38.635408 (+   145us) write_op.cc:276] Timestamp: P: 1783599698635205 usec, L: 0
0709 12:21:38.635445 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:21:38.636250 (+   805us) log.cc:844] Serialized 4131 byte log entry
0709 12:21:40.064527 (+1428277us) op_driver.cc:464] REPLICATION: finished
0709 12:21:40.408994 (+344467us) write_op.cc:301] APPLY: starting
0709 12:21:40.409169 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:40.409601 (+   432us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:40.409821 (+   220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:40.411770 (+  1949us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:40.412241 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:21:40.412343 (+   102us) write_op.cc:312] APPLY: finished
0709 12:21:40.450783 (+ 38440us) log.cc:844] Serialized 77 byte log entry
0709 12:21:40.451037 (+   254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:40.451207 (+   170us) write_op.cc:454] Released schema lock
0709 12:21:40.451294 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:40.451840 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:40.451874 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":285285,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":304288,"apply.run_cpu_time_us":5046,"apply.run_wall_time_us":42819,"num_ops":10,"prepare.queue_time_us":89987,"prepare.run_cpu_time_us":22854,"prepare.run_wall_time_us":73068,"raft.queue_time_us":1087921,"raft.run_cpu_time_us":24761,"raft.run_wall_time_us":380434,"replication_time_us":1354362,"thread_start_us":1034080,"threads_started":4,"wal-append.queue_time_us":149719,"wal-append.run_cpu_time_us":164407,"wal-append.run_wall_time_us":2725892}]]}
I20260709 12:21:43.239120  9701 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.239728  9765 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.228346  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.247866  9422 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:43.224669  9664 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:43.276058  9765 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.278329  9765 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.224241  9609 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.281347  9609 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.283916  9609 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:43.247062  8760 raft_consensus.cc:2889] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:43.228603  9892 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.231807  9759 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:43.218942  8731 leader_election.cc:336] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.761s (SENT)
I20260709 12:21:43.265151  9873 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.307899  9873 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.245340  9736 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.273519  9422 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.226060  9822 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.304211  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:43.323051  9422 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:43.310993  9759 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:43.324112  9832 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.309499  9892 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.326268  9832 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.330511  9822 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:43.331225  9730 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.009s
I20260709 12:21:43.331650  9730 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.332945  8065 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:43.333451  9700 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:43.319501  9721 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.116s	user 0.011s	sys 0.001s
W20260709 12:21:43.335040  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 116123us
I20260709 12:21:43.340219  9571 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:43.342557  9586 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.345194  9840 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:21:43.377199  8063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.057s	sys 0.085s
W20260709 12:21:43.398715  8063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.057s	sys 0.086s
W20260709 12:21:43.393488  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.016s	sys 0.071s
W20260709 12:21:43.326285  9726 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.001s
W20260709 12:21:43.393296  8144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.026s	sys 0.026s
W20260709 12:21:43.402138  9578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.022s	sys 0.036s
W20260709 12:21:43.420522  9578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.022s	sys 0.036s
W20260709 12:21:43.421562  9852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.002s	sys 0.022s
W20260709 12:21:43.421993  9852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.002s	sys 0.022s
I20260709 12:21:43.422940  9759 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:43.407701  8729 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.009s	sys 0.032s
W20260709 12:21:43.424942  8729 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.010s	sys 0.033s
W20260709 12:21:43.407080  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.016s	sys 0.071s
W20260709 12:21:43.408061  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.000s	sys 0.024s
I20260709 12:21:43.334347  9892 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:43.477564  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.015s	sys 0.048s
W20260709 12:21:43.434712  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 925100us
I20260709 12:21:43.393774  9822 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:43.417836  8144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.026s	sys 0.026s
I20260709 12:21:43.483287  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:43.484248  8145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.003s	sys 0.023s
W20260709 12:21:43.484722  8145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.003s	sys 0.023s
I20260709 12:21:43.485754  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1030) took 1745 ms. Trace:
I20260709 12:21:43.394093  9721 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:43.395962  9840 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:43.426076  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.02804e+06us
I20260709 12:21:43.522764  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:43.479666  8765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.012s	sys 0.033s
W20260709 12:21:43.478116  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.015s	sys 0.048s
W20260709 12:21:43.469671  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.000s	sys 0.025s
W20260709 12:21:43.500288  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.017s	sys 0.046s
I20260709 12:21:43.486330  8145 rpcz_store.cc:276] 0709 12:21:41.739930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.514145 (+774215us) service_pool.cc:224] Handling call
0709 12:21:42.514467 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.514693 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:42.515026 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 12:21:43.485161 (+970135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:43.485239 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:43.485307 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.485396 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.485666 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":744,"prepare.queue_time_us":5912,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":700167,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7274,"thread_start_us":969806,"threads_started":1}
W20260709 12:21:43.526968  8765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.013s	sys 0.034s
I20260709 12:21:43.415015  9726 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:43.646276  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 187) took 1129 ms. Trace:
I20260709 12:21:43.212244  8211 rpcz_store.cc:276] 0709 12:21:41.397486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.458607 (+ 61121us) service_pool.cc:224] Handling call
0709 12:21:41.494583 (+ 35976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.669236 (+174653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.678293 (+  9057us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.712860 (+ 34567us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.206675 (+493815us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:42.312102 (+105427us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.324009 (+ 11907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.328281 (+  4272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.626720 (+298439us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b180027db40. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:21:43.130151 (+503431us) raft_consensus.cc:1685] finished
0709 12:21:43.156098 (+ 25947us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:43.156291 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13084,"prepare.queue_time_us":61968,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":41670,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":10680,"spinlock_wait_cycles":11330816,"thread_start_us":586500,"threads_started":2,"wal-append.queue_time_us":614288}
W20260709 12:21:43.975224  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.005530  8065 rpcz_store.cc:276] 0709 12:21:42.516841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.693517 (+176676us) service_pool.cc:224] Handling call
0709 12:21:43.645943 (+952426us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540011dad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:43.646180 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465600896}
I20260709 12:21:44.006301  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:43.482498  9789 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.702747  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.033s	sys 0.036s
I20260709 12:21:44.007218  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:43.980083  9898 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.008060  9789 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.008805  9898 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:44.009678  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.613s	user 0.035s	sys 0.061s
I20260709 12:21:44.010378  8069 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:44.011200  9789 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.011278  9740 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.637089  9786 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.012274  9901 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:44.012405  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:43.844858  9730 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.013676  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:43.676896  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.535831  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:44.014380  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:44.052222  8070 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:43.843722  8141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.010s	sys 0.035s
W20260709 12:21:44.053274  8141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.014s	sys 0.038s
I20260709 12:21:43.528280  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:44.015671  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:43.874655  8142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.257s	user 0.006s	sys 0.039s
W20260709 12:21:44.016422  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.514e+06us
I20260709 12:21:44.054417  8764 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:44.016580  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.016s	sys 0.014s
I20260709 12:21:44.054812  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:44.055392  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.016s	sys 0.015s
I20260709 12:21:44.053606  8064 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:44.009184  9736 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.057996  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.054744  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:44.058949  8220 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:44.059808  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1143) took 2504 ms. Trace:
W20260709 12:21:44.016983  8138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.472s	user 0.007s	sys 0.036s
I20260709 12:21:44.017083  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:44.020697  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:44.061601  8145 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:44.018165  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:44.062284  8138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.518s	user 0.007s	sys 0.036s
W20260709 12:21:43.487066  9735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.000s	sys 0.030s
I20260709 12:21:44.015161  9897 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:44.019543  9619 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.692s	user 0.029s	sys 0.029s
I20260709 12:21:44.019830  9881 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:43.803905  9840 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.087154  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.005s	sys 0.013s
W20260709 12:21:44.087692  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.005s	sys 0.013s
I20260709 12:21:44.089469  8070 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:43.566151  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:43.528527  9578 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:44.090646  8139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.586s	user 0.023s	sys 0.031s
W20260709 12:21:44.090989  8139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.023s	sys 0.031s
I20260709 12:21:44.091490  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1142) took 2551 ms. Trace:
W20260709 12:21:44.065462  9735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.566s	user 0.008s	sys 0.049s
W20260709 12:21:44.037073  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.546s	user 0.013s	sys 0.028s
W20260709 12:21:44.092756  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.013s	sys 0.028s
W20260709 12:21:44.093577  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.6027e+06us
W20260709 12:21:44.038902  8062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.010s	sys 0.006s
W20260709 12:21:44.038029  9550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.007s	sys 0.048s
W20260709 12:21:44.054131  8142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.007s	sys 0.044s
W20260709 12:21:44.008077  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.040s	sys 0.050s
I20260709 12:21:44.056074  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:43.527213  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:44.061631  8146 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:44.060292  8141 rpcz_store.cc:276] 0709 12:21:41.549190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.949222 (+400032us) service_pool.cc:224] Handling call
0709 12:21:41.957781 (+  8559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.957990 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:42.347985 (+389995us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.612227 (+264242us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b18001e3280. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a
0709 12:21:44.053650 (+1441423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.053709 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.053755 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.053817 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.053934 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4643,"prepare.queue_time_us":458677,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4877,"raft.queue_time_us":666405,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":2156800,"thread_start_us":1936313,"threads_started":3,"wal-append.queue_time_us":120043,"wal-append.run_cpu_time_us":1994,"wal-append.run_wall_time_us":1031473}
I20260709 12:21:44.069099  9897 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.050372  9740 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.053562  9901 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.074065  9803 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:44.057315  9545 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:44.078754  9727 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.681s	user 0.012s	sys 0.000s
I20260709 12:21:44.079571  9659 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:44.092092  7964 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.019s	sys 0.013s
W20260709 12:21:44.153456  7964 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.019s	sys 0.013s
I20260709 12:21:44.056806  9786 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.096618  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.103329  8110 leader_election.cc:400] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:44.099320  8761 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:44.083909  9736 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.096940  8062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.010s	sys 0.006s
W20260709 12:21:44.147234  9765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.014s	sys 0.005s
W20260709 12:21:44.104183  9550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.402s	user 0.007s	sys 0.048s
W20260709 12:21:44.105926  8137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.328s	user 0.015s	sys 0.003s
W20260709 12:21:44.171518  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.015s	sys 0.026s
I20260709 12:21:44.069093  9759 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.163971  8110 leader_election.cc:403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:44.102449  9896 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.170020  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:44.146620  9803 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.105806  9735 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.102738  9881 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:44.190356  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.015s	sys 0.026s
W20260709 12:21:44.231546  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.091774  8139 rpcz_store.cc:276] 0709 12:21:41.539945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.816424 (+276479us) service_pool.cc:224] Handling call
0709 12:21:41.840832 (+ 24408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.841106 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:42.280146 (+439040us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.091256 (+1811110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.091296 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:44.091325 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.091371 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.091452 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524559,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":642937,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":39602,"thread_start_us":2174479,"threads_started":3,"wal-append.queue_time_us":732585}
I20260709 12:21:44.086578  9619 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.169250  9844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.005s	sys 0.038s
I20260709 12:21:44.191387  9840 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:44.190224  8137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.015s	sys 0.004s
I20260709 12:21:44.155252  9545 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.226323  9803 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:44.169842  9765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.014s	sys 0.005s
I20260709 12:21:44.163758  9916 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:44.234349  8141 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:21:44.241892  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.256392  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 159828us
W20260709 12:21:44.130124  9739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.012s	sys 0.027s
I20260709 12:21:44.226540  9730 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.169520  9659 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.227905  9912 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:44.280189  8140 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:44.281751  9619 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.282755  9832 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.284705  9898 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.284946  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:44.299167  8139 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:44.238456  9881 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.237475  9844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.006s	sys 0.039s
I20260709 12:21:44.162170  9727 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.257799  9726 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.258605  9915 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.236769  9735 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.232833  9902 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:44.265260  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166303us
W20260709 12:21:44.355307  9836 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.911s	user 0.014s	sys 0.000s
I20260709 12:21:44.292235  8145 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
W20260709 12:21:44.290622  9739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.016s	sys 0.035s
W20260709 12:21:44.334195  9918 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:21:44.352939  9866 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:44.233645  9919 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 12:21:44.235752  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.009s	sys 0.024s
I20260709 12:21:44.352195  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:44.297175  9903 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.378023  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 251) took 1954 ms. Trace:
I20260709 12:21:44.378554  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1213) took 2715 ms. Trace:
I20260709 12:21:44.290246  9759 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:44.291636  9730 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.362380  8764 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:44.190689  9736 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.370834  8034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.493s	user 0.004s	sys 0.093s
W20260709 12:21:44.359618  8061 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.938s	user 0.013s	sys 0.002s
I20260709 12:21:44.349798  8067 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:44.361353  9911 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:21:44.374346  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.009s	sys 0.024s
I20260709 12:21:44.392028  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:44.392753  8220 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:44.393716  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.394444  8214 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:44.352566  9916 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:44.393739  8217 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:44.395238  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.396337  8218 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:44.398022  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.399024  8212 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:44.399945  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.372759  9836 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.362210  9865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.014s	sys 0.017s
I20260709 12:21:44.377754  9727 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.401579  8141 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:44.307776  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1023) took 2808 ms. Trace:
I20260709 12:21:44.362514  9789 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.386299  8034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.004s	sys 0.093s
I20260709 12:21:44.388885  8066 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:21:44.385794  9832 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.378516  8765 rpcz_store.cc:276] 0709 12:21:42.424059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.424181 (+   122us) service_pool.cc:224] Handling call
0709 12:21:42.424499 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.443289 (+ 18790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.443319 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.443922 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.018715 (+1574793us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:44.018754 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.018814 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.377793 (+358979us) raft_consensus.cc:1685] finished
0709 12:21:44.377814 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.377954 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18390,"raft.queue_time_us":22197,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2981,"thread_start_us":1537735,"threads_started":1,"wal-append.queue_time_us":1864625}
I20260709 12:21:44.254206  9896 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.390990  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.373203  9721 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.385815  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1028) took 2653 ms. Trace:
W20260709 12:21:44.390914  8757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.425s	user 0.019s	sys 0.041s
I20260709 12:21:44.390964  8061 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:44.378337  9903 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.412672  8218 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:44.379530  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:44.436308  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45404us
W20260709 12:21:44.421624  9822 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.005s
I20260709 12:21:44.390645  9915 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:44.410408  9865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.015s	sys 0.018s
I20260709 12:21:44.425498  8216 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:44.439066  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.413919  8220 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:44.416958  9740 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.442996  8218 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:44.387189  9866 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.379527  9902 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.421167  9786 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:44.427256  8757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.489s	user 0.019s	sys 0.041s
I20260709 12:21:44.410555  9803 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.455144  8218 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 1
I20260709 12:21:44.449441  9915 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:44.379144  8068 rpcz_store.cc:276] 0709 12:21:41.662874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.663022 (+   148us) service_pool.cc:224] Handling call
0709 12:21:41.677864 (+ 14842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.678063 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.678088 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.636364 (+958276us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b2c000014c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:21:42.636898 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.056064 (+1419166us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:44.056123 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.056257 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.378246 (+321989us) raft_consensus.cc:1685] finished
0709 12:21:44.378262 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.378469 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8370048,"thread_start_us":1418682,"threads_started":1,"wal-append.queue_time_us":1517066}
I20260709 12:21:44.403374  9912 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:21:44.411541  9919 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:44.446957  9907 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:44.434065  9721 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.466162  8218 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:44.447324  9897 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.446825  9917 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.454306  9822 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.420423  9789 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.455681  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.456367  9901 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.454913  9739 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.477056  8218 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:44.453764  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1228) took 2205 ms (client timeout 1888 ms). Trace:
I20260709 12:21:44.466744  8215 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:44.464154  9727 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.463012  9765 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.462502  9740 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.503147  9740 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.505793  9740 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.478523  9903 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.483356  9897 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.424995  8144 rpcz_store.cc:276] 0709 12:21:41.732022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.274362 (+542340us) service_pool.cc:224] Handling call
0709 12:21:42.300077 (+ 25715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.333670 (+ 33593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.339292 (+  5622us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.412865 (+ 73573us) log.cc:844] Serialized 26 byte log entry
0709 12:21:43.555030 (+1142165us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:43.584727 (+ 29697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.635669 (+ 50942us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.379084 (+743415us) raft_consensus.cc:1685] finished
0709 12:21:44.379113 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.379259 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23716,"raft.queue_time_us":28374,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7535,"thread_start_us":1008187,"threads_started":1,"wal-append.queue_time_us":1801000}
I20260709 12:21:44.491694  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.463311  9914 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:21:44.488947  9898 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.510203  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1231) took 2277 ms. Trace:
I20260709 12:21:44.513832  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:44.489040  9726 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.481910  9919 consensus_queue.cc:1243] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:21:44.565961  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52256.2us
I20260709 12:21:44.565845  8067 rpcz_store.cc:276] 0709 12:21:42.232687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.300397 (+ 67710us) service_pool.cc:224] Handling call
0709 12:21:44.509915 (+2209518us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400106dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:44.510123 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4626908416}
I20260709 12:21:44.482223  9721 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.479030  9907 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.470868  9916 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:44.629089  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60526.9us
I20260709 12:21:44.517686  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 412) took 2043 ms. Trace:
I20260709 12:21:44.581957  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:44.672359  8213 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.017s	sys 0.025s
W20260709 12:21:44.672844  8213 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.017s	sys 0.025s
I20260709 12:21:44.496285  9739 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.564404  9881 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:44.491648  8061 rpcz_store.cc:269] 0709 12:21:42.231747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.262233 (+ 30486us) service_pool.cc:224] Handling call
0709 12:21:44.437250 (+2175017us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:44.682425  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.016s
I20260709 12:21:44.501102  9901 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.582633  9903 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:44.532701  9765 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.673499  9923 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:44.698913  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.698895  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.016s
I20260709 12:21:44.682523  9730 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.677971  8215 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:44.726300  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:44.676755  9684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.003s	sys 0.024s
W20260709 12:21:44.696771  8731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.014s	sys 0.017s
I20260709 12:21:44.568102  9619 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
W20260709 12:21:44.698661  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.004s	sys 0.028s
I20260709 12:21:44.508368  9727 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.672554  9736 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.572484  9898 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.719693  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.003s	sys 0.029s
W20260709 12:21:44.737558  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.003s	sys 0.029s
W20260709 12:21:44.721942  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 660869us
W20260709 12:21:44.738646  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 720498us
I20260709 12:21:44.740097  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.740195  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.696192  9725 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:44.729668  8731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.014s	sys 0.018s
I20260709 12:21:44.509063  9915 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:44.720194  9867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.021s	sys 0.040s
I20260709 12:21:44.630316  9726 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:44.759817  9907 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:44.733826  9684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.003s	sys 0.028s
W20260709 12:21:44.754628  9867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.021s	sys 0.040s
I20260709 12:21:44.698149  9836 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:44.733480  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.004s	sys 0.028s
W20260709 12:21:44.720468  9920 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 12:21:44.720077  8138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.023s
I20260709 12:21:44.570526  9659 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:44.722841  8062 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.021s	sys 0.022s
W20260709 12:21:44.771884  8062 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.021s	sys 0.022s
W20260709 12:21:44.771884  8138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.009s	sys 0.024s
I20260709 12:21:44.769344  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1232) took 2532 ms. Trace:
I20260709 12:21:44.731537  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.772787  8063 rpcz_store.cc:276] 0709 12:21:42.237432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.456825 (+219393us) service_pool.cc:224] Handling call
0709 12:21:42.457134 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.457326 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:43.399665 (+942339us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.768158 (+1368493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.768229 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.768292 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.768395 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.768551 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1905530,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3077,"raft.queue_time_us":760,"thread_start_us":2298093,"threads_started":2}
W20260709 12:21:44.839591  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 400599us
I20260709 12:21:44.846530  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:44.783550  8142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.014s	sys 0.023s
W20260709 12:21:44.847507  8142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.020s	sys 0.023s
I20260709 12:21:44.774454  9915 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:44.760854  9803 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.774220  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 188) took 2257 ms. Trace:
I20260709 12:21:44.852994  9759 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.857875  9803 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.861415  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:44.862190  8756 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:44.862341  9839 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.862761  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 414) took 1339 ms. Trace:
I20260709 12:21:44.863456  9765 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.863210  8756 rpcz_store.cc:276] 0709 12:21:43.523581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.527949 (+  4368us) service_pool.cc:224] Handling call
0709 12:21:44.861258 (+1333309us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:44.862694 (+  1436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61409152}
W20260709 12:21:44.865085  9930 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:21:44.861398  9803 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:44.866622  9934 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:21:44.866984  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:44.867609  9803 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.751701  9736 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:21:44.869632  9740 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:44.870054  9740 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:44.870474  9902 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.871019  9740 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.762439  9866 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.768911  9899 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.873351  9727 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.873001  9899 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.874061  9545 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:44.875423  9929 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:21:44.876329  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1149) took 2919 ms. Trace:
I20260709 12:21:44.876789  8138 rpcz_store.cc:276] 0709 12:21:41.957249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.543834 (+586585us) service_pool.cc:224] Handling call
0709 12:21:42.544164 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.062824 (+1518660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.062876 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.069331 (+  6455us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.774684 (+705353us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:44.774724 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.774791 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.876088 (+101297us) raft_consensus.cc:1685] finished
0709 12:21:44.876111 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.876268 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5191,"raft.queue_time_us":682583,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2504,"thread_start_us":2221334,"threads_started":2,"wal-append.queue_time_us":785396}
I20260709 12:21:44.852368  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.722427  9901 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:44.410234  8137 rpcz_store.cc:276] 0709 12:21:41.497397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.720152 (+222755us) service_pool.cc:224] Handling call
0709 12:21:41.720574 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.720809 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:42.219569 (+498760us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.255749 (+2036180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.263651 (+  7902us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.285816 (+ 22165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.292171 (+  6355us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.305640 (+ 13469us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":614030,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5855,"raft.queue_time_us":609835,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":16070,"thread_start_us":2439685,"threads_started":3,"wal-append.queue_time_us":288601,"wal-append.run_cpu_time_us":2081,"wal-append.run_wall_time_us":1388701}
I20260709 12:21:44.716605  9923 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:44.830637  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:44.789072  8035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.016s	sys 0.035s
W20260709 12:21:44.918618  8035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.019s	sys 0.037s
I20260709 12:21:44.918681  8216 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:21:44.919036  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 804071us
W20260709 12:21:44.921645  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 223310us
W20260709 12:21:44.856236  9932 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:21:44.857594  9938 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:44.868099  9931 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:21:44.858268  8062 rpcz_store.cc:276] 0709 12:21:42.517152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.757584 (+240432us) service_pool.cc:224] Handling call
0709 12:21:42.759675 (+  2091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.761331 (+  1656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.761540 (+   209us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.058702 (+297162us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.164947 (+1106245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:44.773614 (+608667us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.773885 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.773978 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.774023 (+    45us) raft_consensus.cc:1685] finished
0709 12:21:44.774034 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.774164 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212311,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":6908,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7139,"thread_start_us":1685254,"threads_started":2,"wal-append.queue_time_us":1341322}
I20260709 12:21:44.834072  9789 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:44.755338  9891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.022s
I20260709 12:21:44.890280  9765 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:44.648790  8757 rpcz_store.cc:276] 0709 12:21:42.457102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.462505 (+  5403us) service_pool.cc:224] Handling call
0709 12:21:42.468740 (+  6235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.484699 (+ 15959us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:42.826780 (+342081us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.482738 (+1655958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.484689 (+  1951us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:44.488497 (+  3808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.493200 (+  4703us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.500734 (+  7534us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306645,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":15574,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":1541274,"threads_started":1,"wal-append.queue_time_us":1869721}
I20260709 12:21:44.900763  9896 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.901242  9726 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.876029  9939 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:44.902302  9721 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:44.850554  9739 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:44.877095  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:44.909499  9898 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:44.913213  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:44.914481  8145 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:44.917443  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:44.928504  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.932101  8216 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:44.934149  8217 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:44.956990  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 216992us
I20260709 12:21:44.896412  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 413) took 1373 ms. Trace:
W20260709 12:21:44.956743  9891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.013s	sys 0.022s
I20260709 12:21:44.986733  9923 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:44.971776  8186 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:44.934998  9727 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:21:45.037925  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66236.4us
I20260709 12:21:44.956038  9730 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:44.941306  9867 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
W20260709 12:21:45.090955  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 177910us
I20260709 12:21:45.096005  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.097023  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.097859  8146 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:45.099102  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.099772  8146 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:45.022394  8213 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.027086  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1029) took 3293 ms. Trace:
I20260709 12:21:44.956351  9881 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.029595  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 289568us
I20260709 12:21:45.023556  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:21:45.062261  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.130534  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:44.984470  9903 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:44.961947  9619 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:44.962625  9839 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.978533  9901 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:45.084237  9727 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.081228  9721 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.021647  8760 rpcz_store.cc:276] 0709 12:21:43.523229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.566827 (+ 43598us) service_pool.cc:224] Handling call
0709 12:21:43.715245 (+148418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.187457 (+472212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.190537 (+  3080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.193484 (+  2947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:44.231628 (+ 38144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.896108 (+664480us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54005460d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:44.896175 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.896349 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957362048}
I20260709 12:21:45.106107  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:45.022671  8216 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:45.133333  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 432835us
I20260709 12:21:45.100508  8142 rpcz_store.cc:276] 0709 12:21:41.733884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.616992 (+883108us) service_pool.cc:224] Handling call
0709 12:21:42.617435 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.097161 (+1479726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.097211 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.121298 (+ 24087us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.848084 (+726786us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:44.848137 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.848231 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.026835 (+178604us) raft_consensus.cc:1685] finished
0709 12:21:45.026860 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.027017 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":661224,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":2136024,"threads_started":2,"wal-append.queue_time_us":861527}
I20260709 12:21:45.175434  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.176213  8142 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:21:45.130941  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52837.9us
I20260709 12:21:45.141079  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.166591  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.179082  8145 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:45.158057  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 134609us
I20260709 12:21:45.164705  8213 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:45.095022  9765 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.186370  8146 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:45.188705  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.191023  8142 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:45.189456  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:45.190038  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.193468  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.193667  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.194288  8216 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.134661  9923 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.194118  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:45.198362  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.198951  8138 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:45.198810  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:45.200590  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 94588.4us
I20260709 12:21:45.173038  9939 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:45.150261  9898 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:45.210593  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.210711  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.211854  8065 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:45.187491  9721 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.220003  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.187409  9956 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:45.191280  9739 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.232357  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51820.8us
I20260709 12:21:45.233222  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1158) took 1216 ms. Trace:
I20260709 12:21:45.213110  9916 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.230989  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.195657  9902 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.187592  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.242861  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:45.242318  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1230) took 3010 ms. Trace:
I20260709 12:21:45.233706  8143 rpcz_store.cc:276] 0709 12:21:44.016427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.016561 (+   134us) service_pool.cc:224] Handling call
0709 12:21:44.016882 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.165090 (+148208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.165133 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.165181 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:44.165211 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.232903 (+1067692us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400351e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:45.232971 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.233147 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340363136}
I20260709 12:21:45.131381  9730 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.213020  9939 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.209384  9925 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.168335  9619 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.150519  9881 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.260941  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:45.262095  9844 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:45.262959  9881 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.263654  9881 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:45.255194  9803 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:45.265280  8067 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:45.266520  9619 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.267428  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.268133  8070 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:45.268265  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.269207  8143 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:45.221150  9921 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:21:45.270437  9921 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:45.253082  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.248713  9739 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.271610  9921 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:45.257762  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.272647  8764 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 1.
I20260709 12:21:45.273196  9739 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.273586  9954 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.274595  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.275353  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.275627  9950 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:45.274578  9921 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:45.260018  9955 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:21:45.276726  9950 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.277154  9950 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:45.260485  9925 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.277570  9950 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.278155  9727 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.279481  9925 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.248435  9903 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:45.279912  9725 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.007s
I20260709 12:21:45.249138  9765 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.280606  9748 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.280791  9896 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:45.202230  9961 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.264497  9881 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.281255  9896 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:45.281615  9961 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:45.281221  9748 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.281796  9881 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.233001  9956 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:45.235718  9933 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:21:45.282140  9961 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.256723  9902 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.283355  9956 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.284044  8144 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:45.284757  9956 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:45.260227  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.285102  9939 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:45.259470  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:45.287618  8756 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.187879  9839 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.289209  9896 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.235193  9898 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.290563  9896 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:45.290751  9839 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.268198  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.235478  9721 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.292296  9898 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.271818  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.255538  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.273281  9940 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:21:45.223338  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.297122  8063 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:45.275398  8138 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.258301  8216 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:45.200089  9789 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:21:45.306043  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.271066  8765 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:21:45.299680  8143 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.250088  8066 rpcz_store.cc:276] 0709 12:21:42.232377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.413781 (+181404us) service_pool.cc:224] Handling call
0709 12:21:42.447732 (+ 33951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.417341 (+1969609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.241892 (+824551us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400346054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:45.242227 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4463567232}
I20260709 12:21:45.223287  8142 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:45.295763  9730 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:45.252784  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63448.2us
I20260709 12:21:45.309610  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.308260  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.311131  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.310716  8142 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:45.311441  8216 raft_consensus.cc:2376] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3. Re-sending same reply.
I20260709 12:21:45.315366  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.316911  8142 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.316241  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.321158  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.321331  9968 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.322397  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.322994  8212 raft_consensus.cc:2376] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4. Re-sending same reply.
I20260709 12:21:45.323391  9902 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:45.274178  9954 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:45.323854  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.324542  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.327695  9898 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.281138  9765 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.329648  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.329833  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.330489  8765 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:45.331504  8143 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.332765  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.332682  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.333120  8138 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.334348  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.328694  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.335891  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.337957  8143 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.318468  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:45.335405  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 87332us
I20260709 12:21:45.339056  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:45.335517  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.339790  8138 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:45.339852  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.354880  8216 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.354331  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:45.353482  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98960.2us
I20260709 12:21:45.353248  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.334030  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.328980  9735 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.357435  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:45.340504  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:45.356738  8142 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.366999  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.364153  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:45.338129  9968 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:45.359009  9659 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:45.370245  9725 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:45.371929  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.372201  9727 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:45.366019  8211 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:45.377106  9726 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.377877  9739 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.393508  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.395020  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.395774  8211 raft_consensus.cc:2368] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 5.
I20260709 12:21:45.396564  8145 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:21:45.397046  8145 pending_rounds.cc:85] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 2
I20260709 12:21:45.397323  8145 pending_rounds.cc:107] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:21:45.397569  8145 raft_consensus.cc:2889] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.398684  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.374323  8216 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:45.391134  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.369546  9730 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:45.417363  9881 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.357956  9969 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:45.373569  9925 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.433647  9925 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:45.434135  9925 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.434445  9923 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.435199  9923 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.438460  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.438846  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.439126  8062 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:45.439662  8218 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:45.443106  8143 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:45.413599  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1045) took 1260 ms. Trace:
I20260709 12:21:45.444825  8139 rpcz_store.cc:276] 0709 12:21:44.153341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.371448 (+1218107us) service_pool.cc:224] Handling call
0709 12:21:45.413524 (+ 42076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.440698  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.451192  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.414541  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.414965  9765 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.392545  9727 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:45.381582  9659 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.371110  9968 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:45.615155  8062 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:45.607784  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.453723  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.617946  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1072) took 1225 ms. Trace:
W20260709 12:21:45.631505  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.490654  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.638124  8139 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:45.642351  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.643596  8218 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:45.643874  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 286497us
W20260709 12:21:45.644220  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 269067us
I20260709 12:21:45.645087  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.646143  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:45.646770  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.655999  8062 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:45.668596  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.670172  8218 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:45.401206  9902 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:45.678798  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.679330  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.679787  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.680011  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.660467  8215 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:45.680498  8062 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:45.753523  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.754944  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:45.755645  8218 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:45.755059  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 84177.9us
I20260709 12:21:45.755883  8215 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:45.761022  8184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.556s (SENT) [suppressed 22 similar messages]
I20260709 12:21:45.761529  8218 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:45.764066  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:45.683776  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.756754  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:45.756996  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110987us
I20260709 12:21:45.693162  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:45.401432  9954 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:45.628743  8219 rpcz_store.cc:276] 0709 12:21:44.392327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.393826 (+  1499us) service_pool.cc:224] Handling call
0709 12:21:44.394190 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.394449 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.394484 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.417979 (+ 23495us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.824315 (+406336us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.974163 (+149848us) log.cc:844] Serialized 14 byte log entry
0709 12:21:44.976704 (+  2541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.976795 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.474483 (+497688us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b240020af38. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:21:45.617543 (+143060us) raft_consensus.cc:1685] finished
0709 12:21:45.617687 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.617869 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2088,"prepare.queue_time_us":50519,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":5463,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":37846,"spinlock_wait_cycles":52005632,"thread_start_us":513578,"threads_started":2,"wal-append.queue_time_us":407492}
I20260709 12:21:45.775626  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:45.776197  8070 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:45.777381  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.778297  8066 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:45.779247  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:45.779908  8763 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:45.473266  9896 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:45.759539  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.680594  8765 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
W20260709 12:21:45.554746  9971 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.123s	user 0.007s	sys 0.000s
I20260709 12:21:45.453776  9659 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.703119  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.799034  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.591017  9928 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:45.803444  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.757970  9898 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:45.775372  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.782457  8214 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:45.677767  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.493820  9923 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.455624  9899 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.396584  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:45.791725  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.456338  9961 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.839666  8139 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:45.765944  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.654199  9740 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.492961  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:45.680842  9968 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.796195  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.678400  9881 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.591118  9970 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:45.758342  9956 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.799844  8143 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:45.769991  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.758795  9866 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:45.933354  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.934329  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:45.935523  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.774921  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.806480  8212 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:45.720750  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1080) took 1270 ms. Trace:
W20260709 12:21:45.791301  8756 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:21:45.937702  8220 rpcz_store.cc:276] 0709 12:21:44.450294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.453499 (+  3205us) service_pool.cc:224] Handling call
0709 12:21:44.453867 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.481318 (+ 27451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.481351 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.481411 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:44.481444 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.720321 (+1238877us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:45.720398 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.720653 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61245312}
I20260709 12:21:45.810931  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:45.950718  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 139871us
I20260709 12:21:45.948208  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.952070  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.953151  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.954005  8063 raft_consensus.cc:2410] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:45.814257  8214 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:45.818364  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.474227  9939 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.783921  9735 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:45.961724  9735 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:45.822278  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.963865  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.964759  8066 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:21:45.822935  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:45.966159  8069 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:45.967368  8069 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:45.804539  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.830132  8070 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:45.968950  8145 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:45.969808  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.514824  9721 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.784459  9896 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:45.983978  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 183704us
I20260709 12:21:45.835151  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:45.836158  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.753583  9768 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:21:45.866895  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1086) took 1365 ms. Trace:
I20260709 12:21:45.867712  8141 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:45.988349  8141 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:45.929032  9935 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:45.875319  9748 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.940654  9822 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:21:45.883599  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:45.888542  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:46.005260  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:46.005616  8067 raft_consensus.cc:2376] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5. Re-sending same reply.
I20260709 12:21:46.006083  8064 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:46.005259  8761 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:45.890398  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.891506  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:45.453886  9727 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.681047  9726 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 12:21:45.947094  8756 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:45.911628  9961 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.915247  7964 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 251) took 6868 ms. Trace:
I20260709 12:21:45.821482  9928 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.918474  9970 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.928354  8764 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:45.805163  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.958948  9881 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.002939  9935 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:45.808429  9765 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:45.957415  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:46.041757  9950 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.002s
I20260709 12:21:45.970839  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:46.057135  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.972812  8062 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 12:21:45.973692  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:45.960507  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:46.059052  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 98613.3us
I20260709 12:21:45.965657  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:46.061048  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
W20260709 12:21:46.065496  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 91893.8us
I20260709 12:21:46.066778  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:46.068928  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.071153  8215 raft_consensus.cc:1217] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:21:46.071810  8215 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:45.962687  9735 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:45.980930  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:45.986511  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 151434us
I20260709 12:21:45.987998  8217 rpcz_store.cc:276] 0709 12:21:44.501189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.866692 (+365503us) service_pool.cc:224] Handling call
0709 12:21:45.866678 (+999986us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:45.866832 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114468224}
I20260709 12:21:46.086695  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:46.087977  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:46.088088  9939 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:45.868660  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.985975  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:46.055403  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:46.089092  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 103190us
I20260709 12:21:46.089743  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:46.090067  9925 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.000s
I20260709 12:21:46.090590  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:46.090533  9925 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.073674  9725 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.950618  9956 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.092259  9956 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.092156  9725 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:46.092926  9923 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:46.093335  9923 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.093735  9923 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.095528  9725 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:46.096117  9725 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:45.975380  9957 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:45.971256  9933 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:46.091519  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:46.099500  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:46.013245  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 175213us
I20260709 12:21:46.013967  8064 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:46.017416  8216 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:46.005017  8141 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.036185  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:45.988183  9896 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:45.985009  9866 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:46.100126  9925 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:45.989976  9578 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:46.139999  9898 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.096484  9725 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.140434  9909 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:46.012176  8061 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:45.937633  8138 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:45.936586  8142 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:45.958487  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.000808  9545 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:21:46.080891  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.062328  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:46.098680  8069 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:46.142344  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:46.112457  8217 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:46.053399  9935 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.143748  8141 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.132414  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:45.978834  8063 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:46.144385  8761 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:46.054459  9730 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:46.082464  8140 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:46.144999  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:46.055826  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:46.275385  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:46.155114  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:46.208110  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65846.3us
I20260709 12:21:46.175079  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1092) took 1614 ms. Trace:
I20260709 12:21:46.146714  9725 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:46.277380  8213 rpcz_store.cc:276] 0709 12:21:44.560451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.192116 (+631665us) service_pool.cc:224] Handling call
0709 12:21:45.192905 (+   789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.109117 (+916212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:46.109165 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.109227 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:46.109271 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.174765 (+ 65494us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54000e6354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:46.174817 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.174999 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12992,"raft.queue_time_us":44667,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2076327680}
W20260709 12:21:46.246421  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 165622us
I20260709 12:21:46.075742  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:46.039597  7964 rpcz_store.cc:276] 0709 12:21:39.046718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.047021 (+   303us) service_pool.cc:224] Handling call
0709 12:21:45.915135 (+6868114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:44.695430 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:44.703835 (+  8405us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:44.703876 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:21:44.703893 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:44.704374 (+   481us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:44.704437 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:44.704482 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:44.704923 (+   441us) tablet.cc:701] Row locks acquired
0709 12:21:44.704943 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:44.705148 (+   205us) write_op.cc:270] Start()
0709 12:21:44.705298 (+   150us) write_op.cc:276] Timestamp: P: 1783599704705089 usec, L: 0
0709 12:21:44.705323 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:21:44.706352 (+  1029us) log.cc:844] Serialized 929 byte log entry
0709 12:21:45.340697 (+634345us) op_driver.cc:464] REPLICATION: finished
0709 12:21:45.904680 (+563983us) write_op.cc:301] APPLY: starting
0709 12:21:45.904891 (+   211us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:45.905066 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:45.905276 (+   210us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:45.905702 (+   426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:45.905953 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:45.906028 (+    75us) write_op.cc:312] APPLY: finished
0709 12:21:45.906327 (+   299us) log.cc:844] Serialized 29 byte log entry
0709 12:21:45.906566 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.906722 (+   156us) write_op.cc:454] Released schema lock
0709 12:21:45.906787 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:45.907337 (+   550us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.907378 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1450529,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":465971,"apply.run_cpu_time_us":2671,"apply.run_wall_time_us":69227,"num_ops":2,"prepare.queue_time_us":1462780,"prepare.run_cpu_time_us":23833,"prepare.run_wall_time_us":311848,"raft.queue_time_us":221213,"raft.run_cpu_time_us":15496,"raft.run_wall_time_us":446789,"replication_time_us":619388,"thread_start_us":1678717,"threads_started":4,"wal-append.queue_time_us":370932}]]}
W20260709 12:21:46.395500  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 250568us
I20260709 12:21:46.096432  9979 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:46.214627  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:46.064605  9765 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.448215  8213 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:46.140012  9726 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:46.451078  8213 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:46.078652  9954 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:46.084023  9836 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:46.106765  9916 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.002s
I20260709 12:21:46.272797  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.223757  8145 raft_consensus.cc:2410] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:46.278636  8765 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:46.465220  8142 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:21:46.300069  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.465945  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.004s	sys 0.012s
W20260709 12:21:46.466288  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.012s
I20260709 12:21:46.277637  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:46.466544  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 773970us
I20260709 12:21:46.392056  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:46.467206  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:46.418110  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:46.448236  8141 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:46.100805  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.100379  9721 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:46.250084  8143 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:46.111603  9933 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:46.112437  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:46.259833  9730 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:46.245728  9925 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:46.467299  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 75426us
I20260709 12:21:46.491775  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.468158  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1043) took 2347 ms. Trace:
I20260709 12:21:46.492607  8141 rpcz_store.cc:276] 0709 12:21:44.121205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.409623 (+288418us) service_pool.cc:224] Handling call
0709 12:21:44.422798 (+ 13175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.867581 (+1444783us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000bd4a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:21:46.467873 (+600292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.468099 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340621568}
I20260709 12:21:46.105257  9881 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:46.472182  8219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.012s
W20260709 12:21:46.526226  8219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.005s	sys 0.012s
I20260709 12:21:46.387856  9902 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:46.475796  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.531994  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 2.
I20260709 12:21:46.533924  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 278) took 1077 ms. Trace:
I20260709 12:21:46.534365  8145 rpcz_store.cc:276] 0709 12:21:45.456779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.532886 (+1076107us) service_pool.cc:224] Handling call
0709 12:21:46.533299 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.533523 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.533561 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.533618 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:46.533661 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.533729 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.533858 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.481479  8143 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:46.539887  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 272) took 1104 ms. Trace:
I20260709 12:21:46.543716  8143 rpcz_store.cc:276] 0709 12:21:45.435456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.480867 (+1045411us) service_pool.cc:224] Handling call
0709 12:21:46.481241 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.539562 (+ 58321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.539819 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.486682  8139 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:46.147871  9909 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.483454  9933 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:46.510205  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.440834  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2373) took 1178 ms. Trace:
W20260709 12:21:46.560072  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 49904.3us
I20260709 12:21:46.561015  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.476456  9903 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:46.076052  9950 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:46.590101  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 122974us
I20260709 12:21:46.482935  8142 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:46.461577  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1164) took 1368 ms. Trace:
I20260709 12:21:46.468712  9916 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:46.605669  8218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.048s
W20260709 12:21:46.607066  8218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.007s	sys 0.048s
I20260709 12:21:46.528558  9836 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:46.484737  9912 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:21:46.559546  8145 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:46.463749  8759 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:46.562827  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.146461  9898 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:46.526486  9839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.019s	sys 0.018s
I20260709 12:21:46.145686  9866 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.471751  9982 raft_consensus.cc:2764] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:21:46.634260  8146 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:21:46.490902  9925 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:46.556458  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:46.638671  8063 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:46.609448  8067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.039s
W20260709 12:21:46.639761  8067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.039s
I20260709 12:21:46.529413  9902 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.622457  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 279) took 1165 ms. Trace:
W20260709 12:21:46.642647  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.011s
W20260709 12:21:46.626001  8731 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.029s
I20260709 12:21:46.483804  9789 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 12:21:46.588644  9736 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:46.587947  9740 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:46.609725  9619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.034s	sys 0.052s
I20260709 12:21:46.592027  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 269) took 1157 ms. Trace:
I20260709 12:21:46.676009  8142 rpcz_store.cc:276] 0709 12:21:45.434553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.482083 (+1047530us) service_pool.cc:224] Handling call
0709 12:21:46.482440 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.591724 (+109284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.591955 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:46.644567  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.007s	sys 0.011s
W20260709 12:21:46.644829  8731 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.013s	sys 0.029s
W20260709 12:21:46.680111  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 568979us
I20260709 12:21:46.644227  8145 rpcz_store.cc:276] 0709 12:21:45.457112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.535466 (+1078354us) service_pool.cc:224] Handling call
0709 12:21:46.535806 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.622127 (+ 86321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.622396 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.608737  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 286) took 1004 ms. Trace:
W20260709 12:21:46.629427  9839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.019s	sys 0.019s
W20260709 12:21:46.652375  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.063s
W20260709 12:21:46.682931  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.063s
W20260709 12:21:46.683446  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.633567  9735 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:46.646064  9916 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:46.642508  9727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.008s
I20260709 12:21:46.645239  9925 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.722085  8063 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:21:46.622853  9822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.021s	sys 0.029s
W20260709 12:21:46.699229  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 421686us
I20260709 12:21:46.645617  9928 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:46.650460  9902 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:46.672246  9923 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.001s
I20260709 12:21:46.685493  9970 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:46.654019  9545 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:46.690172  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.674839  9619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.035s	sys 0.053s
I20260709 12:21:46.598454  8140 rpcz_store.cc:276] 0709 12:21:45.092739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.129920 (+ 37181us) service_pool.cc:224] Handling call
0709 12:21:45.890235 (+760315us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:46.451310 (+561075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8556416}
I20260709 12:21:46.643127  9836 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:21:46.723127  8144 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:46.560350  8061 rpcz_store.cc:276] 0709 12:21:45.209801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.213202 (+  3401us) service_pool.cc:224] Handling call
0709 12:21:45.492739 (+279537us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b5800010598. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967e9c 00007f4989967a5b 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:46.281221 (+788482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11547520}
I20260709 12:21:46.716739  9954 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:46.716181  9740 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:46.755492  9978 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:21:46.759284  9659 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.000s
I20260709 12:21:46.759720  9659 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.726677  9735 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:46.726055  9916 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:46.741209  9990 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:46.750183  9909 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:46.753170  9881 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.763134  9950 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:46.729209  9822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.022s	sys 0.029s
W20260709 12:21:46.717024  9727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.012s	sys 0.008s
I20260709 12:21:46.766402  8217 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:46.772230  9896 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.004s
W20260709 12:21:46.744772  9976 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.633s	user 0.001s	sys 0.000s
I20260709 12:21:46.685894  8137 rpcz_store.cc:276] 0709 12:21:45.604468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.083178 (+478710us) service_pool.cc:224] Handling call
0709 12:21:46.605027 (+521849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:46.778679  9898 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:46.764259  9545 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.782099  9921 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:46.802256  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.802652  9725 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.806676  9916 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:46.809902  9968 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.000s
I20260709 12:21:46.810715  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2386) took 1441 ms. Trace:
I20260709 12:21:46.810380  9968 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.795173  9765 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:46.811105  8218 rpcz_store.cc:276] 0709 12:21:45.369666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.775225 (+405559us) service_pool.cc:224] Handling call
0709 12:21:45.775533 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.792013 (+ 16480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.792045 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.796390 (+  4345us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.927277 (+130887us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800406cc0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:21:46.607437 (+680160us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:46.607474 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.607538 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.810411 (+202873us) raft_consensus.cc:1685] finished
0709 12:21:46.810440 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.810644 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":24497,"spinlock_wait_cycles":4136192,"thread_start_us":679948,"threads_started":1,"wal-append.queue_time_us":991210}
I20260709 12:21:46.815310  9925 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.793143  9735 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.816748  8145 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:46.778707  9933 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.818334  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.818775  8214 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:46.774838  9956 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.001s
I20260709 12:21:46.802978  8140 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:46.782743  9909 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.745244  9923 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.756050  9740 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.819053  8145 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:46.811358  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 193) took 1180 ms. Trace:
I20260709 12:21:46.831202  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2387) took 1459 ms. Trace:
W20260709 12:21:46.844852  8731 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.623s (SENT)
W20260709 12:21:46.846611  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 255591us
I20260709 12:21:46.845151  9979 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:46.849910  8065 rpcz_store.cc:276] 0709 12:21:45.630572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.630935 (+   363us) service_pool.cc:224] Handling call
0709 12:21:45.948758 (+317823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.949045 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.949078 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.975813 (+ 26735us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.479043 (+503230us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:46.479099 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.479178 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.810198 (+331020us) raft_consensus.cc:1685] finished
0709 12:21:46.810218 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.811120 (+   902us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540011e4d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:46.811298 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729872128,"thread_start_us":435159,"threads_started":1,"wal-append.queue_time_us":622289}
W20260709 12:21:46.907802  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62995.3us
I20260709 12:21:46.780191  9730 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:46.915923  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:46.800405  9950 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:46.994899  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:46.995749  8145 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 1.
I20260709 12:21:46.825119  9545 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:46.972371  8731 leader_election.cc:336] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.650s (SENT)
I20260709 12:21:46.997157  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:46.991233  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2393) took 1577 ms (client timeout 1706 ms). Trace:
W20260709 12:21:46.999066  8216 rpcz_store.cc:269] 0709 12:21:45.445182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.453431 (+  8249us) service_pool.cc:224] Handling call
0709 12:21:46.991026 (+1537595us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000e6d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:46.991169 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873390464}
W20260709 12:21:46.991405  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 75587.7us
I20260709 12:21:46.991469  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1258) took 1121 ms. Trace:
W20260709 12:21:46.992808  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69907.2us
I20260709 12:21:46.819020  9989 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:47.004251  8139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 284) took 1545 ms (client timeout 1935 ms). Trace:
W20260709 12:21:47.024837  8139 rpcz_store.cc:269] 0709 12:21:45.460664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.840361 (+379697us) service_pool.cc:224] Handling call
0709 12:21:46.997326 (+1156965us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400312754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:47.004177 (+  6851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914033920}
I20260709 12:21:46.996918  9940 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:46.800088  9896 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.849368  9985 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.988511  9765 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.090531  9916 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:46.988353  9982 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:47.006114  9748 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:47.066243  9984 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:21:47.120695  8220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.001s	sys 0.029s
I20260709 12:21:46.845510  9956 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.005357  9867 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:47.004351  9725 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:47.104929  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.006980  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.032795  9940 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:46.853186  9909 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.032619  9903 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:47.055016  9989 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:47.121043  8220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.001s	sys 0.029s
W20260709 12:21:47.725347  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 752960us
W20260709 12:21:47.285451  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.015s	sys 0.048s
W20260709 12:21:47.727018  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.740s	user 0.028s	sys 0.056s
W20260709 12:21:47.326642  8035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.077s	sys 0.192s
W20260709 12:21:47.727705  8035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.103s	sys 0.217s
W20260709 12:21:47.377074  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.002s
W20260709 12:21:47.728021  8109 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.046s	sys 0.026s
W20260709 12:21:47.730018  8109 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.046s	sys 0.026s
I20260709 12:21:47.139256  9982 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.003784  8067 rpcz_store.cc:276] 0709 12:21:45.870507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.006261 (+135754us) service_pool.cc:224] Handling call
0709 12:21:46.033778 (+ 27517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.034052 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:46.046016 (+ 11964us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.990982 (+944966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.991057 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:46.991137 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.991233 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.991378 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283,"prepare.queue_time_us":12698,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":104849,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":944472,"threads_started":2,"wal-append.queue_time_us":691550}
W20260709 12:21:47.730538  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 647144us
I20260709 12:21:47.727105  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 203) took 1893 ms. Trace:
I20260709 12:21:47.731421  8069 rpcz_store.cc:276] 0709 12:21:45.833429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.977112 (+143683us) service_pool.cc:224] Handling call
0709 12:21:45.985692 (+  8580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.208381 (+222689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.726833 (+1518452us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:47.727034 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259394304}
I20260709 12:21:47.201225  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 266) took 1319 ms. Trace:
I20260709 12:21:47.499058  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.736013  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1061) took 1001 ms. Trace:
I20260709 12:21:47.734722  8763 rpcz_store.cc:276] 0709 12:21:45.881439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.275891 (+394452us) service_pool.cc:224] Handling call
0709 12:21:46.341202 (+ 65311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.469681 (+128479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.469711 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.476982 (+  7271us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.826065 (+349083us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:46.826125 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.826216 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.200937 (+374721us) raft_consensus.cc:1685] finished
0709 12:21:47.200964 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.201144 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105379,"raft.queue_time_us":128711,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16154,"thread_start_us":348643,"threads_started":1,"wal-append.queue_time_us":722063}
W20260709 12:21:47.269716  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.023s	sys 0.043s
W20260709 12:21:47.741662  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.033s	sys 0.057s
W20260709 12:21:47.742276  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.17947e+06us
I20260709 12:21:47.742993  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:47.743815  9954 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:47.744213  9954 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.728320  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.012s	sys 0.011s
I20260709 12:21:47.744570  9954 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:47.406957  9979 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.752693 10023 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:47.728152  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.02098e+06us
I20260709 12:21:47.013908  9950 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.753648 10023 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.754571  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:47.197687  9992 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.362s	user 0.000s	sys 0.000s
I20260709 12:21:47.118196  9765 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.736580  8139 rpcz_store.cc:276] 0709 12:21:46.734110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.026093 (+291983us) service_pool.cc:224] Handling call
0709 12:21:47.735448 (+709355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.762337  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.121449  8138 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:47.763461  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1266) took 1764 ms. Trace:
I20260709 12:21:47.770340  8068 rpcz_store.cc:276] 0709 12:21:45.999378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.052833 (+ 53455us) service_pool.cc:224] Handling call
0709 12:21:46.053193 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:46.065168 (+ 11975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.065210 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:46.076922 (+ 11712us) log.cc:844] Serialized 52 byte log entry
0709 12:21:46.588649 (+511727us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:46.616862 (+ 28213us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.617153 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.996056 (+378903us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000fdcd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:46.996125 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.763058 (+766933us) raft_consensus.cc:1685] finished
0709 12:21:47.763199 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.763365 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7224,"prepare.queue_time_us":27997,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":109469,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":28055,"spinlock_wait_cycles":26609024,"thread_start_us":491543,"threads_started":1,"wal-append.queue_time_us":672478}
I20260709 12:21:47.763599  8139 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:47.774358  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.780983  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1063) took 1045 ms. Trace:
I20260709 12:21:47.781708  8139 rpcz_store.cc:276] 0709 12:21:46.735670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.774008 (+1038338us) service_pool.cc:224] Handling call
0709 12:21:47.780900 (+  6892us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:47.587162  9935 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.201s	user 0.012s	sys 0.000s
W20260709 12:21:47.205224  9957 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.411s	user 0.001s	sys 0.001s
W20260709 12:21:47.141085  9726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.023s
I20260709 12:21:47.820835  9954 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:47.823305  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2377) took 2456 ms (client timeout 1599 ms). Trace:
I20260709 12:21:47.673552  9923 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:47.823786  8212 rpcz_store.cc:269] 0709 12:21:45.366609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.366740 (+   131us) service_pool.cc:224] Handling call
0709 12:21:47.823029 (+2456289us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:47.823180 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383894912}
I20260709 12:21:47.766770  9960 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:47.352648  9925 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:47.676144  9896 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:47.667794  9970 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:47.111461  9985 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.769834  9659 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:47.824170  9726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.024s	sys 0.060s
W20260709 12:21:47.824404  9921 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.023s	user 0.011s	sys 0.000s
I20260709 12:21:47.815649  9982 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:47.842193  9923 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.120128  9916 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.823359  9954 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:47.824610  9935 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:47.874013  8764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 424) took 2571 ms (client timeout 2697 ms). Trace:
W20260709 12:21:47.874524  8764 rpcz_store.cc:269] 0709 12:21:45.302180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.302559 (+   379us) service_pool.cc:224] Handling call
0709 12:21:47.873721 (+2571162us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54005b0754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:47.873905 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428754688}
I20260709 12:21:47.873024  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:47.876685  8760 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:21:47.877190  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 272) took 1993 ms (client timeout 2610 ms). Trace:
W20260709 12:21:47.877564  8760 rpcz_store.cc:269] 0709 12:21:45.883504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.089883 (+206379us) service_pool.cc:224] Handling call
0709 12:21:47.872839 (+1782956us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:47.877125 (+  4286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114762496}
I20260709 12:21:47.878003 10013 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:47.878609 10013 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.879514  8758 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:47.848974 10005 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:47.872213  9903 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.845647  9726 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:47.866142  9730 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:47.850714  9923 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.866492 10020 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.889024 10020 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.844108  9940 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.892788  9940 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:47.893391  9578 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:47.893823  9578 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:47.865872  9659 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:21:47.894662  9578 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:47.884761  9545 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.853s	user 0.004s	sys 0.007s
I20260709 12:21:47.844470  9970 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.896996  9748 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:47.896694  9545 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.897480  9748 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:47.898615  9970 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:47.899502  9545 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:47.887390  9726 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:47.901297  9935 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:47.902474  9902 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.157s	user 0.011s	sys 0.000s
I20260709 12:21:47.902884  9902 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:47.892325 10015 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:21:47.905843  9902 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:47.855924  9896 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:47.958166  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 273) took 2522 ms. Trace:
I20260709 12:21:47.957829  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1064) took 1221 ms. Trace:
W20260709 12:21:47.958882  8142 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.008s	sys 0.029s
W20260709 12:21:48.040061  8142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.008s	sys 0.029s
I20260709 12:21:48.038847  9896 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:47.960677  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 216052us
I20260709 12:21:48.041790  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 295) took 2223 ms. Trace:
I20260709 12:21:47.959942  8213 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:48.042966  9896 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:47.961894  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 207287us
W20260709 12:21:48.047303  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.962424  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2390) took 2558 ms. Trace:
I20260709 12:21:48.049228  8220 rpcz_store.cc:276] 0709 12:21:45.404201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.959437 (+555236us) service_pool.cc:224] Handling call
0709 12:21:45.959750 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.960141 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.960169 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.960649 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.726083 (+1765434us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:47.726139 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.726231 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.891585 (+165354us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:21:47.961621 (+ 70036us) raft_consensus.cc:1685] finished
0709 12:21:47.961677 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.962136 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":30073216,"thread_start_us":1716852,"threads_started":1,"wal-append.queue_time_us":1782421}
I20260709 12:21:47.826119  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.965268  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:47.923764 10024 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:48.052810  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1065) took 1315 ms. Trace:
I20260709 12:21:48.053571 10024 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:48.054095 10012 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:48.054518  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 227) took 2063 ms. Trace:
I20260709 12:21:48.055274 10012 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:47.980410 10016 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.964330  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 274) took 2080 ms. Trace:
I20260709 12:21:48.057145 10016 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.057013  8761 rpcz_store.cc:276] 0709 12:21:45.884168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.439236 (+555068us) service_pool.cc:224] Handling call
0709 12:21:46.439706 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.439986 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:46.767664 (+327678us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.963359 (+1195695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.963492 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:47.963657 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.963783 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.964030 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":553380,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":178324,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":1500114,"threads_started":3,"wal-append.queue_time_us":1152810}
I20260709 12:21:48.048072  9989 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.061002  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1067) took 1292 ms. Trace:
I20260709 12:21:48.061816  8110 leader_election.cc:400] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 5.
I20260709 12:21:48.055521 10024 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:46.907095  8219 rpcz_store.cc:276] 0709 12:21:45.371392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.776175 (+404783us) service_pool.cc:224] Handling call
0709 12:21:45.776483 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:45.794888 (+ 18405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.794922 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:45.800295 (+  5373us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.879456 (+ 79161us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b48000b0c58. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:21:46.526694 (+647238us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:46.830181 (+303487us) log.cc:844] Serialized 14 byte log entry
0709 12:21:46.830687 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.830784 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.830833 (+    49us) raft_consensus.cc:1685] finished
0709 12:21:46.830949 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.831120 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98150,"raft.queue_time_us":24810,"raft.run_cpu_time_us":2856,"raft.run_wall_time_us":93210,"spinlock_wait_cycles":12222848,"thread_start_us":883767,"threads_started":2,"wal-append.queue_time_us":891203}
I20260709 12:21:48.063645  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:48.006541  8731 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.341s (SENT)
I20260709 12:21:48.017060  9986 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.055090  8211 rpcz_store.cc:276] 0709 12:21:45.991312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.756882 (+765570us) service_pool.cc:224] Handling call
0709 12:21:48.051946 (+1295064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.052574 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.052610 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.052733 (+   123us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:48.052791 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.052899 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.054082 (+  1183us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400373a50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:48.054265 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2977274752}
I20260709 12:21:48.034097  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2391) took 2629 ms. Trace:
I20260709 12:21:48.066836  8214 rpcz_store.cc:276] 0709 12:21:45.404525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.957168 (+552643us) service_pool.cc:224] Handling call
0709 12:21:45.957461 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.827833 (+870372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.033529 (+1205696us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b540017cfd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:48.033901 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980410752}
W20260709 12:21:48.025868  8146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1177) took 2803 ms (client timeout 3155 ms). Trace:
I20260709 12:21:48.037703  9909 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.039088  8137 rpcz_store.cc:276] 0709 12:21:46.736360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.836022 (+ 99662us) service_pool.cc:224] Handling call
0709 12:21:47.957302 (+1121280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:48.068790  9909 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.051400  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2398) took 2078 ms. Trace:
I20260709 12:21:48.038479  8141 rpcz_store.cc:276] 0709 12:21:45.435722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.529234 (+1093512us) service_pool.cc:224] Handling call
0709 12:21:46.590203 (+ 60969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.590499 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.590548 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.608430 (+ 17882us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.001054 (+392624us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:47.001287 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.001414 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.957350 (+955936us) raft_consensus.cc:1685] finished
0709 12:21:47.957434 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.957885 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":341324,"threads_started":1,"wal-append.queue_time_us":1261564}
I20260709 12:21:48.069821  8217 rpcz_store.cc:276] 0709 12:21:45.972328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.214306 (+241978us) service_pool.cc:224] Handling call
0709 12:21:48.050845 (+1836539us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400169ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:48.051133 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743572864}
I20260709 12:21:48.070647  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:48.071774  8757 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:21:48.068219  8146 rpcz_store.cc:269] 0709 12:21:45.222795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.222946 (+   151us) service_pool.cc:224] Handling call
0709 12:21:48.025378 (+2802432us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001c43d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:48.025641 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3061200128}
I20260709 12:21:48.061543  8140 rpcz_store.cc:276] 0709 12:21:46.769093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.016032 (+246939us) service_pool.cc:224] Handling call
0709 12:21:48.060900 (+1044868us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:48.065970  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 59763.9us
I20260709 12:21:48.005753  9916 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.016753  9933 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.053259  8139 rpcz_store.cc:276] 0709 12:21:46.737110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.783693 (+1046583us) service_pool.cc:224] Handling call
0709 12:21:48.052574 (+268881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:47.896001  9578 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.066124 10016 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:48.047358  8035 leader_election.cc:336] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.626s (SENT)
I20260709 12:21:48.049255  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2385) took 2680 ms. Trace:
I20260709 12:21:48.072618  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 265) took 2191 ms. Trace:
I20260709 12:21:48.109477  8757 rpcz_store.cc:276] 0709 12:21:45.881083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.209680 (+328597us) service_pool.cc:224] Handling call
0709 12:21:48.070185 (+1860505us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:48.072484 (+  2299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173442304}
W20260709 12:21:48.114212  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50826us
I20260709 12:21:48.115736  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:48.077405  8731 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.110s (SENT)
I20260709 12:21:48.091639  8215 rpcz_store.cc:276] 0709 12:21:45.369350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.773743 (+404393us) service_pool.cc:224] Handling call
0709 12:21:45.774039 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.072185 (+298146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.048608 (+1976423us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400373a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:48.049027 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682947328}
I20260709 12:21:48.073941  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 632) took 2395 ms. Trace:
I20260709 12:21:48.122644  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:48.131877  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1072) took 1332 ms. Trace:
I20260709 12:21:48.042235  8142 rpcz_store.cc:276] 0709 12:21:45.818706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.677399 (+858693us) service_pool.cc:224] Handling call
0709 12:21:46.678122 (+   723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.678425 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.678458 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.679088 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.013124 (+334036us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:48.040683 (+1027559us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.041274 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.041444 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.041510 (+    66us) raft_consensus.cc:1685] finished
0709 12:21:48.041524 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.041728 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":904151,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":746,"raft.queue_time_us":2717,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":262,"thread_start_us":1360469,"threads_started":2,"wal-append.queue_time_us":1193341}
I20260709 12:21:48.121722  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1071) took 1326 ms. Trace:
W20260709 12:21:48.142793  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.144989  9736 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.134800  9989 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.159976  9836 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.161054  9836 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.162130  9735 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:48.162949  9735 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.168566  9735 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:48.175560  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0339740079998592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:21:48.175978  9956 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.176785  9735 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.146000  9736 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.185635  9736 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:48.187384  9961 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:48.187841  9961 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:21:48.190047  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 142956us
I20260709 12:21:48.190407  9968 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:48.190826  8035 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.681s (SENT)
I20260709 12:21:48.193001  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:48.192250  9961 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.195009  9961 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.176498  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.212188  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1178) took 1209 ms. Trace:
W20260709 12:21:48.215302  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.137949  8137 rpcz_store.cc:276] 0709 12:21:46.794774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.069342 (+1274568us) service_pool.cc:224] Handling call
0709 12:21:48.070097 (+   755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.070848 (+   751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.070897 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.071776 (+   879us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.093685 (+ 21909us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:48.093748 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.093863 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.096407 (+  2544us) raft_consensus.cc:1685] finished
0709 12:21:48.096448 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.120034 (+ 23586us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":547,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":216,"thread_start_us":21282,"threads_started":1,"wal-append.queue_time_us":21792}
I20260709 12:21:48.133965  8758 rpcz_store.cc:276] 0709 12:21:45.678582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.753250 (+ 74668us) service_pool.cc:224] Handling call
0709 12:21:47.409659 (+1656409us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:21:47.879289 (+469630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.879996 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.073317 (+193321us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54005b0750. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:48.073655 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030353536}
I20260709 12:21:48.223389 10012 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:48.223982  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 71983.5us
I20260709 12:21:48.226574  9985 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.181713  9836 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:48.227108  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.229736  9735 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.230458 10013 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.231171 10013 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.232259  9735 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:48.234571  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:48.236888  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98059.5us
I20260709 12:21:48.238615  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 282) took 2780 ms. Trace:
I20260709 12:21:48.237432  9982 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:48.234619  8144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1054) took 2937 ms (client timeout 1852 ms). Trace:
W20260709 12:21:48.251780  8144 rpcz_store.cc:269] 0709 12:21:45.297422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.299327 (+  1905us) service_pool.cc:224] Handling call
0709 12:21:48.234207 (+2934880us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002f1f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:48.234433 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2966205184}
I20260709 12:21:48.252938  9986 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:48.253908 10012 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:48.261478  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.261873 10012 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.262499 10012 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.254884  9903 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:48.257714  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 271) took 2822 ms. Trace:
I20260709 12:21:48.237619  9940 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.242328  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.245366  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.250303  9748 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.279946  9748 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.241801  8143 rpcz_store.cc:276] 0709 12:21:45.457890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.547710 (+1089820us) service_pool.cc:224] Handling call
0709 12:21:46.548127 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.607511 (+ 59384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.607540 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:46.607583 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:46.607623 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.237997 (+1630374us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400254254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:48.238075 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.238364 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135593856}
I20260709 12:21:48.281865  8143 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:48.283356  8143 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:48.268286  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 261) took 2481 ms. Trace:
I20260709 12:21:48.283903  9954 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.249935  9968 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:48.284660  9954 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.251152  9923 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.286267  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.286983  8143 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.287079  9954 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:48.272167  8142 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:48.137651  8141 rpcz_store.cc:276] 0709 12:21:46.799325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.070648 (+1271323us) service_pool.cc:224] Handling call
0709 12:21:48.071182 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.071746 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:48.077732 (+  5986us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.131476 (+ 53744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.131540 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:48.131611 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.131680 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.131821 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":456,"prepare.queue_time_us":5394,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":14972,"thread_start_us":41996,"threads_started":1,"wal-append.queue_time_us":63395}
I20260709 12:21:48.288568  8139 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:21:48.288537  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.289062  8139 pending_rounds.cc:85] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 2
I20260709 12:21:48.288866  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.265895  8138 rpcz_store.cc:276] 0709 12:21:45.435174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.489612 (+1054438us) service_pool.cc:224] Handling call
0709 12:21:46.557349 (+ 67737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:47.777992 (+1220643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.257169 (+479177us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400256054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:48.257506 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296739072}
I20260709 12:21:48.289397  8142 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
W20260709 12:21:48.289554  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.272528  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.292444  8140 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:48.268839  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.272970  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:48.274613  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 98341.2us
I20260709 12:21:48.275254  9735 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.275353 10024 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.275504 10023 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.277069 10027 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:48.280220  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2401) took 2307 ms. Trace:
I20260709 12:21:48.285045  9968 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:48.273452  9578 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:48.316771  9578 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:48.262764  8144 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:48.290431  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.318004  9578 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.305423  8213 rpcz_store.cc:276] 0709 12:21:45.973134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.452010 (+478876us) service_pool.cc:224] Handling call
0709 12:21:46.452266 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.043271 (+1591005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.279856 (+236585us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003a6e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:48.280115 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3465582976}
W20260709 12:21:48.320011  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51319.8us
I20260709 12:21:48.321164  8069 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:48.322364  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:48.323273  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.324118  8144 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.328125  9765 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.319975  8138 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 6 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:21:48.309312  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56728.6us
I20260709 12:21:48.309018  9903 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.311281  8067 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:48.312351  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:48.289443  8139 pending_rounds.cc:107] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:21:48.313648  8034 connection.cc:256] RPC call timeout handler was delayed by -2.1666665849998026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:21:48.284190  8762 rpcz_store.cc:276] 0709 12:21:45.784727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.074903 (+2290176us) service_pool.cc:224] Handling call
0709 12:21:48.075538 (+   635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.076329 (+   791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.076378 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.117067 (+ 40689us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.150492 (+ 33425us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:48.150544 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.150630 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.265053 (+114423us) raft_consensus.cc:1685] finished
0709 12:21:48.265084 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.265616 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1390,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"thread_start_us":32875,"threads_started":1,"wal-append.queue_time_us":91684}
W20260709 12:21:48.332456  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 173725us
I20260709 12:21:48.334275  8139 raft_consensus.cc:2889] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.212749  8146 rpcz_store.cc:276] 0709 12:21:47.003309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.073263 (+1069954us) service_pool.cc:224] Handling call
0709 12:21:48.073925 (+   662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:48.074509 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:48.120696 (+ 46187us) log.cc:844] Serialized 14 byte log entry
0709 12:21:48.211727 (+ 91031us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:48.211783 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:48.211871 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.211952 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.212093 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5156,"prepare.queue_time_us":44967,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":130,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":172,"thread_start_us":72663,"threads_started":1,"wal-append.queue_time_us":77702}
I20260709 12:21:48.362232  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:48.360658  8034 connection.cc:256] RPC call timeout handler was delayed by -1.9956665849995261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:21:48.363550  8034 connection.cc:256] RPC call timeout handler was delayed by -1.9083665849998397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:21:48.363878  8034 connection.cc:256] RPC call timeout handler was delayed by -1.8786665849997917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:21:48.351550  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.368224  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.364490  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:48.375866  8137 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:48.379139  8064 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.355173  9923 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:48.386588  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.383810  9735 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:21:48.388746  8034 connection.cc:256] RPC call timeout handler was delayed by -1.7642905630000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:21:48.389199  8034 connection.cc:256] RPC call timeout handler was delayed by -1.5973893079999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:21:48.389518  8034 connection.cc:256] RPC call timeout handler was delayed by -1.4341164389998085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:21:48.389815  8034 connection.cc:256] RPC call timeout handler was delayed by -1.3163864949997333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 12:21:48.390142  8034 connection.cc:256] RPC call timeout handler was delayed by -1.2621665849997044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2819s for a response
W20260709 12:21:48.390440  8034 connection.cc:256] RPC call timeout handler was delayed by -1.033134309000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:21:48.362334  9765 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.364493  9954 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:48.400909  9954 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.401736  8064 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:48.403417  9954 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.403730  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:48.404076  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81987.5us
I20260709 12:21:48.404618  8213 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.406997  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.408479  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:48.408831  9916 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.409315  8215 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.410637  9768 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:48.411147  9916 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.411278  9768 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:48.413308  8144 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:48.414402  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.414702 10020 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.415141  8144 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.394335  8146 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:48.394754  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.392441  9735 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.397008  9730 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.399767  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.394559 10025 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:48.411746  9916 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.427582  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.428257  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.429221  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:48.429282  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.430145  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.430377  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.426100  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:48.438026  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 360719us
I20260709 12:21:48.425840  9730 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.441010  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.412379  9768 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.683975  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:48.441012  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 83158.8us
I20260709 12:21:48.449100  8217 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:48.598806  8213 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
W20260709 12:21:48.590956  8731 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.213s (SENT)
I20260709 12:21:48.483645  8219 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:48.489583  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.441011  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.618901  8143 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:48.478715  8212 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:48.729562  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.484223 10013 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.496918  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:48.746928  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.747437  8218 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:48.585539  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.663391  8215 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:48.592823  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.470837  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.721652  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.483837  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.751178  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:48.488142  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.431264 10025 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:48.729508  8066 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:48.496897  8137 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.755038  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.758553  8070 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:48.483906  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:48.488703  9950 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.492825  8068 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:48.723052  9735 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:48.645992  9916 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:48.802414  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:48.593639 10045 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.530030  9933 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.727887  9578 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.596786  9903 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.436805  8146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:48.809921  8146 raft_consensus.cc:606] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:48.803740 10013 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.810432  8146 raft_consensus.cc:614] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:48.761938  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:48.471593  8184 leader_election.cc:336] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.545s (SENT)
I20260709 12:21:48.801661  8220 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:21:48.759680  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.714118  9923 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.450145  8211 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:48.772960  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.535725 10012 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.804545  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.762390  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.821349  8212 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:48.766201  8143 raft_consensus.cc:2376] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3. Re-sending same reply.
I20260709 12:21:48.786326  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.767369  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.772301  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.808000  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.773166 10002 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:48.836503  8063 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.634114  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.766767  9912 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.766634  8216 raft_consensus.cc:2376] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4. Re-sending same reply.
I20260709 12:21:48.816457  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.836717  8062 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:48.837868  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.535629  9968 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.841302  8064 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:48.844198  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.845530  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.846642  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.847711  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.851817  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.853245  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.853979  8141 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.828527  9765 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:48.857208  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.768838  9730 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:48.819239  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 233962us
I20260709 12:21:48.824038 10013 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:48.824939  8065 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:48.827001 10046 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:48.527204  9985 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.293s
I20260709 12:21:48.829607  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.830428  8137 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:48.831317  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:48.771620  9982 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.003s
I20260709 12:21:48.815157  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.585572  9989 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.229s
I20260709 12:21:48.859648  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.863314  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.817730  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.838892  8144 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:48.841948  7965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 171) took 8124 ms. Trace:
I20260709 12:21:48.873220  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.875434  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.895927  8140 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:48.889158  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.890125  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:48.869861  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:48.898200  8137 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:48.897459  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.885492  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.898830  8146 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:48.899667  8066 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:48.902719  8065 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:48.899971  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:48.896890  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.843664 10045 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.913028  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:48.914281  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.860404  9933 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.921413  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.922152  8138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:48.923238  8213 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:48.924813  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:48.925859  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:48.927765  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 496050us
I20260709 12:21:48.896560  9903 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:48.922741  8138 raft_consensus.cc:606] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:48.924136  8062 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:48.931146  8139 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:48.936398  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.940567  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.942284  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:48.943248  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 463990us
I20260709 12:21:48.944219  8064 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:48.893092  9923 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.949285  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.952375  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.882193  7967 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 4 to 5, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.955999  8139 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:48.941351 10048 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:21:48.959810  8070 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:48.901882 10002 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:48.960667  8140 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 2.
I20260709 12:21:48.969914  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:48.971863  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.973138  8143 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:48.974330  8068 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:48.974417  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.978781  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:48.979488  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:48.979807  8184 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.556s (SENT)
I20260709 12:21:48.981765  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.990209  8139 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:48.990120  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.992806  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.994513  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:48.914913 10025 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:48.998525  8064 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:48.978441  9981 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.002349  9735 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:48.961135 10013 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:21:48.961645  9903 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.002432  8065 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:49.009368  8070 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:49.010027  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.012738  8140 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:48.994443  9836 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.005309  7967 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.008710  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.017146  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.996001 10012 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.018036  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:48.996500  9721 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:21:48.894420  7965 rpcz_store.cc:276] 0709 12:21:40.438766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.439124 (+   358us) service_pool.cc:224] Handling call
0709 12:21:44.286125 (+3847001us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b54001a5aa8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919dc9b4 00007f49904c03dc 00007f4990481e0b 00007f4990481be4 00007f4992981fa1 00007f49929827ff 00007f4992841a1b 00007f499294990e 00007f4990e0a2a4 00007f4990e0a232
0709 12:21:45.721269 (+1435144us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b54001a5a00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49903f6161 00007f49904cab89 00007f49904c07ad 00007f4990481e0b 00007f4990481be4 00007f4992981fa1 00007f49929827ff 00007f4992841a1b 00007f499294990e 00007f4990e0a2a4 00007f4990e0a232
0709 12:21:48.554100 (+2832831us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:46.558631 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:46.779149 (+220518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:46.779197 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:21:46.779225 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:46.779904 (+   679us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:46.779973 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:46.780003 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:46.780360 (+   357us) tablet.cc:701] Row locks acquired
0709 12:21:46.780382 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:21:46.780561 (+   179us) write_op.cc:270] Start()
0709 12:21:46.780715 (+   154us) write_op.cc:276] Timestamp: P: 1783599706780496 usec, L: 0
0709 12:21:46.780735 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:21:46.793150 (+ 12415us) log.cc:844] Serialized 1302 byte log entry
0709 12:21:47.929294 (+1136144us) op_driver.cc:464] REPLICATION: finished
0709 12:21:47.979005 (+ 49711us) write_op.cc:301] APPLY: starting
0709 12:21:47.979228 (+   223us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:47.979513 (+   285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:47.979757 (+   244us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:47.980651 (+   894us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:47.981141 (+   490us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:47.981222 (+    81us) write_op.cc:312] APPLY: finished
0709 12:21:47.981773 (+   551us) log.cc:844] Serialized 35 byte log entry
0709 12:21:47.982073 (+   300us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:47.982324 (+   251us) write_op.cc:454] Released schema lock
0709 12:21:47.982403 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:47.992365 (+  9962us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:47.992410 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2336684,"reported_tablets":10,"spinlock_wait_cycles":9402496,"child_traces":[["op",{"apply.queue_time_us":49057,"apply.run_cpu_time_us":4298,"apply.run_wall_time_us":13411,"num_ops":3,"prepare.queue_time_us":739180,"prepare.run_cpu_time_us":4700,"prepare.run_wall_time_us":307440,"replication_time_us":1148347,"thread_start_us":345917,"threads_started":2}]]}
I20260709 12:21:49.033699  9940 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.029914  7967 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:49.031265  8035 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.796s (SENT)
I20260709 12:21:49.030656 10020 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:49.044616 10020 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:49.045590  9903 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:49.043684  8137 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:49.047417  8035 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:49.048235  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50105.5us
I20260709 12:21:49.049134  8064 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:49.050314 10050 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:21:49.034185 10046 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:49.050926  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 95860.4us
W20260709 12:21:49.053565  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46631.2us
I20260709 12:21:49.055510 10016 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:49.055765 10053 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:21:49.055594 10046 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.056574 10025 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.059021 10046 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.050508  9940 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:49.061515  8184 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.677s (SENT)
I20260709 12:21:49.062414  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.061781  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1068) took 2288 ms. Trace:
W20260709 12:21:49.064054  8035 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.814s (SENT)
I20260709 12:21:49.103462  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:49.065187  8145 rpcz_store.cc:276] 0709 12:21:46.773229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.821817 (+1048588us) service_pool.cc:224] Handling call
0709 12:21:47.822279 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.248844 (+426565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.248889 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.433810 (+184921us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b2c00010c48. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:21:48.496777 (+ 62967us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.760352 (+263575us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:48.760389 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.760482 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.060495 (+300013us) raft_consensus.cc:1685] finished
0709 12:21:49.060528 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.061574 (+  1046us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79062,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":32105344,"thread_start_us":622409,"threads_started":2,"wal-append.queue_time_us":387562}
I20260709 12:21:49.090016  8062 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:49.093398  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.094921  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.097661  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.106588  8065 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:49.108045  8063 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:49.109122  8066 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:49.111752  8070 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 12:21:49.049881 10012 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:49.085973  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:49.116721  8760 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:49.088526  9912 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.068423  9730 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.093957  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:49.125026  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 165350us
I20260709 12:21:49.124526  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.086414  9903 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.108052 10002 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:49.105829  8062 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:49.136690  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.130604 10012 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.140230 10012 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.140877 10002 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:49.141369 10002 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:49.136173  8761 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.143121  8762 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:49.135712  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.122965  9933 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:49.146509  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.149081  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55472.6us
W20260709 12:21:49.150648  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.153764  9725 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.157369  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.158238  8765 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:49.160812  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.161512  8756 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:49.136610 10052 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:21:49.171241  8757 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:49.172049  8761 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:49.173678 10016 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.136993  9940 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.175632  9923 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.176374  9933 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.180667  8141 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:49.183472  9989 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:49.185813  8758 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:49.186125  9989 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:49.164229  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.186509  9989 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:49.187026  8759 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:49.187482  9989 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.188982  9989 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:49.182293  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118152us
W20260709 12:21:49.196184  8035 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.874s (SENT)
I20260709 12:21:49.141927 10002 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:49.179603  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 93480.9us
I20260709 12:21:49.204375  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:49.201165  8035 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.997s (SENT)
I20260709 12:21:49.207585 10016 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.149055  7967 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.213588  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.214238 10023 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:49.214707 10023 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:49.215582 10023 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:49.220819 10057 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:49.221917 10020 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.223073 10020 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.211679  7967 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.224665  7967 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 2, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.226329  7967 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.232831 10023 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.265242  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.129565 10045 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.265789  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:49.278091  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.278614  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.279523  8138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:40658
I20260709 12:21:49.279613  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.280303  8138 raft_consensus.cc:606] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:49.280792  8138 raft_consensus.cc:614] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:49.251087  9721 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.272797  7967 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 3 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:49.288693  8035 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.102s (SENT)
I20260709 12:21:49.289242  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.289978  8141 raft_consensus.cc:2376] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5. Re-sending same reply.
W20260709 12:21:49.290032  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44687.1us
I20260709 12:21:49.299279  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:49.296132  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.317816  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.311542  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.318972  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.294325 10016 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:49.317590  7967 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 3, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.331023  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1084) took 1020 ms. Trace:
I20260709 12:21:49.333364  8138 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:49.333309  9721 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:49.337718  9721 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.340871  9912 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.341578  9912 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.345150  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.345882  8141 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:49.347862  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.347798  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.348850  9923 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.349318  8759 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:49.349448  9923 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.332186  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.350829  9985 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.351397  8758 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:49.351428  9985 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.350669  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.354046  9985 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.354369  8141 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:49.354673  9985 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.355289  9985 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.356859  8145 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:49.333827 10063 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:49.359040  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.359136  8756 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:49.359870  8140 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:49.360739  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.360992  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.361194  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.361929  8142 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:49.361948  8140 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:49.329116  9730 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.363749  9730 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:49.363986  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.364277  9730 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.365363  9748 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:49.365814  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.366909  9748 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:49.367301  9748 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:49.367558  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93182.9us
I20260709 12:21:49.368278  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.368839  9836 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:49.367731  9748 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.369390  9836 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:49.370329  9836 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.373219  8138 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:49.375573  8220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c14c286147e549768b521ff92a61fec9"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:21:49.376250  8220 raft_consensus.cc:606] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:49.376336  8757 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:49.332875 10016 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:49.378044  7967 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 1 to 3, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:49.393890  9985 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:49.403036  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.298539  9981 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:49.332414  8146 rpcz_store.cc:276] 0709 12:21:48.311100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.904000 (+592900us) service_pool.cc:224] Handling call
0709 12:21:48.908846 (+  4846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.933186 (+ 24340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.933216 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.957530 (+ 24314us) log.cc:844] Serialized 26 byte log entry
0709 12:21:49.144022 (+186492us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:49.144047 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.144136 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.330810 (+186674us) raft_consensus.cc:1685] finished
0709 12:21:49.330828 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.330964 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3796,"raft.queue_time_us":6019,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":13505,"thread_start_us":153944,"threads_started":1,"wal-append.queue_time_us":299017}
W20260709 12:21:49.388027  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.407918  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:49.415822  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.386885 10016 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.437239  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.303097  9735 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 12:21:49.408167  9981 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:49.459386  9748 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.459456  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.463047  9912 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.463747  9866 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:49.464190  9866 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:49.466069 10066 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
W20260709 12:21:49.466373 10067 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:49.466217  9748 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.471159  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.472822  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:49.474462  9866 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.475806  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:49.476018  9866 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:49.455368  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.482364  9923 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.481894  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:49.476780  9578 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:49.485069  9578 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:49.485474  9578 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:49.486323  9578 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.487541  9578 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.476374  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.494705  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.495679  8758 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:21:49.500223  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 134524us
I20260709 12:21:49.501650  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.503012  9981 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.509759 10002 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.510386  9981 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:49.503988  8757 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:49.504695  9735 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.505175 10045 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.506990  9730 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:49.550158  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48571.2us
I20260709 12:21:49.563504  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.572206 10020 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:49.572924 10020 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:49.576510  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 100191us
I20260709 12:21:49.539788 10002 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:49.526259  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 189153us
I20260709 12:21:49.583997  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:49.586197  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.576510  9968 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.591367  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.590698  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.590140  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:49.590698  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 299016us
I20260709 12:21:49.586918  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:49.590796 10045 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.620178  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:49.592934  9940 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:49.624233  8763 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:49.603063 10012 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.603853  9725 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.630155  8212 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:49.632066  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.634007  8219 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:49.634197  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:49.635070  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.631421  9725 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:49.636207  9725 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.636562  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:49.638082 10002 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:21:49.666659 10069 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:21:49.668051  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.671559  8067 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:49.680755  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.681963  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.682672  8068 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:49.683990  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:49.684376  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52474us
I20260709 12:21:49.685272  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:49.685695 10072 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:21:49.686470  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 49990.5us
I20260709 12:21:49.687343  9735 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:49.687736  9735 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:49.688223  9866 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.688678  9735 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.688498  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:49.692142  8146 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:21:49.646358 10020 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.692586  8146 pending_rounds.cc:85] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
I20260709 12:21:49.694088  8146 pending_rounds.cc:107] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:21:49.694357  8146 raft_consensus.cc:2889] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:49.694804  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55496.9us
I20260709 12:21:49.695729  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.625881  9940 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.698881  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.699040  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.700237  9940 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:49.700961  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.701732  8212 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:49.702436  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.703085  8145 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:49.702529 10012 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.703207  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.703826 10012 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.703847  8138 raft_consensus.cc:2376] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3. Re-sending same reply.
I20260709 12:21:49.671439  9923 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.707857  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.710512  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.711205  8140 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:49.713009  9735 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.713073  9866 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:49.703329  8144 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:49.714233  9866 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:49.714682  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.715541  8146 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:49.718535  9721 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:49.721040  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.722641  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.723380  8214 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:49.723712  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 412251us
I20260709 12:21:49.723970 10084 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.725208  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.725358  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:49.720486  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.723739  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.646697 10077 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:21:49.737238  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:49.742198  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.707440 10063 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.746611  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.752740  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.753051  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.753650  8145 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:49.709336  9968 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:49.709061 10045 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.757678  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.757790  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.759464  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.759917  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.761392  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.762188  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:49.763269  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.763409  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.764663  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.764734  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.765622  8217 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:49.766039  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.766604  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.767184  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.767886  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.768285  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.768672  8217 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:49.769351  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.770089  8216 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:49.771140  8216 pending_rounds.cc:85] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
I20260709 12:21:49.771405  8216 pending_rounds.cc:107] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:21:49.771638  8216 raft_consensus.cc:2889] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:49.772439  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:49.774377  9940 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.774968  9940 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.775497  9940 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.779459  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:49.782495 10073 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.786965  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.787307  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:49.788465  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.788698  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.789148  8066 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:49.783512 10073 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.790184 10073 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.790774  8069 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:49.789058  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.791715  8061 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.792368  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:49.793386  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.792451  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.794585  8068 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
W20260709 12:21:49.795301  8035 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.682s (SENT)
I20260709 12:21:49.798583  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.799232  8069 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:49.800148  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:49.683460 10081 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:21:49.759500  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.732918 10012 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:49.807864  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.745652  9721 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:49.821012  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.756757  9923 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:49.756093  9730 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:49.832660  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:49.833298  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73860.3us
W20260709 12:21:49.833364  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78901.4us
I20260709 12:21:49.857721  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:49.805549 10025 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.818580  9578 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:49.878057  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.870012  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:49.869226  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:49.870873  9968 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:49.884198  8212 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.887508  8138 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:49.888425  8213 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:49.898204  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.886996 10020 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.899961  9721 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:49.877259 10023 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:49.901262 10023 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.901628 10023 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.906847 10025 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.907483 10025 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:49.908021 10025 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:49.910019  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:49.911823  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 119490us
I20260709 12:21:49.913260  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:49.848726  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:49.938649  8219 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:49.945822  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:49.950886  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.878324 10045 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:49.952039  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:49.952668  8143 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:49.957348  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 233255us
I20260709 12:21:49.896278 10083 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.958598  9912 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:21:49.989863  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 76711.6us
I20260709 12:21:49.933655  9578 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:49.961347 10045 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:50.017329  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54841.8us
I20260709 12:21:50.032640  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:50.038952  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:50.036988 10063 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:50.036119 10045 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:50.069731  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 332449us
I20260709 12:21:50.037410  9836 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:50.090045  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.129313  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:50.133698  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.138211  8143 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:50.138798  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.140177  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:50.106406 10069 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.146358  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:50.131875 10016 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.004s
W20260709 12:21:50.182577  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 150028us
W20260709 12:21:50.183071  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 144242us
W20260709 12:21:50.255232  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 108971us
I20260709 12:21:50.256835  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.188499 10063 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.147603  8141 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:50.213394 10093 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:21:50.141441  9933 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.130990 10096 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:50.218531  8212 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:50.142673 10073 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.216984  9923 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:50.136138  9578 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.133527 10092 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:50.182377  9903 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:50.136113 10084 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:50.182662 10077 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:50.118809  9836 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.232573 10114 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:50.233235 10101 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 12:21:50.233522 10100 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:21:50.234620  8061 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:21:50.234645 10089 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:21:50.232702  9725 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
W20260709 12:21:50.236100 10091 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.333s	user 0.000s	sys 0.004s
W20260709 12:21:50.237344 10080 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 12:21:50.237902  9748 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:50.239218  9768 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:50.140110  9940 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.217193  9985 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.266884  8141 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:50.230038  9735 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.007s
I20260709 12:21:50.095250  9968 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.359683  8137 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:50.283061  9933 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:50.299883  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:50.364166  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64377.9us
I20260709 12:21:50.301425  8143 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:50.329150 10114 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.369813  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:50.370049  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65613.2us
I20260709 12:21:50.226836 10102 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.288967 10016 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.308199 10069 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:50.314106 10092 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:50.303800  9903 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.389376 10084 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.390120 10120 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.390664 10120 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:50.391124 10120 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.393118 10095 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.393730 10095 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.357271 10083 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:21:50.365229  9933 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.400545 10105 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:50.401171 10105 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:50.401292 10092 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:50.402177 10117 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:50.402436 10105 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.403836 10045 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.376188 10102 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.405169 10102 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:50.408736 10023 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 12:21:50.408957  8759 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:50.409665  9981 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.005s
I20260709 12:21:50.410283  8215 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:50.371147  8144 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:50.412207  9940 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.288923 10103 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.288317 10108 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:21:50.342243 10086 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
W20260709 12:21:50.363166  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 525032us
I20260709 12:21:50.423728 10103 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:50.426592  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.232585 10078 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.356999  9725 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.304788  9923 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.362119  8141 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.338217 10096 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:50.337318 10077 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:50.431469 10077 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.431509 10096 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.400719 10098 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.433667  8144 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:50.433528 10098 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.435441 10016 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:50.404480 10073 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:50.435900 10098 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:50.437809  9725 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:50.375085 10075 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.329190  8067 raft_consensus.cc:2368] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4.
I20260709 12:21:50.375839 10114 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.355114  9748 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:50.357260  9768 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:50.388746  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:50.385514 10025 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:50.389652 10094 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:21:50.389919 10076 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
I20260709 12:21:50.416765  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:50.390372  9903 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:50.428521  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:50.396380 10095 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.425072 10121 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:50.443239  8141 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.380333  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:50.453244  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64596.1us
I20260709 12:21:50.462992  8218 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:50.453950  9985 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:50.438956  9940 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:21:50.442626  9735 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:21:50.464594  9768 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.451761  9748 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:50.467204 10025 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:50.427920 10078 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.469988  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:50.498974  8137 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.429024 10103 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.425741 10023 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.495465  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:50.514933  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234877us
I20260709 12:21:50.516162  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.494568  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:50.535387  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.565991  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.566776  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.586916  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:50.611773  8140 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:50.500422  9923 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:50.507800 10078 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.512712  9912 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.618948  8137 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:50.608816  9725 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:50.623946  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 107904us
W20260709 12:21:50.624172  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 112156us
I20260709 12:21:50.627139  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:50.631253  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:50.628757  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 248516us
I20260709 12:21:50.526335 10020 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.631991  8137 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:50.633800  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:50.638417  8141 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:21:50.638937  8141 pending_rounds.cc:85] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 1
I20260709 12:21:50.639287  8141 pending_rounds.cc:107] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:50.639679  8141 raft_consensus.cc:2889] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.626570  9768 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:50.634757  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47956.3us
I20260709 12:21:50.623389  9985 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.622157  8144 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:50.629669 10073 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:50.708793 10125 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:50.748227 10145 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:50.749042 10118 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:50.749747 10074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.019s	sys 0.032s
I20260709 12:21:50.631572  9912 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.754786 10023 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.637842 10085 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:50.757467  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 58221.9us
I20260709 12:21:50.795707  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:50.623512 10025 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:50.629220  9923 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:50.817232 10045 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.748394 10130 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:50.817554  9923 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.818315 10130 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:50.813236 10125 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.819567 10130 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.820901 10125 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.701200  9940 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:50.821596  9940 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:21:50.797564  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.679s (SENT) [suppressed 50 similar messages]
I20260709 12:21:50.810894  8141 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:21:50.793833  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 274717us
I20260709 12:21:50.755072 10120 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.812397 10002 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:50.818100 10135 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:21:50.810333 10074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.019s	sys 0.032s
I20260709 12:21:50.643486 10098 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
I20260709 12:21:50.820372  9923 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:50.641422  9725 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.642360 10020 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:50.834791  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 135386us
I20260709 12:21:50.757807 10147 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:21:50.841480  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 414941us
W20260709 12:21:50.865641  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.879509  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:50.894526  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.828331  9721 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.828125 10023 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.928581  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:50.830940 10118 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:50.835847 10125 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:50.826277 10002 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:50.950651  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:50.933130  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1224) took 1021 ms. Trace:
I20260709 12:21:50.951470  8140 rpcz_store.cc:276] 0709 12:21:49.911272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.911550 (+   278us) service_pool.cc:224] Handling call
0709 12:21:49.911922 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.620987 (+709065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.932577 (+311590us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400313154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:50.933047 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608676096}
W20260709 12:21:50.935433  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.936764  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:50.810284  9985 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.948263  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:50.948285  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:50.939260  8064 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:50.973060  8062 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:50.973179  8066 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:50.961447  8144 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:50.961560 10144 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:50.962145 10137 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.211s	user 0.004s	sys 0.001s
W20260709 12:21:50.963213 10134 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:21:50.834044 10025 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:21:50.813529 10145 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:50.918883  8137 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:50.981889  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:50.982115 10118 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.984028 10097 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.841833  9940 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:50.904237 10147 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:50.985682  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57211.5us
I20260709 12:21:51.403178  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:51.021008  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:51.297008  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.953610 10125 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.987666  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:51.407276  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 527855us
I20260709 12:21:51.408236  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:51.055442  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:51.095291  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:51.409320  8069 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.044643  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:51.412432  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.412920  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.413410  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.414112 10146 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:51.409257  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:51.414963 10146 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:51.296267 10127 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:21:51.276225 10078 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.641s	user 0.003s	sys 0.007s
W20260709 12:21:51.301271  9903 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.810s	user 0.005s	sys 0.005s
W20260709 12:21:51.256572 10142 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:21:51.404659 10063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.012s	sys 0.010s
W20260709 12:21:50.985697 10138 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:21:51.175172 10102 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.002s
I20260709 12:21:51.476850  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.477044  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.477828  8760 raft_consensus.cc:2410] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:51.047529  9933 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.001s
I20260709 12:21:51.468227  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.478358  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:51.400714 10128 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.479007  8757 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:51.290421  9912 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:50.933720 10023 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.418190 10125 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.471451  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.471647  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:50.987037 10119 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:51.036763 10020 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:51.474709  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:50.984107  9725 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:51.477703  8761 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
W20260709 12:21:51.076543 10084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.010s	sys 0.029s
I20260709 12:21:51.409111  9985 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:51.095033 10155 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:51.736548  9768 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.925s	user 0.014s	sys 0.007s
W20260709 12:21:51.737130 10114 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.266s	user 0.013s	sys 0.000s
I20260709 12:21:51.738102  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1225) took 1760 ms. Trace:
I20260709 12:21:51.737748 10114 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.738543  8138 rpcz_store.cc:276] 0709 12:21:49.977783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.977981 (+   198us) service_pool.cc:224] Handling call
0709 12:21:49.987538 (+  9557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.340917 (+353379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:50.340961 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.451968 (+111007us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.827172 (+375204us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.827215 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.827285 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.737876 (+910591us) raft_consensus.cc:1685] finished
0709 12:21:51.737896 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.738041 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30100,"raft.queue_time_us":34589,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3521,"thread_start_us":643805,"threads_started":2,"wal-append.queue_time_us":974072}
I20260709 12:21:51.740417  8063 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:51.476508  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:50.985977 10109 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.641s
I20260709 12:21:51.487380  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:51.462901 10148 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.471756 10063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.016s	sys 0.010s
I20260709 12:21:51.085490  9721 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.719805  8763 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
W20260709 12:21:51.619889 10107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.029s	sys 0.036s
W20260709 12:21:51.742947 10084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.010s	sys 0.045s
W20260709 12:21:51.754493 10107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.038s	sys 0.047s
W20260709 12:21:51.620218  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.023s	sys 0.043s
W20260709 12:21:51.757541  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.029s	sys 0.056s
I20260709 12:21:51.620492 10098 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.759172 10098 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.761828  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1215) took 2022 ms. Trace:
I20260709 12:21:51.761993 10098 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:51.762308  8142 rpcz_store.cc:276] 0709 12:21:49.739499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.739653 (+   154us) service_pool.cc:224] Handling call
0709 12:21:49.757591 (+ 17938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.832527 (+ 74936us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:49.909469 (+ 76942us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b1800282a00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:21:50.824102 (+914633us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b1800282a00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf
0709 12:21:50.826899 (+  2797us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.427072 (+600173us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.433966 (+  6894us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.434190 (+   224us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:51.434241 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.434356 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.761609 (+327253us) raft_consensus.cc:1685] finished
0709 12:21:51.761631 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.761766 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11087,"prepare.queue_time_us":232946,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":40184,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":58385,"spinlock_wait_cycles":73073920,"thread_start_us":496403,"threads_started":2,"wal-append.queue_time_us":783026}
W20260709 12:21:51.484436  9748 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.001s
I20260709 12:21:51.764339 10125 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.764695  9748 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.461869  9578 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:51.470396 10078 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.767391  9721 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:51.472420  9903 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.767699 10125 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:51.646332 10116 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:51.483978 10102 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.488104 10128 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.485728  9933 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.198159 10143 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.595s
I20260709 12:21:51.533150 10120 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:51.727298  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 241994us
W20260709 12:21:51.729517  8109 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.174s (SENT)
W20260709 12:21:51.774441  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44959.7us
W20260709 12:21:51.775202  8109 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.174s (SENT)
I20260709 12:21:51.775664  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:51.730064  8068 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:51.722424  8765 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:51.720570  8764 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:51.726001  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:51.528136 10103 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.002s	user 0.006s	sys 0.006s
I20260709 12:21:51.733081  8069 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:21:51.728683 10161 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.722487  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.742077  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:51.482664  8213 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:51.751528  8220 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:51.470206 10097 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.763732 10098 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.729357 10095 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:51.612128 10133 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.175s
I20260709 12:21:51.158073 10002 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.811801 10002 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:51.811918  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:51.740455 10114 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:51.781634  9748 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:51.781656 10158 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:51.788614  8069 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:51.787577 10103 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.792773  8765 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:51.793215  8761 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:51.762048 10023 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:51.768567 10078 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:51.807435  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:51.805371  8214 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:51.810071  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:51.796800 10163 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.806552 10120 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.810730  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.773500 10116 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.813280  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:51.869834 10133 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:51.814426 10098 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.870759 10143 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:51.794480 10161 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.907750  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:51.814119  9721 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.787982  9578 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.806723 10095 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:51.908352 10163 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.869992  9903 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:51.789199 10107 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.883435  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:51.808794  8758 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:51.797006  9768 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:51.812517  8068 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:51.910465 10078 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.908428  8069 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:51.908918 10103 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:51.909667  8762 raft_consensus.cc:2368] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4.
I20260709 12:21:51.913846  8765 pending_rounds.cc:85] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 5
I20260709 12:21:51.964349  8765 pending_rounds.cc:107] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:51.964913  8765 raft_consensus.cc:2889] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.915364  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:51.813014  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:51.924744  8764 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:21:51.933333  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.023s	sys 0.043s
W20260709 12:21:51.966450  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.023s	sys 0.043s
I20260709 12:21:51.966974  8761 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:51.969169  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.969689  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.925771 10133 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:21:51.976079  8184 connection.cc:256] RPC call timeout handler was delayed by -1.2165448580003613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 12:21:51.947660  8757 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:51.752895 10148 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:51.961508  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 78184.8us
W20260709 12:21:51.970178  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.937112  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123898us
W20260709 12:21:51.976559  8184 connection.cc:256] RPC call timeout handler was delayed by -1.1400448580002376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:21:51.982918  8184 connection.cc:256] RPC call timeout handler was delayed by -1.1274448580002172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:21:51.957203 10114 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:51.985080  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.984994  8069 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:51.981632  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:51.989854  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:51.989076  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:51.992708  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:51.997857  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:51.999241  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:52.008078  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.969055 10023 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:52.017757  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:52.011739  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:52.012825  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.016709  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:51.934504 10120 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.961704  9578 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:51.958104  9721 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:52.035637  8213 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:52.037487  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.038153  8219 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:51.980947  9903 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:52.039839  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.040499  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1299) took 1130 ms. Trace:
I20260709 12:21:52.017709  9985 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:51.954531 10116 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.041561  9985 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.041998  9985 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:52.042244 10097 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.043550 10116 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.043471 10133 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:51.960053 10143 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:52.045040 10133 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.017880 10125 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:52.050001  8764 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.040941  8062 rpcz_store.cc:276] 0709 12:21:50.910573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.468914 (+558341us) service_pool.cc:224] Handling call
0709 12:21:51.483324 (+ 14410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.528780 (+ 45456us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:51.956331 (+427551us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.040132 (+ 83801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.040192 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:52.040237 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.040306 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.040442 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":318350,"raft.queue_time_us":7457,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":291631,"threads_started":2}
I20260709 12:21:52.048413  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.049220  8216 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:52.010073  9768 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:52.049216  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.051081  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.018567 10023 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.054937  9933 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:52.055856  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 55094.8us
I20260709 12:21:52.057852  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.059068  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:51.979511 10078 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.029212 10103 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:52.037405 10092 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:52.055490  9721 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:51.988168 10107 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:52.049738 10125 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.053545  9768 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:52.073952  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.060559 10023 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:52.060889 10116 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:52.096043  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.063133 10114 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.088347  8219 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:52.093534  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.094964  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.098322  8765 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.064817 10109 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:52.108564  8761 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:52.055061 10164 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:52.111918  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.117178  8757 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:52.118955  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.056903  9903 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.076938 10125 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:52.075011 10104 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:52.130439 10098 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.130573 10171 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:52.090917  9768 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:52.039947 10095 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.160965 10095 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:52.165520 10161 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.166491 10109 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:52.137018  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.144060  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.096693 10102 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.146317  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:52.152804 10170 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:21:52.152935  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.153496 10128 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.158252 10078 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.159860  9578 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:52.159936  8764 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:21:52.142697  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 157428us
W20260709 12:21:52.170454  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51613us
I20260709 12:21:52.170670  8761 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:52.173760  8219 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:52.095608 10103 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:52.167273 10124 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:52.164229  9985 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.183018  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.183439 10143 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:52.167449 10164 consensus_queue.cc:1243] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:52.188472  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.227921  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.189198  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.240237  8216 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:52.241201  8756 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:52.242045  8216 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:52.243005  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.243429  8756 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:52.243829  8219 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:52.227152  8761 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:52.245493  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.246760  8757 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.246963  8217 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:52.247890  8220 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:52.249199  8219 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:52.251931  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:52.262943  8212 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:52.263582 10163 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.264286  9903 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.252287 10182 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.176839  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2418) took 1210 ms. Trace:
W20260709 12:21:52.254258  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.252051 10179 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.253139 10118 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:52.275914  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.271080  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.253099 10143 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.271075  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:52.287413  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107330us
I20260709 12:21:52.288326  8216 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:52.286442  8219 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:52.289024  8757 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:52.289426  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.296041  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.298599  8212 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:52.305596  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.308399  8216 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:52.276916 10182 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:52.322216  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.351871  8219 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:52.295256 10118 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.329460  9985 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.331771  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.358243  8757 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:52.275300  8061 rpcz_store.cc:276] 0709 12:21:50.966808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.756198 (+789390us) service_pool.cc:224] Handling call
0709 12:21:51.756582 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.756820 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:51.958390 (+201570us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.145534 (+187144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.145634 (+   100us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:52.145710 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.145828 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.174463 (+ 28635us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3670,"prepare.queue_time_us":300702,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":55,"raft.queue_time_us":7699,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6750,"thread_start_us":318254,"threads_started":2,"wal-append.queue_time_us":220984}
I20260709 12:21:52.345707  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:52.291612 10143 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.304020 10099 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:21:52.304157 10109 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:21:52.349968 10121 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:52.349967 10103 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.297654 10084 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:52.362439 10107 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.318955 10114 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:52.369329  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.370683  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:52.367619  8035 connection.cc:256] RPC call timeout handler was delayed by -1.8584619510002085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:21:52.403774  8035 connection.cc:256] RPC call timeout handler was delayed by -1.7549619510000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:21:52.405782  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:52.293411 10179 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.383507  9768 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.384503  9903 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.384847  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:52.386583 10187 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:21:52.368542 10121 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:52.416821  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:52.387226 10023 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.375125  8219 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:52.397981  8757 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:52.421600  8065 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:52.410226  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:52.422900  8062 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.414608  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:52.424971  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.425753  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:52.433463  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:52.435725  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50971.5us
I20260709 12:21:52.439666  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:52.432039  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:52.444972  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.445755  8065 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:52.425760  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.447093  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:52.694535  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:52.700838  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 253816us
I20260709 12:21:52.447242  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:52.691462  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:52.663981  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 272738us
W20260709 12:21:52.688499  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 249873us
I20260709 12:21:52.692068  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.644248  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.707098  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:52.641515  8138 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:52.710826  8068 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:52.711733  8216 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:21:52.500449  8110 connection.cc:256] RPC call timeout handler was delayed by -1.615074862000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 12:21:52.415467 10114 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:21:52.714851  8110 connection.cc:256] RPC call timeout handler was delayed by -1.534074862000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:21:52.603503 10133 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.001s
I20260709 12:21:52.736716  9578 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:52.601469  9940 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:52.737241  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4341748619999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
I20260709 12:21:52.452386 10125 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.599707 10099 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:52.738562  9985 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.738897  8219 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:52.739065  9985 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.739465 10125 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.714725 10171 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:52.740657 10171 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.741045 10171 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:52.741585  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2393544359997577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 12:21:52.740670  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.741364  9985 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.737097 10114 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:52.673884  8061 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:52.449168 10107 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:52.751518  9985 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:52.753587 10102 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:52.742340  9578 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.762599  8062 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:52.763772  9985 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.473073 10179 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:52.764588 10125 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.801367 10125 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.803552 10125 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.674069 10121 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:52.694496 10095 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:21:52.797030 10143 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.763214 10182 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:52.794258  8110 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.524s (SENT)
I20260709 12:21:52.806265  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:52.808178  8110 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.570s (SENT)
I20260709 12:21:52.446581  9768 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.796875 10185 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.793061 10103 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:52.791853 10107 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:52.797647  9578 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:52.818368  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.636s (SENT)
I20260709 12:21:52.822124  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:52.809887 10143 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:52.828960  8110 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.638s (SENT)
I20260709 12:21:52.829598  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:52.827064  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.822470 10023 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.821309 10185 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:52.854434  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 154818us
W20260709 12:21:52.855324  8035 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.852s (SENT)
I20260709 12:21:52.855885  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:52.858294  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:21:52.855952 10192 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:21:52.862129  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:52.833505  9768 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:52.875459  8066 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:52.866727  8110 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.679s (SENT)
I20260709 12:21:52.858112 10133 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:52.877252  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:52.865789 10023 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:52.875906  8066 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:52.867621 10095 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:52.866200 10179 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:52.882098  9985 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.882690 10118 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:52.885108  9836 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:52.885792  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1107) took 2456 ms. Trace:
I20260709 12:21:52.886735  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:52.867274 10012 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:52.890686  8066 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:52.901839  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 133995us
I20260709 12:21:52.904258  8066 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:52.895802  8139 rpcz_store.cc:276] 0709 12:21:50.429368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.429510 (+   142us) service_pool.cc:224] Handling call
0709 12:21:50.429876 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.439801 (+  9925us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:50.468958 (+ 29157us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.498959 (+ 30001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:50.499035 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.499084 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.816476 (+2317392us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b18002fe300. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419
0709 12:21:52.885515 (+ 69039us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b54000523d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:52.885593 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.885731 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29489,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":78,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10358,"spinlock_wait_cycles":43691520,"thread_start_us":28734,"threads_started":1,"wal-append.queue_time_us":154521,"wal-append.run_cpu_time_us":1653,"wal-append.run_wall_time_us":1126801}
I20260709 12:21:52.902623  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:52.892776 10179 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.896168 10095 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:52.893842  9768 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:52.909759 10179 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:52.919824  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 237) took 3273 ms (client timeout 2168 ms). Trace:
W20260709 12:21:52.920274  8211 rpcz_store.cc:269] 0709 12:21:49.646830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.658172 (+ 11342us) service_pool.cc:224] Handling call
0709 12:21:52.919580 (+3261408us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400134054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:52.919724 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453156224}
I20260709 12:21:52.921823  8211 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:52.923400  8756 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:21:52.926959 10147 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:52.911319  9836 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:52.929414  9836 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:52.929818  9836 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:52.931608  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.931972 10148 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:52.952948 10126 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 2.546s	user 0.020s	sys 0.013s
W20260709 12:21:52.953289  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.977335  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.978158  8757 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:52.984081  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.984894  8763 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:52.990028  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:52.996908  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:52.999112 10095 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:53.007910  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.018178  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:53.019025  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.020982 10105 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.022415 10179 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.031101 10077 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:53.036218 10077 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:53.038085 10185 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.035713  8761 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:53.035557  8765 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.039812  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:53.040997  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:53.041345  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.043814  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.037231 10077 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.045822  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.047693  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.005055 10120 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.053158  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.056141  8765 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:21:53.057698  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.058863  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.060413  8761 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:53.047871  9768 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:53.060848  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:53.062516  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.064977  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.065593  8761 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:53.073275  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.074671  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:53.069046  8061 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.080689  9578 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.084133  9578 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:53.085139 10179 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.074684 10148 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:53.085784 10148 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:53.076586 10198 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:21:53.064134 10077 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.086705 10148 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.087332  9836 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.067838 10120 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:53.088891 10120 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:53.089277 10120 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.089434  9836 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.085809  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:53.090616  8062 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:53.069380  9768 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:53.094444 10133 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:53.074322  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.096294  8066 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:21:53.122010  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 47797us
I20260709 12:21:53.123958  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.109953 10171 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.136334 10171 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:21:53.137336 10147 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:53.137811 10147 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.138167 10147 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.140123  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:53.142144  9578 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:53.115687 10120 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.118959  8061 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:53.068667 10102 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:53.127240 10179 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:53.129377  8220 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:53.128877 10133 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:53.128978  9768 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.130767 10146 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.130992  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.133148  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.133703 10185 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.110540 10023 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:53.142946  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.102221  8062 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:53.159626  8763 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:53.161796  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 96109.4us
I20260709 12:21:53.163141 10164 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:53.168426 10124 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:53.148905  9578 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.178561  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:53.183672  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52786.7us
I20260709 12:21:53.185318  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.186173  8220 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:53.188691  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:53.190215  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:53.192430  8220 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:53.175204 10185 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.158423 10025 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:53.180540 10075 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:53.197835  8214 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:53.178050  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:53.197029  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1133) took 3437 ms (client timeout 1737 ms). Trace:
I20260709 12:21:53.180354 10164 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:53.183213 10124 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:53.214962  8218 rpcz_store.cc:269] 0709 12:21:49.759431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.759638 (+   207us) service_pool.cc:224] Handling call
0709 12:21:53.196847 (+3437209us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:53.196951 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384281472}
I20260709 12:21:53.192173  9578 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:53.208915  8067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2409) took 3416 ms (client timeout 2174 ms). Trace:
I20260709 12:21:53.199642 10185 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.196619 10102 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.220750  8067 rpcz_store.cc:269] 0709 12:21:49.787260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.788756 (+  1496us) service_pool.cc:224] Handling call
0709 12:21:53.203090 (+3414334us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:53.203256 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203069184}
I20260709 12:21:53.207235  9940 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.205886 10171 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:53.229431 10164 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.226270  9940 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:53.242578  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 63517.1us
I20260709 12:21:53.197067 10114 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:21:53.257324  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.257720 10205 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:53.258253  9836 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:53.259694  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.261013  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.261399  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.262748  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.263325  8218 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:53.264144  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.265687  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.267385  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.268939  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.261940  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.270681  8220 raft_consensus.cc:2410] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:53.271469  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:53.273283  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 78040.6us
I20260709 12:21:53.274143  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.272173  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.275692  8218 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:53.275172  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:53.276775  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.262588  9940 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.280087  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.270094 10205 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:53.281780  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:53.282691  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.285422  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:53.286180  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.247745 10102 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.287925  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.276255 10164 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:53.300980 10208 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:53.303174  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1114) took 2785 ms. Trace:
I20260709 12:21:53.303558  8141 rpcz_store.cc:276] 0709 12:21:50.517734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.927149 (+409415us) service_pool.cc:224] Handling call
0709 12:21:51.418857 (+491708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.469905 (+ 51048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.469937 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:51.469983 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:51.470016 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.302891 (+1832875us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54002f1554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:53.302953 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.303121 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116747008}
I20260709 12:21:53.275844 10179 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:53.306435 10025 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:53.318547  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.282655 10083 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.325356  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:53.291924  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.333608  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.290419 10023 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.336741  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1134) took 3576 ms (client timeout 1852 ms). Trace:
I20260709 12:21:53.290169 10146 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:53.337177  8215 rpcz_store.cc:269] 0709 12:21:49.759752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.760228 (+   476us) service_pool.cc:224] Handling call
0709 12:21:53.336476 (+3576248us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54000ca3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:53.336572 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346022144}
I20260709 12:21:53.341195  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.341441  8061 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:53.341233 10023 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.337553  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:53.304965 10148 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.344000 10023 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.342103  8215 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:53.345536  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.346063  8215 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:53.348121 10102 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:53.343199  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.348937  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.349500  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.349598  8145 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:53.334594  8142 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:53.350591  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:53.354017  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.353732  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.354609  8139 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:53.353755  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.359287  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.359457  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:53.360244  8217 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.362136  8215 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:53.344256 10148 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.346123 10146 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.365098 10146 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.367245  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.368000  8139 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:53.368239  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.360548 10081 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.365098 10148 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.368678  9578 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.369289 10081 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.370018  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.370767  8220 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:53.371383  9578 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.371650 10081 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:53.372948  8142 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:21:53.373322  8142 pending_rounds.cc:85] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 1
I20260709 12:21:53.373595  8142 pending_rounds.cc:107] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:53.373859  8142 raft_consensus.cc:2889] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.375516 10121 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:53.377878  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1298) took 2468 ms. Trace:
I20260709 12:21:53.378276  8063 rpcz_store.cc:276] 0709 12:21:50.909134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.909702 (+   568us) service_pool.cc:224] Handling call
0709 12:21:50.926439 (+ 16737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.740945 (+814506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.377552 (+1636607us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400202bd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:53.377777 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871305088}
I20260709 12:21:53.379634  8137 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:53.380103  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.380234  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.380928  8139 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:53.381352  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.381916  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.381995  8137 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:53.382546  8141 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
W20260709 12:21:53.385519 10210 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:21:53.387748  8764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 284) took 1583 ms (client timeout 1888 ms). Trace:
I20260709 12:21:53.388612  8760 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:53.392051  8761 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:53.394832  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:53.336558 10025 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:53.396875  8146 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:53.397620 10025 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.398957  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.399719  8765 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:53.388203  8764 rpcz_store.cc:269] 0709 12:21:51.804853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.009849 (+204996us) service_pool.cc:224] Handling call
0709 12:21:53.387561 (+1377712us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b540049ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:53.387681 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21961472}
I20260709 12:21:53.402267  8764 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:53.404007  8764 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:53.404809  8138 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.406548  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.408319  8146 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:53.409034  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.409706  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.410151  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.410655  8142 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:53.411537  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:53.411777  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:53.412067  8142 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:53.414141  8139 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:53.415401  8139 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:53.417950  8143 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:53.417953  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.419183  8143 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:53.421514 10147 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.423906 10147 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.338976 10075 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:53.426067 10075 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.425136  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1160) took 1067 ms. Trace:
I20260709 12:21:53.429322  8214 rpcz_store.cc:276] 0709 12:21:52.357268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.704985 (+347717us) service_pool.cc:224] Handling call
0709 12:21:53.197506 (+492521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.210349 (+ 12843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.424961 (+214612us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400316ad0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:53.425075 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131755264}
I20260709 12:21:53.416575  8139 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:53.434834  8138 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:53.410740  8213 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.340445  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:53.430959  8036 connection.cc:256] RPC call timeout handler was delayed by -1.093026526000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:21:53.437918  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53376.9us
I20260709 12:21:53.443377  8145 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:53.446851  8213 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:53.448349  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:53.449242 10121 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:53.449498  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.449787 10121 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:53.450783 10121 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.461122  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.435782 10145 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.337299 10083 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.438285 10092 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:21:53.473712  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.478087 10162 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.478542 10162 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.478890 10162 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.469810 10081 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:21:53.477639  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.472026  8211 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:53.441605 10114 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:21:53.479837 10185 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.474494  9748 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:53.482115  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.488612  8217 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:53.510469  8146 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:53.513816  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 229678us
W20260709 12:21:53.515129  8184 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.238s (SENT)
W20260709 12:21:53.517736  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:53.524585  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53193.4us
I20260709 12:21:53.526124  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.530578 10081 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:53.532613 10081 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:21:53.538322 10075 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:53.539201 10075 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.542529 10075 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:53.554134  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.562330 10075 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:53.571158  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67742.7us
I20260709 12:21:53.505465  9748 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:53.508813 10105 raft_consensus.cc:2764] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:53.494663 10092 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:53.575837  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 60729.9us
I20260709 12:21:53.589622  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:53.574275  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.590968  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.481575 10217 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 12:21:53.504014 10124 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.574317 10077 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:53.603514 10124 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:53.605814 10092 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:53.607944  8034 connection.cc:256] RPC call timeout handler was delayed by -1.864498795000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:21:53.610723 10153 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.870s	user 0.002s	sys 0.003s
I20260709 12:21:53.615639  8761 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:53.618566  8762 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:53.621207  8034 connection.cc:256] RPC call timeout handler was delayed by -1.2932213190001676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:21:53.623334  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:53.623570  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.626246  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:53.629215 10231 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:53.629509 10185 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:53.630270 10124 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.600338 10226 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.600575 10077 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:53.630046  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:53.631487  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.636451  9836 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:53.639209 10155 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:53.631500 10233 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.668831  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:53.630035  9748 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.671134  8062 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:53.669546 10231 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.630136 10130 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:53.621528  9981 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:53.680963  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:53.681912  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91026.3us
I20260709 12:21:53.725314  8067 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.725558  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.687037  8764 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:53.621716 10108 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:53.688159  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 58195.3us
I20260709 12:21:53.643493  9866 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:53.688423  9836 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:53.688784 10155 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:53.682328 10077 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:53.746003 10215 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:21:53.673839  8034 connection.cc:256] RPC call timeout handler was delayed by -1.2218693160002658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260709 12:21:53.697053  8763 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:53.797266  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71794.9us
I20260709 12:21:53.802264  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:53.824738 10107 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:53.825279 10107 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:53.825662 10107 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:53.698644 10233 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.769294  9578 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:53.769632  9866 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:53.829618 10025 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.835199 10107 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.835476 10025 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:53.844298  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.850407  8142 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:53.701526 10231 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:53.920522  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:53.930873  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 128680us
I20260709 12:21:53.682147 10124 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:53.936327  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.936502  8139 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:53.682842 10226 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:53.971480  8218 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:53.961428  8220 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:53.963061  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.974069  8217 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:53.964435  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:53.965776  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:53.976060  8213 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:53.834234  9866 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:53.978545  8219 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:53.831060 10233 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:53.994488 10218 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
W20260709 12:21:54.001560  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 475494us
I20260709 12:21:54.003183  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:54.004827  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 254964us
W20260709 12:21:53.795586  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 172893us
I20260709 12:21:53.887118 10215 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:53.983893  8139 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:53.976969  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:54.004305  8216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.012s
W20260709 12:21:54.021077  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.043085  8216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.012s
I20260709 12:21:54.045527  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:53.966382 10198 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:54.052716  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 75901.1us
I20260709 12:21:53.833124  9578 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.062619  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.067305  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.045766 10239 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:21:54.050645 10092 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:21:54.008617  9836 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.154892  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:54.037554  8067 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:21:54.161055  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.109323  8764 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:21:54.080291  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.152689  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:54.168020  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 115832us
I20260709 12:21:54.009459 10025 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:54.041043 10155 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.176708  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.147590  8211 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:21:54.123087 10234 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:21:54.185222  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:54.188467  8063 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:54.191599  8068 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:54.183704  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.151930 10241 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:21:54.188864  9578 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:54.189064  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:54.189272  8067 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:54.190287 10155 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:54.190739  8211 pending_rounds.cc:85] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
W20260709 12:21:54.171422  9940 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.001s
W20260709 12:21:54.192451  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 141218us
I20260709 12:21:54.192984  8062 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:21:54.185745 10088 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:54.053929 10198 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.197680  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.186586 10216 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:54.129662 10107 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.065326 10114 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 12:21:54.236407 10198 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:54.092979  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.229673  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:54.177510 10092 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:21:54.225816  8211 pending_rounds.cc:107] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:21:54.102523 10227 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:21:54.232057  8065 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:54.197408  9836 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.071791 10235 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
W20260709 12:21:54.281385 10243 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:54.283020 10227 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:54.283471 10227 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:54.284098  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.300763  8213 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:54.301434  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.302248  8143 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:54.303113  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.303620 10077 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.304343 10241 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:54.304733 10241 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:54.304987  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:54.305805  8220 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:54.305552 10241 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.096995 10240 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 12:21:54.306983 10240 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:54.307335 10240 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:54.307564 10120 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:54.072592  9730 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:54.309176  9730 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:54.309558  9730 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:54.304042  9866 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.310386  9730 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.311661  9730 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:54.311791  9866 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.228248 10088 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:54.313256 10088 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.314459 10088 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:54.247931  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 646) took 2818 ms (client timeout 2387 ms). Trace:
W20260709 12:21:54.248258 10224 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:21:54.248574 10246 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:21:54.248823 10124 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:54.122499 10012 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:54.258193 10162 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.779s	user 0.006s	sys 0.011s
I20260709 12:21:54.102120 10108 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:21:54.266491  8068 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:54.269338  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:54.232542  9940 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.287451  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.266750  8211 raft_consensus.cc:2889] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.290192 10213 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:54.291050 10235 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:54.291725  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.294142 10215 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.308125 10240 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.299432 10248 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:54.299798  8216 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:54.305984 10077 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.065822 10103 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:54.317865  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:54.363068 10241 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.300791  8146 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:21:54.320245  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.368244 10012 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.185150 10226 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:54.321887  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152596us
I20260709 12:21:54.401903  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:54.319589  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 264993us
W20260709 12:21:54.363263  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 194049us
I20260709 12:21:54.321938 10116 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:54.295523 10160 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:54.315913 10105 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:54.389495  8145 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:54.375219  9981 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.394497 10217 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.376034 10244 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:21:54.371474 10162 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.407027  8064 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:54.322883 10198 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.408522  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:54.410028  8217 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:54.410583  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:54.411403  8214 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:54.400463 10012 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:54.426530 10164 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.427404 10025 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.438237  8218 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:54.465301  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:21:54.321728  8759 rpcz_store.cc:269] 0709 12:21:51.428996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.464205 (+ 35209us) service_pool.cc:224] Handling call
0709 12:21:54.188894 (+2724689us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:54.247772 (+ 58878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185470848}
I20260709 12:21:54.407193 10160 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:54.284373 10227 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.470584 10088 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:21:54.423341 10217 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:54.473374  9866 consensus_queue.cc:1175] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92362bf8983f4a71a3511e987a2c6578" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 12:21:54.473875  9940 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:54.421023 10120 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.474794 10120 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.422374  9981 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.470960 10248 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:54.478790  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:54.479662  9981 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.480556  8212 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:54.422104 10105 consensus_queue.cc:1243] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:54.477847  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:54.491533  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.466686 10164 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.466917 10025 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.497386  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:54.479185 10248 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.470757 10145 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:21:54.528960 10145 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:54.529454 10145 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:54.529660  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.415091 10116 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:54.432660 10077 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:21:54.576586  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.578563  8137 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:54.575156  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:54.579955  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 133793us
W20260709 12:21:54.580950  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 115741us
I20260709 12:21:54.581228  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:54.533716  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.577972  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:54.582746  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:54.585839  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:54.464550 10147 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:21:54.608767  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:54.609602  8137 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:54.604918  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:54.533659 10246 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:21:54.490404  9735 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:21:54.574388  9730 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:21:54.603605 10145 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:54.582026 10227 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:54.576177 10198 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:54.526847 10114 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:55.065029  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.692875  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1237) took 1354 ms. Trace:
W20260709 12:21:54.705717  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.775557  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:55.086680  8186 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.045s
W20260709 12:21:55.087421  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.088380  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.045862  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.091116  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:21:54.681398 10255 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:21:54.693003  8141 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:55.063663  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:55.059619  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 476917us
I20260709 12:21:55.095748  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:55.096040  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:55.064112  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 482924us
W20260709 12:21:55.059258  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.097577  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.071065  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.610782 10235 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:55.072535  8061 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [2.4-5.6]
I20260709 12:21:55.073791  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.105494  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:54.647092 10226 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:55.087603  8186 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.011s	sys 0.045s
W20260709 12:21:55.110138  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 529770us
I20260709 12:21:54.645532  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.086228  8138 rpcz_store.cc:276] 0709 12:21:53.338414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.338636 (+   222us) service_pool.cc:224] Handling call
0709 12:21:54.692651 (+1354015us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b540008edd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:54.692808 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99669248}
I20260709 12:21:55.111878  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.112637  8146 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:55.066586  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 485356us
W20260709 12:21:54.771586 10231 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.006s
I20260709 12:21:55.091794  8142 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:54.965116 10216 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:54.605997 10045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.022s	sys 0.013s
W20260709 12:21:55.056694 10241 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.001s
W20260709 12:21:54.623788  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 245854us
I20260709 12:21:55.116200  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:54.602154 10249 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.065042  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.117388  8140 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:54.604668 10258 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:54.669450 10104 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:54.612591 10124 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.073951  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:55.106142  8069 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:55.078822  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.127256  8143 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.107920  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.799729 10122 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:21:55.065234 10250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.027s
I20260709 12:21:55.132645  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:54.801659 10103 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:54.604363 10252 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.520s
I20260709 12:21:55.066341 10116 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.200845  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.119796  9730 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:54.683449 10025 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:54.772895 10083 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.116806  8145 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:55.118391  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.231616  8140 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:55.122006  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.124231  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:54.636613 10213 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.473s
I20260709 12:21:55.129128  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.235845  8137 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.129633  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.612383 10162 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.094201 10016 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.678548 10264 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.104066 10263 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:55.194065  8142 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.193593  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:54.702118 10120 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:55.121991 10045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.749s	user 0.030s	sys 0.019s
I20260709 12:21:55.125049 10231 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.224494  8765 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:55.227288  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:55.122679 10145 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.115871 10236 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.121819 10104 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:21:55.216461 10250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.013s	sys 0.043s
I20260709 12:21:55.130686  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:55.194065  8758 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:54.609079 10160 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.350149 10160 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:55.269748 10114 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.351584 10114 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.129660 10235 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.352912 10235 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:55.354457 10155 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.125s	user 0.008s	sys 0.004s
I20260709 12:21:55.195102 10241 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.355393 10241 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.298997  8757 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:55.299047  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 466) took 1178 ms. Trace:
I20260709 12:21:55.357618 10241 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.299443  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:55.359181  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.363461 10231 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:55.365324 10271 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:55.367405  8070 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:55.369467 10155 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.369979 10155 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.371372 10104 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.372730 10254 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.373250 10254 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.356977  8762 rpcz_store.cc:276] 0709 12:21:54.120932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.121132 (+   200us) service_pool.cc:224] Handling call
0709 12:21:54.121652 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:54.122988 (+  1336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:54.123039 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:54.123666 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 12:21:54.346677 (+223011us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:54.576845 (+230168us) log.cc:844] Serialized 14 byte log entry
0709 12:21:54.613662 (+ 36817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.613766 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:55.298819 (+685053us) raft_consensus.cc:1685] finished
0709 12:21:55.298837 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.298985 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58289,"prepare.queue_time_us":237493,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":58922,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":22518,"thread_start_us":365967,"threads_started":2,"wal-append.queue_time_us":377708}
I20260709 12:21:55.375303 10254 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.342621 10278 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.375818 10254 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.376230 10278 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.372370 10155 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.216274 10122 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.221007 10164 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.201805 10103 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.242830 10025 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.136080 10147 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 12:21:55.315634  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:55.240171 10215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.012s	sys 0.023s
I20260709 12:21:55.323783  8214 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:55.302037  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.330765  8217 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:55.235272 10124 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.305188 10016 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.332726  8143 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:55.333354  8137 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:55.301004  8218 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:55.245347 10258 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:55.242216 10083 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.405654  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1257) took 1087 ms. Trace:
W20260709 12:21:55.339674  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 222942us
I20260709 12:21:55.127890 10216 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.343118  8215 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:55.348544  8142 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:55.342221  8759 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:55.302342 10264 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.415751 10264 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.360313  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.417763  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.298902 10263 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.233426 10116 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:21:55.382921  8140 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:55.420174  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 330) took 1002 ms. Trace:
I20260709 12:21:55.420589  8140 rpcz_store.cc:276] 0709 12:21:54.417377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.118123 (+700746us) service_pool.cc:224] Handling call
0709 12:21:55.420095 (+301972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.377334 10155 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:55.388046  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 263906us
I20260709 12:21:55.373241  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.372397 10104 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.376291 10254 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:55.332180  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 234984us
W20260709 12:21:55.429028  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 100296us
I20260709 12:21:55.434103  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:55.399019 10215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.013s	sys 0.023s
I20260709 12:21:55.410466  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1259) took 1012 ms. Trace:
I20260709 12:21:55.410631  8138 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:55.408375  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 347640us
I20260709 12:21:55.411785 10122 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.416345 10281 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:55.423338  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:55.426764  8146 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:55.429442  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.406177  8137 rpcz_store.cc:276] 0709 12:21:54.318673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.404826 (+1086153us) service_pool.cc:224] Handling call
0709 12:21:55.405176 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.405353 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.405379 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:55.405420 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:55.405451 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.405499 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.405600 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16768}
I20260709 12:21:55.431939  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:55.395413 10025 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.419230 10263 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:55.632140  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.470933  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.621923  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 294701us
I20260709 12:21:55.476428  8068 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:21:55.468432  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.606357  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 142728us
I20260709 12:21:55.422685 10147 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:55.407465 10258 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.565110  8219 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:55.429036 10120 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.665426  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.668666  8137 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:55.660015  8143 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:55.660651 10236 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.524147 10226 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.670090 10236 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.420714 10083 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.667598 10289 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:55.672411 10236 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.664774 10227 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.673435 10145 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:55.673503 10227 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.674520 10103 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.675904  8213 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:55.563706 10254 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.543160  9730 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.678169 10227 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:55.601078 10278 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.409117 10124 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.678745 10103 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:55.499346 10213 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:55.657979  8063 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:55.661125 10281 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.538338 10198 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.625682 10116 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.660225  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 327) took 1244 ms. Trace:
I20260709 12:21:55.458069  8142 rpcz_store.cc:276] 0709 12:21:54.398020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.114655 (+716635us) service_pool.cc:224] Handling call
0709 12:21:55.410407 (+295752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.690600  8146 rpcz_store.cc:276] 0709 12:21:54.415647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.111576 (+695929us) service_pool.cc:224] Handling call
0709 12:21:55.660167 (+548591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.691169  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.691831  8142 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.691905  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.692826  8146 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:55.693552  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:55.693912  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.585863 10016 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.541244 10286 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.653981  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1258) took 1335 ms. Trace:
I20260709 12:21:55.602769  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1139) took 1329 ms. Trace:
I20260709 12:21:55.462796 10231 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.223s
W20260709 12:21:55.689245  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.522354 10284 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.180s
I20260709 12:21:55.685231 10025 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.695441  8062 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:21:55.672510 10083 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:55.458634 10155 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.697418  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.714892  8137 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.530259 10285 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:21:55.690297 10114 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.725191 10114 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.699163  9730 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:55.699553 10116 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.726902  9730 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.727504  9730 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.729681 10284 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:55.730168 10284 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.696249  8140 rpcz_store.cc:276] 0709 12:21:54.319026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.421503 (+1102477us) service_pool.cc:224] Handling call
0709 12:21:55.421848 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.422098 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:55.462485 (+ 40387us) log.cc:844] Serialized 14 byte log entry
0709 12:21:55.653503 (+191018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:55.653576 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:55.653642 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.653739 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.653901 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53186,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":19770,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":190627,"threads_started":1,"wal-append.queue_time_us":166651}
I20260709 12:21:55.732291  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.733042  8140 raft_consensus.cc:2376] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4. Re-sending same reply.
I20260709 12:21:55.661180 10147 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:55.736239 10292 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:55.736771 10292 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:55.734617 10116 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.705633 10016 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.742867  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.736776 10124 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.697017 10258 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.708586 10278 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.746254 10278 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.749933  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.751471  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:55.753296  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:55.754513  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.708014  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:55.687672 10213 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.757171 10213 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.757377 10239 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:55.717460  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 285619us
I20260709 12:21:55.699324 10198 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:55.721627 10232 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.599s	user 0.011s	sys 0.007s
I20260709 12:21:55.722725 10257 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:55.723614 10155 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.736996 10147 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.777966 10147 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:55.779439 10198 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:55.780283 10114 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:55.756328  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48396.8us
I20260709 12:21:55.782701  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:55.760471  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:55.761399  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.737795 10231 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.707047 10286 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.772145 10012 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:55.741564 10292 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.800266  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.801628  8146 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:55.758142 10025 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:55.802300  8214 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:55.781378 10257 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:55.757849 10239 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:55.784564  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.784873  9730 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.850482  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:55.850802  8137 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:55.752291 10016 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.697518  8145 rpcz_store.cc:276] 0709 12:21:54.273120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.400765 (+1127645us) service_pool.cc:224] Handling call
0709 12:21:55.421370 (+ 20605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.438852 (+ 17482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.438900 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.458933 (+ 20033us) log.cc:844] Serialized 26 byte log entry
0709 12:21:55.589449 (+130516us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:55.589521 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.589629 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:55.602451 (+ 12822us) raft_consensus.cc:1685] finished
0709 12:21:55.602482 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:55.602683 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82808,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":17262,"thread_start_us":59093,"threads_started":1,"wal-append.queue_time_us":94187}
W20260709 12:21:55.788040 10275 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260709 12:21:55.788479  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.855324  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:55.791502  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.862816  8762 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:55.863196  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:55.792455  8142 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:55.794600  8218 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:55.794837  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.864857  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.865285  8217 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:55.865918  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.795735  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:55.797662  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.799469  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.866791  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.867146  8140 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:55.811112  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:55.795778  9735 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:55.856755 10286 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.856995 10292 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.877430  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:55.877539  8036 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:55.878101  8066 raft_consensus.cc:2376] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6. Re-sending same reply.
W20260709 12:21:55.873124  8144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1233) took 2572 ms (client timeout 2645 ms). Trace:
I20260709 12:21:55.879446  8756 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:55.880861  8763 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:55.815292 10012 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:55.859158  9730 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.860332  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:55.857025  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:55.736171 10284 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:55.861894  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.791440 10281 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:55.869316  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73666.3us
W20260709 12:21:55.870193  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.870864  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:55.889496  8109 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.655s (SENT) [suppressed 46 similar messages]
W20260709 12:21:55.866739  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.892107  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.879087  8144 rpcz_store.cc:269] 0709 12:21:53.300619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.310675 (+ 10056us) service_pool.cc:224] Handling call
0709 12:21:55.801221 (+2490546us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967e9c 00007f4989967a5b 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:55.873053 (+ 71832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11159936}
I20260709 12:21:55.894066  8764 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:55.808938 10231 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:55.840330  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 417024us
I20260709 12:21:55.869364  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:55.873550  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:55.873996  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.801347 10155 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.883366  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:55.873149  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:55.886655  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:55.896512  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.909214 10278 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:55.907068  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 247) took 1505 ms. Trace:
I20260709 12:21:55.903599 10012 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:56.315399  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.901662  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:56.274204 10217 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:56.337823  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:56.338106  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.338747  8146 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:56.300951  7965 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.339808  8146 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:21:55.998924  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1116) took 2591 ms. Trace:
I20260709 12:21:56.367084  8141 rpcz_store.cc:276] 0709 12:21:53.407825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.410965 (+  3140us) service_pool.cc:224] Handling call
0709 12:21:54.692812 (+1281847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.094725 (+401913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.998592 (+903867us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540008edd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:55.998817 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2947285248}
I20260709 12:21:56.368265 10258 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:56.368602  8141 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:56.369331  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 320) took 1955 ms. Trace:
I20260709 12:21:56.369637  8141 rpcz_store.cc:276] 0709 12:21:54.413512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.368122 (+1954610us) service_pool.cc:224] Handling call
0709 12:21:56.368436 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.369058 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.369275 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.371048  8141 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:56.371593  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 324) took 1956 ms. Trace:
I20260709 12:21:56.371881  8141 rpcz_store.cc:276] 0709 12:21:54.414766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.370419 (+1955653us) service_pool.cc:224] Handling call
0709 12:21:56.370721 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.371365 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.371542 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.905216  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:55.932504 10239 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.341820  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:56.373178  8065 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:56.373464  8757 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:56.373646  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2435) took 1254 ms. Trace:
I20260709 12:21:56.374024  8065 rpcz_store.cc:276] 0709 12:21:55.118908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.904873 (+785965us) service_pool.cc:224] Handling call
0709 12:21:56.373590 (+468717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:55.875854 10234 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:56.343734  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:56.375305  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.375903  8145 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:56.376003  8069 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
W20260709 12:21:56.141675  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.376657  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 328) took 1960 ms. Trace:
W20260709 12:21:56.377041  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.377038  8145 rpcz_store.cc:276] 0709 12:21:54.416685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.375265 (+1958580us) service_pool.cc:224] Handling call
0709 12:21:56.375550 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.376399 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.376588 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.377704  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2441) took 1257 ms. Trace:
I20260709 12:21:56.378189  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1261) took 1979 ms. Trace:
I20260709 12:21:56.378078  8069 rpcz_store.cc:276] 0709 12:21:55.120418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.761104 (+640686us) service_pool.cc:224] Handling call
0709 12:21:56.377533 (+616429us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540011d5d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.377652 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341140224}
I20260709 12:21:56.378667  8146 rpcz_store.cc:276] 0709 12:21:54.398548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.339295 (+1940747us) service_pool.cc:224] Handling call
0709 12:21:56.339601 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.377897 (+ 38296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.378120 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.379175 10284 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.344288  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:56.344650  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 456230us
I20260709 12:21:56.380201  8063 raft_consensus.cc:2410] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:56.381141  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.381371  8146 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:56.381738  8063 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:56.382084  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 333) took 1963 ms. Trace:
I20260709 12:21:56.382684  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:55.911754  9735 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:56.305128 10205 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:56.383414  9735 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.383460 10205 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.383960  9735 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:56.384613 10205 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.385969 10205 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:56.387133 10276 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.026s	user 0.002s	sys 0.001s
I20260709 12:21:56.307888  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:56.345851  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.346168  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.346918  8137 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:56.388321  8064 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:56.347002 10084 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.246513 10303 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.388900 10303 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.389161  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.390136  8140 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:56.391331 10303 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.391588  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1265) took 1813 ms. Trace:
I20260709 12:21:56.388460  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1262) took 1989 ms. Trace:
W20260709 12:21:56.349349 10213 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 12:21:56.339267  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1260) took 1941 ms. Trace:
I20260709 12:21:56.356292 10287 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:56.382463  8146 rpcz_store.cc:276] 0709 12:21:54.418347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.379482 (+1961135us) service_pool.cc:224] Handling call
0709 12:21:56.379752 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.381807 (+  2055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.382015 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.397912 10287 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.400045 10287 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.357287 10233 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:56.400328  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1140) took 1821 ms. Trace:
I20260709 12:21:56.400866 10233 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:56.400754  8146 rpcz_store.cc:276] 0709 12:21:54.578755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.398054 (+1819299us) service_pool.cc:224] Handling call
0709 12:21:56.398332 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.398492 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.398516 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.398556 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:56.398588 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.398637 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.400262 (+  1625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.401413 10233 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:56.358615  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1256) took 2042 ms. Trace:
W20260709 12:21:56.363562  8070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2424) took 1256 ms (client timeout 1655 ms). Trace:
I20260709 12:21:56.402321  8143 rpcz_store.cc:276] 0709 12:21:54.316829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.404776 (+1087947us) service_pool.cc:224] Handling call
0709 12:21:55.659836 (+255060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.669182 (+  9346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.358426 (+689244us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540008ded0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.358547 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585727744}
W20260709 12:21:56.402489  8070 rpcz_store.cc:269] 0709 12:21:55.106840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.193246 (+ 86406us) service_pool.cc:224] Handling call
0709 12:21:56.363326 (+1170080us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b54001f6654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.363480 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166515072}
W20260709 12:21:55.901612 10300 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:21:56.404178  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.404876  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1192) took 1025 ms. Trace:
I20260709 12:21:56.373145 10239 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.343531  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:56.407047  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 266) took 2109 ms (client timeout 2126 ms). Trace:
W20260709 12:21:56.407583  8219 rpcz_store.cc:269] 0709 12:21:54.297930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.317527 (+ 19597us) service_pool.cc:224] Handling call
0709 12:21:56.406882 (+2089355us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002b4b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.406993 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712505216}
W20260709 12:21:56.408002  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64571.6us
I20260709 12:21:56.336410  8068 rpcz_store.cc:276] 0709 12:21:54.401510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.401619 (+   109us) service_pool.cc:224] Handling call
0709 12:21:55.906793 (+1505174us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:55.906951 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469435136}
I20260709 12:21:56.072896  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.409224  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.409538  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.409838  8068 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:56.409996 10124 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:56.410810  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:56.407716  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:56.405414  8216 rpcz_store.cc:276] 0709 12:21:55.379563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.379702 (+   139us) service_pool.cc:224] Handling call
0709 12:21:55.398819 (+ 19117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.399264 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.399309 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.399891 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:21:55.798805 (+398914us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:55.798852 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.798927 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.404593 (+605666us) raft_consensus.cc:1685] finished
0709 12:21:56.404621 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.404805 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2785,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4018,"thread_start_us":339918,"threads_started":1,"wal-append.queue_time_us":388679}
I20260709 12:21:56.412808 10120 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:56.410815  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.392338  8137 rpcz_store.cc:276] 0709 12:21:54.398775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.346506 (+1947731us) service_pool.cc:224] Handling call
0709 12:21:56.346769 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.388202 (+ 41433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.388404 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.413594 10120 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:56.412312  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.394934  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2427) took 1287 ms. Trace:
I20260709 12:21:56.414773  8062 rpcz_store.cc:276] 0709 12:21:55.107717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.417392 (+309675us) service_pool.cc:224] Handling call
0709 12:21:56.394756 (+977364us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000fcdd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.394871 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636843392}
I20260709 12:21:56.379338  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.415421  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.416052  8069 raft_consensus.cc:2410] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:56.416090  8062 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:56.416428 10303 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:56.416759  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2433) took 1300 ms. Trace:
I20260709 12:21:56.417131  8137 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:56.417181  8069 rpcz_store.cc:276] 0709 12:21:55.116823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.379116 (+1262293us) service_pool.cc:224] Handling call
0709 12:21:56.416701 (+ 37585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.417999  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1142) took 1838 ms. Trace:
I20260709 12:21:56.396646  8141 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:56.418371  8137 rpcz_store.cc:276] 0709 12:21:54.579327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.416600 (+1837273us) service_pool.cc:224] Handling call
0709 12:21:56.416921 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.417755 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.417948 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.419255 10145 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.420174 10303 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.392956  8144 rpcz_store.cc:276] 0709 12:21:54.398301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.338315 (+1940014us) service_pool.cc:224] Handling call
0709 12:21:56.338717 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.338907 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.338951 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.338994 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:56.339030 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.339092 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.339210 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.420693  8137 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:56.421578  8146 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:56.379395  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 331) took 1961 ms. Trace:
I20260709 12:21:56.397058 10084 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.356841 10241 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.424889  8145 rpcz_store.cc:276] 0709 12:21:54.417701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.377914 (+1960213us) service_pool.cc:224] Handling call
0709 12:21:56.378215 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.379116 (+   901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.379138 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.379177 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:56.379207 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.379253 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.379348 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.425575 10241 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.429116  8064 raft_consensus.cc:2410] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:56.417081  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2426) took 1309 ms. Trace:
I20260709 12:21:56.430516  8062 rpcz_store.cc:276] 0709 12:21:55.107465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.415567 (+1308102us) service_pool.cc:224] Handling call
0709 12:21:56.415862 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.416764 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.417013 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.431118  8068 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:56.424860  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:21:56.434005  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 271) took 1341 ms (client timeout 1734 ms). Trace:
W20260709 12:21:56.434449  8220 rpcz_store.cc:269] 0709 12:21:55.092572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.094052 (+  1480us) service_pool.cc:224] Handling call
0709 12:21:56.072667 (+978615us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:56.433800 (+361133us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.433928 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47718528}
W20260709 12:21:56.435801  8109 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.023s
W20260709 12:21:56.366370  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.406733 10287 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:56.418713  8142 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:21:56.438802  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.000402  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:56.410591 10124 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.438661 10287 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.414284 10249 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.440980 10249 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.441515 10287 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.443410  8139 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:21:56.396268 10025 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 12:21:56.444957 10025 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:56.392025  8140 rpcz_store.cc:276] 0709 12:21:54.578278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.390828 (+1812550us) service_pool.cc:224] Handling call
0709 12:21:56.391138 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.391288 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.391313 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.391353 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:56.391386 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.391446 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.391535 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.405705  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.393919 10213 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.392530  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.447196  8063 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:56.446767 10240 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.421646  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 325) took 2006 ms. Trace:
I20260709 12:21:56.448793  8141 rpcz_store.cc:276] 0709 12:21:54.415059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.372553 (+1957494us) service_pool.cc:224] Handling call
0709 12:21:56.396402 (+ 23849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.419051 (+ 22649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.421591 (+  2540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.396727  9735 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.449584  8066 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:56.450969  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2439) took 1331 ms. Trace:
I20260709 12:21:56.451314  8066 rpcz_store.cc:276] 0709 12:21:55.119923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.878728 (+758805us) service_pool.cc:224] Handling call
0709 12:21:56.450780 (+572052us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400395dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.450904 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261937536}
I20260709 12:21:56.451370  9735 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:56.453274 10075 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.003s	sys 0.007s
W20260709 12:21:56.453332  9866 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.035s
W20260709 12:21:56.453760 10075 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.008s
W20260709 12:21:56.454201  9866 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.036s
I20260709 12:21:56.107108 10263 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:56.456274  8109 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.019s	sys 0.023s
W20260709 12:21:56.456661  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 568160us
I20260709 12:21:56.462911  7965 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:56.464784  8109 connection.cc:256] RPC call timeout handler was delayed by -1.9668097500002659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:21:56.465452  8109 connection.cc:256] RPC call timeout handler was delayed by -1.8759097500005737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 12:21:56.294956  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1181) took 1887 ms. Trace:
I20260709 12:21:56.458165 10234 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.466535 10303 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:56.466672 10234 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.467389 10303 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.470319 10303 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.470402  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.471339  8214 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:56.473121  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:56.473256  8109 connection.cc:256] RPC call timeout handler was delayed by -1.7719422180002766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:21:56.475598  8109 connection.cc:256] RPC call timeout handler was delayed by -1.735042218000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:21:56.458767  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 77729.3us
I20260709 12:21:56.459517 10108 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.477775 10108 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.478048 10160 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:56.478556  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.478935 10160 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.479583 10077 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:56.479871  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.460973  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.480165 10108 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.460600 10105 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:56.480695  8213 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:56.480962 10105 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.481714  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.482167 10162 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:56.481966 10105 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.482934 10162 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:56.483206  7967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 258) took 11199 ms. Trace:
I20260709 12:21:56.472321  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.484041  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.484203  8214 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:56.484861 10281 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:56.461108  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 574488us
I20260709 12:21:56.002904  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 453) took 3052 ms. Trace:
I20260709 12:21:56.485448 10281 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.485726  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.486465 10281 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.486819  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.479970 10077 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.486127  8765 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:56.481674  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.487986  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.475884  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.489121  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.489393 10102 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:56.476776  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.488234 10077 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.292409 10235 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.401894  8065 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:56.499846  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2425) took 1392 ms. Trace:
I20260709 12:21:56.500458  8065 rpcz_store.cc:276] 0709 12:21:55.107170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.375046 (+1267876us) service_pool.cc:224] Handling call
0709 12:21:56.499756 (+124710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.501163  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:56.490195  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.502916  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:56.503156  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.487107  8214 raft_consensus.cc:2410] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:56.276296 10246 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:56.491787  8109 connection.cc:256] RPC call timeout handler was delayed by -1.6414422180000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:21:56.108946  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1186) took 1699 ms. Trace:
W20260709 12:21:56.506065  8109 connection.cc:256] RPC call timeout handler was delayed by -1.6241773440001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2701s for a response
I20260709 12:21:56.506414  8215 rpcz_store.cc:276] 0709 12:21:54.409035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.411702 (+  2667us) service_pool.cc:224] Handling call
0709 12:21:54.411976 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.410309 (+998333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.108552 (+698243us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:56.108855 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140871552}
W20260709 12:21:56.506453  8109 connection.cc:256] RPC call timeout handler was delayed by -1.5712422180004069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 12:21:56.100404  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1135) took 1833 ms. Trace:
I20260709 12:21:56.508653  8138 rpcz_store.cc:276] 0709 12:21:54.267376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.232880 (+965504us) service_pool.cc:224] Handling call
0709 12:21:55.410400 (+177520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.458296 (+ 47896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.100104 (+641808us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002f1550. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:56.100316 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262024960}
W20260709 12:21:56.493198  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.436969  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1143) took 1857 ms. Trace:
I20260709 12:21:56.466117  7965 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:56.510130  8146 rpcz_store.cc:276] 0709 12:21:54.579717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.417654 (+1837937us) service_pool.cc:224] Handling call
0709 12:21:56.417940 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.436678 (+ 18738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.436895 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:56.413594 10231 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.480302 10160 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.517745 10084 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.519841 10124 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.483603  7967 rpcz_store.cc:276] 0709 12:21:45.283733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.286521 (+  2788us) service_pool.cc:224] Handling call
0709 12:21:56.483124 (+11196603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:49.895096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:50.143217 (+248121us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:50.200740 (+ 57523us) write_op.cc:435] Acquired schema lock
0709 12:21:50.203808 (+  3068us) tablet.cc:662] Decoding operations
0709 12:21:50.225706 (+ 21898us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:50.225811 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:50.225840 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:21:50.241662 (+ 15822us) tablet.cc:701] Row locks acquired
0709 12:21:50.241739 (+    77us) write_op.cc:260] PREPARE: finished
0709 12:21:50.241968 (+   229us) write_op.cc:270] Start()
0709 12:21:50.242149 (+   181us) write_op.cc:276] Timestamp: P: 1783599710241884 usec, L: 0
0709 12:21:50.242172 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:50.242957 (+   785us) log.cc:844] Serialized 4523 byte log entry
0709 12:21:51.078754 (+835797us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b180035c380. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:21:52.189106 (+1110352us) op_driver.cc:464] REPLICATION: finished
0709 12:21:52.405058 (+215952us) write_op.cc:301] APPLY: starting
0709 12:21:52.412002 (+  6944us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:52.424989 (+ 12987us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:52.425025 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:52.809153 (+384128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:52.812897 (+  3744us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:21:52.812951 (+    54us) write_op.cc:312] APPLY: finished
0709 12:21:52.813320 (+   369us) log.cc:844] Serialized 83 byte log entry
0709 12:21:52.813547 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:52.813703 (+   156us) write_op.cc:454] Released schema lock
0709 12:21:52.813761 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:52.814194 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:52.814224 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17501,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":176371,"apply.run_cpu_time_us":5906,"apply.run_wall_time_us":434114,"num_ops":11,"prepare.queue_time_us":306791,"prepare.run_cpu_time_us":45227,"prepare.run_wall_time_us":545702,"raft.queue_time_us":278407,"raft.run_cpu_time_us":19432,"raft.run_wall_time_us":114747,"replication_time_us":1946769,"spinlock_wait_cycles":60379392,"thread_start_us":408681,"threads_started":4,"wal-append.queue_time_us":182296,"wal-append.run_cpu_time_us":38513,"wal-append.run_wall_time_us":2745002}]]}
I20260709 12:21:56.108208 10185 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:56.521102 10185 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:56.521499 10249 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.522130 10185 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.490253  8216 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
W20260709 12:21:56.490350  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.505148  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:56.508380  8109 connection.cc:256] RPC call timeout handler was delayed by -1.5451422180003647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 12:21:56.528344  8109 connection.cc:256] RPC call timeout handler was delayed by -1.3822422180001013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:21:56.528983  8109 connection.cc:256] RPC call timeout handler was delayed by -1.3615422180000678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 12:21:56.529044  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:56.529399  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.111555  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.489974 10102 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.513664 10108 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:56.505906 10246 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:56.514285  8757 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:56.514566  8759 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:56.515396 10217 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:56.515631 10083 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:56.516299  8756 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:56.522804 10241 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:56.466037  8212 rpcz_store.cc:276] 0709 12:21:54.407607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.409185 (+  1578us) service_pool.cc:224] Handling call
0709 12:21:54.409446 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:54.480985 (+ 71539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.294618 (+1813633us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b54001694d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:56.294866 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162661248}
I20260709 12:21:56.525312  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.525803  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:56.101758 10262 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.531s	user 0.011s	sys 0.003s
W20260709 12:21:56.529356  8109 connection.cc:256] RPC call timeout handler was delayed by -1.2751422180003829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 12:21:56.547828  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.579941  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1141) took 2000 ms. Trace:
W20260709 12:21:56.587105  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61381.3us
I20260709 12:21:56.530292  8139 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:56.511670  7965 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 4, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:56.540685  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:56.586861  8109 connection.cc:256] RPC call timeout handler was delayed by -1.2751422180003829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:21:56.589000  8109 connection.cc:256] RPC call timeout handler was delayed by -1.2697422180003741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 12:21:56.589285  8109 connection.cc:256] RPC call timeout handler was delayed by -1.1177205160001904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:21:56.589582  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0875492900004247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:21:56.589619  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:56.589932  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0191492900003141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:21:56.590050  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:56.590643  8140 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:21:56.590848  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:56.591461  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:56.591840  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:56.592747  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.593528 10120 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:56.594750  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.595444 10120 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:56.505311 10162 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:56.587371  8143 rpcz_store.cc:276] 0709 12:21:54.579050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.414850 (+1835800us) service_pool.cc:224] Handling call
0709 12:21:56.415208 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.415529 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.415557 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:56.416002 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.578074 (+162072us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:56.578117 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.578188 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.579668 (+  1480us) raft_consensus.cc:1685] finished
0709 12:21:56.579688 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.579851 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1676,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":161638,"threads_started":1,"wal-append.queue_time_us":161973}
I20260709 12:21:56.596799 10116 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:56.596941 10162 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.104938 10248 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.492s
I20260709 12:21:56.586717  8065 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:56.597381 10116 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.597909 10116 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:56.057497 10302 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:56.541900  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:56.602058  7965 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 2, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:21:56.603261  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 74309.7us
I20260709 12:21:56.604090  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:56.604851  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63065.9us
I20260709 12:21:56.605495  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:56.606112  8765 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:21:56.608295  8762 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
I20260709 12:21:56.608776  8762 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:56.609150  8219 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:56.609824  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:56.591456  8146 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:21:56.596508  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.615599 10120 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:56.618050  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.620071  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:56.604020  7965 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.622520  7965 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 3, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.524950 10163 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:56.623456  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.630651  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.526865 10239 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:56.634820  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:56.635558  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:56.641305  8762 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:56.547200  9578 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:56.638087  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 222724us
I20260709 12:21:56.526767 10084 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.597476 10162 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:56.644435  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.643946  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:56.643209  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 117977us
I20260709 12:21:56.700860 10231 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:56.701004  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.704888  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1152) took 1047 ms. Trace:
W20260709 12:21:56.703501  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 83536.4us
I20260709 12:21:56.721103 10084 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.699252 10303 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:56.765029  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.630466 10244 raft_consensus.cc:2764] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:56.745455  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.485754  8758 rpcz_store.cc:276] 0709 12:21:52.950917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.972713 (+ 21796us) service_pool.cc:224] Handling call
0709 12:21:54.278585 (+1305872us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:21:54.278788 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:55.349652 (+1070864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.002507 (+652855us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54005f0354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:56.002799 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924611712}
I20260709 12:21:56.741004 10281 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.746133  8144 rpcz_store.cc:276] 0709 12:21:55.657182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.422901 (+765719us) service_pool.cc:224] Handling call
0709 12:21:56.423138 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.423311 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:56.646960 (+223649us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.704434 (+ 57474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.704515 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:56.704574 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.704671 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.704817 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312528,"thread_start_us":280388,"threads_started":2}
I20260709 12:21:56.050810 10257 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.601438 10077 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:56.759320  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58640.3us
I20260709 12:21:56.760644 10267 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.757495 10231 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.728335 10102 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.748868  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:56.762173  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 151107us
I20260709 12:21:56.762940  9866 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:56.767445  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167318us
I20260709 12:21:56.728260  9578 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.638705 10302 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.649191  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:21:56.811131  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 162023us
I20260709 12:21:56.749511 10124 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:21:56.597242 10213 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.733286  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.749811 10292 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:56.642989 10279 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:56.644160 10160 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.793941  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:56.749214 10241 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:56.738029  8211 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:56.755071 10163 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.755187 10239 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.729333 10315 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 12:21:56.815459  9578 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:56.850364  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 246392us
I20260709 12:21:56.820863  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.792974 10108 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:56.845448  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:56.880522  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 247415us
I20260709 12:21:56.885358  8216 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:21:56.846043  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.821379 10212 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:56.851210 10311 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:56.811985 10328 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:56.881879  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.899253 10160 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:56.821290 10279 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.900310 10279 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.902452 10160 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:56.816439 10292 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:56.821741  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1276) took 1155 ms. Trace:
I20260709 12:21:56.812971 10302 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:56.887763  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66960.8us
W20260709 12:21:56.888211  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:56.925686  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.824110 10120 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:56.890456  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.828548 10284 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:56.912791  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.913702  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.914669  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.822438 10258 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:21:56.925180  9578 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.888664  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:56.949760  8214 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:56.926371  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:56.924245  8137 rpcz_store.cc:276] 0709 12:21:55.669203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.423709 (+754506us) service_pool.cc:224] Handling call
0709 12:21:56.423973 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.424160 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:56.587215 (+163055us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.819166 (+231951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:56.819412 (+   246us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:56.819568 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.821548 (+  1980us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.821677 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7240,"prepare.queue_time_us":328832,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":117122,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":17658,"thread_start_us":393719,"threads_started":3}
I20260709 12:21:56.915863  8762 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:56.952275  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.823072 10235 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:21:56.960940  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:56.961151  9578 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:56.952907  8068 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.769650 10246 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:56.959153 10324 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:21:56.960104  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:56.807078 10267 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:56.982846  8065 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:56.966718  8070 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:56.972126  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 238910us
I20260709 12:21:56.973377  8063 raft_consensus.cc:2410] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:56.973308  8762 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:56.963497  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:56.984773  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:56.897186 10212 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.848731 10241 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:56.977026  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50727.8us
I20260709 12:21:56.904721 10217 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:56.987301  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0787395439997454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:21:56.931027 10292 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:57.018970  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71970.8us
I20260709 12:21:56.997444 10108 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:56.998545 10257 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:56.919289 10012 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:21:56.999087 10212 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.999857 10336 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:57.000692  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:57.038407  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:57.009857  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:21:56.894713 10155 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:21:56.997654  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:57.021030  8212 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:57.022054  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:57.048450  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2849663560000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:21:56.985024  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:57.029737  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.049839  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1841663559998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:21:57.050204  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1688663559998531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:21:56.898191 10244 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:21:57.001233  9735 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:57.039103  8214 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:56.981841  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.042675  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:57.039064  8069 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:57.001197 10217 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:57.040552  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 150814us
W20260709 12:21:57.049189  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.050238  8070 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:57.025981  8062 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
W20260709 12:21:57.052058  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1247663560002366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260709 12:21:57.022712 10246 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:56.892148 10231 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.058391 10016 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:57.018498  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.033048 10235 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:57.028717 10249 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:57.077728  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:57.044688 10322 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:21:57.013528 10284 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:21:57.021780 10287 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:21:57.059317 10075 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.093020  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71109.7us
I20260709 12:21:57.093924  8035 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:21:57.097362  8110 connection.cc:256] RPC call timeout handler was delayed by -1.0518663560001187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:21:57.131073  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:57.131994  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.132268  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.133028  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.133340  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.092283  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.093019  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 83259.3us
I20260709 12:21:57.017630 10239 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.089916  9735 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:57.099417 10338 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:57.126770  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.030237  8068 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:57.103233  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.173362  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70221.9us
I20260709 12:21:57.137823  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.134547  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:57.135074  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.135462  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.133045  8139 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:57.164202  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.164850  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.103812 10316 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:57.161813  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:57.099498 10217 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.124135  8756 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:57.093776 10084 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:57.173377  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:57.133695  8145 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:57.056046 10163 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.120512 10297 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 12:21:57.314544  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.255187  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.420883  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.178279  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.421316  8144 raft_consensus.cc:2376] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6. Re-sending same reply.
W20260709 12:21:57.178295  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47313.6us
I20260709 12:21:57.177270  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.319150  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 119310us
I20260709 12:21:57.180778  8141 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:57.423902  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 259779us
I20260709 12:21:57.239382  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.420750  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.177326  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.177037  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.180052  8146 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:57.119424  8759 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:21:57.341353  8215 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:57.124907 10342 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.249300 10325 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:21:57.470644  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:57.348376  8731 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.542s (SENT)
I20260709 12:21:57.475854  8138 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:57.422346  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:57.473356  8143 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:57.472865  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:57.472306  8140 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:57.474002  8757 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:57.473383  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:57.474820  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.105183 10328 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:57.235958  8758 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:57.163026 10016 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:57.390126 10263 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.935s	user 0.012s	sys 0.001s
W20260709 12:21:57.377034 10319 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
W20260709 12:21:57.507584  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.520170  8139 raft_consensus.cc:2376] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6. Re-sending same reply.
I20260709 12:21:57.520468  8145 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:57.521608  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.522536  8139 raft_consensus.cc:2376] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5. Re-sending same reply.
I20260709 12:21:57.484063  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.124339 10249 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:57.480317  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:57.168205  9735 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:57.521867  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.170493 10338 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:57.483006  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:57.525856  8146 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:57.425879 10316 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.491241  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.546226  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 198081us
I20260709 12:21:57.162159 10075 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.177978 10281 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:57.238972 10241 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:57.162731 10213 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.325s
I20260709 12:21:57.523730  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.308501 10341 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:57.475764 10284 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:57.543605  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.544219  8142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.006s	sys 0.012s
I20260709 12:21:57.472019 10347 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:57.529938  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:57.550812  8731 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.689s (SENT)
I20260709 12:21:57.549721 10316 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:57.539951  8141 raft_consensus.cc:2376] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5. Re-sending same reply.
W20260709 12:21:57.559942  8110 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.543s (SENT)
W20260709 12:21:57.594703  8110 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.655s (SENT)
I20260709 12:21:57.546552 10338 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:57.561254  8061 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:57.245440  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:21:57.538374 10315 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 12:21:57.565649 10340 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.466s	user 0.000s	sys 0.001s
I20260709 12:21:57.466367 10233 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.313002  9866 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.229s
I20260709 12:21:57.569145  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 273) took 1110 ms. Trace:
I20260709 12:21:57.533077 10297 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:57.545522 10124 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:57.598875  8220 rpcz_store.cc:276] 0709 12:21:56.458996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.461705 (+  2709us) service_pool.cc:224] Handling call
0709 12:21:56.462061 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.462967 (+   906us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:56.463282 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.749256 (+285974us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:56.755814 (+  6558us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.756026 (+   212us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:56.756076 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.756173 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:57.568801 (+812628us) raft_consensus.cc:1685] finished
0709 12:21:57.568827 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.569073 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117444,"prepare.queue_time_us":914,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":112611,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":16430,"thread_start_us":177292,"threads_started":1,"wal-append.queue_time_us":714022}
I20260709 12:21:57.510474 10342 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.589401  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.547503  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.021s	sys 0.025s
W20260709 12:21:57.621804  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.022s	sys 0.025s
W20260709 12:21:57.622148  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 876750us
I20260709 12:21:57.623040  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:57.624396  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73626.4us
I20260709 12:21:57.627507  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.629606  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 589666us
I20260709 12:21:57.544926 10263 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:57.590618  8068 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:21:57.591302  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 166435us
W20260709 12:21:57.566448 10332 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:21:57.616794 10185 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:57.616945 10124 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:21:57.587177  8142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.006s	sys 0.013s
I20260709 12:21:57.631987  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:57.654608  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:57.634874  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:57.657460 10343 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:57.658030 10343 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:57.658522 10343 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:57.660970 10349 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:57.661566 10349 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:57.662048 10349 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.673125  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:57.639336  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:57.733188  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93902.7us
W20260709 12:21:57.733296  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 60281.4us
I20260709 12:21:57.738896  8146 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:57.620702 10258 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.639323  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:57.676024 10075 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:57.636428 10025 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:57.620620 10297 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.692724  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 278) took 1232 ms. Trace:
I20260709 12:21:57.694546  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 257) took 1997 ms. Trace:
W20260709 12:21:57.699791  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.701071  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.732582 10279 consensus_meta.cc:287] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 12:21:57.681416 10353 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:21:57.705994  8062 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:57.764683  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:57.766569  8141 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:57.710533  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:21:57.711902 10351 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:57.712821 10120 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:21:57.715265  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2434) took 2598 ms (client timeout 1779 ms). Trace:
I20260709 12:21:57.598634 10347 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.722299 10342 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:57.727594 10355 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.708477  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:57.730754  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1281) took 1184 ms. Trace:
I20260709 12:21:57.738806  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.642470 10356 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:57.557516 10244 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:57.759075  8211 rpcz_store.cc:276] 0709 12:21:56.463323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.472805 (+  9482us) service_pool.cc:224] Handling call
0709 12:21:57.692493 (+1219688us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:57.692654 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517549440}
I20260709 12:21:57.805002 10244 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:57.805408 10244 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.805814 10244 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:57.805622  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.778210 10279 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.807670  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.809100  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.809156 10356 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:57.809860  8211 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:21:57.739866  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:57.746567  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.739645  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.704308 10354 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:21:57.649940 10328 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.812316  8144 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:57.756274  8064 rpcz_store.cc:276] 0709 12:21:55.697321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.430393 (+733072us) service_pool.cc:224] Handling call
0709 12:21:56.433217 (+  2824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.618924 (+185707us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:56.772457 (+153533us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.930513 (+158056us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:56.951543 (+ 21030us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.951677 (+   134us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:56.951708 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.951783 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:57.693073 (+741290us) raft_consensus.cc:1685] finished
0709 12:21:57.693092 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.694248 (+  1156us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5400347e50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:57.694431 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74217,"prepare.queue_time_us":79876,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":2914,"raft.queue_time_us":35279,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7349,"spinlock_wait_cycles":5691648,"thread_start_us":406001,"threads_started":3,"wal-append.queue_time_us":223001}
I20260709 12:21:57.768985 10341 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.770180 10246 consensus_meta.cc:287] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.001s
I20260709 12:21:57.754684 10213 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:57.755367 10284 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.769403 10315 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.797886  8143 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:57.892650  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.894253  8143 raft_consensus.cc:2410] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:57.799675  8142 rpcz_store.cc:276] 0709 12:21:56.546085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.548767 (+  2682us) service_pool.cc:224] Handling call
0709 12:21:56.549214 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.549465 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:56.717943 (+168478us) log.cc:844] Serialized 14 byte log entry
0709 12:21:57.729927 (+1011984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:57.730006 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:57.730073 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.730164 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.730679 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54849,"prepare.queue_time_us":216364,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":179534,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":10045696,"thread_start_us":1086079,"threads_started":3,"wal-append.queue_time_us":314845}
I20260709 12:21:57.900034  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.809285 10279 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:57.809978 10356 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:21:57.768200  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 172919us
I20260709 12:21:57.812022  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:57.908128  8110 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.802s (SENT)
I20260709 12:21:57.908784  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:57.768206  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.763471 10075 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.764309  8214 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.000s
I20260709 12:21:57.909929  8214 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:57.911180  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.777007  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.912734  8140 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:57.811167  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.763594 10124 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.870054  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:57.783078 10120 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:57.876525  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.758899 10311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.008s	sys 0.024s
I20260709 12:21:57.858417  8763 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:57.886950  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.011s	sys 0.042s
W20260709 12:21:57.954942  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.011s	sys 0.043s
I20260709 12:21:57.757565 10258 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:57.786649 10025 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:57.876151 10077 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.066s	user 0.010s	sys 0.004s
W20260709 12:21:57.950101  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.966468  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.872910 10352 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:57.958623  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:57.954381 10311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.010s	sys 0.024s
W20260709 12:21:57.968458  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 203223us
I20260709 12:21:57.976125  8213 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:21:57.977975  8213 pending_rounds.cc:85] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 4
I20260709 12:21:57.946638 10360 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:57.978291  8213 pending_rounds.cc:107] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:57.982239  8213 raft_consensus.cc:2889] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:57.783378  8061 rpcz_store.cc:269] 0709 12:21:55.118627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.326011 (+207384us) service_pool.cc:224] Handling call
0709 12:21:57.714890 (+2388879us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:57.715139 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4824316800}
W20260709 12:21:57.992467  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 357653us
I20260709 12:21:57.996552 10297 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:57.998147  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:57.910640 10284 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.998909  8214 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:57.993295  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:57.999958  8141 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:57.949185  8211 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:57.963858 10213 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:58.001616  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:57.995616  8184 leader_election.cc:336] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.098s (SENT)
W20260709 12:21:58.006043  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.008757  8731 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.997s (SENT)
I20260709 12:21:57.977116 10124 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:57.951799 10075 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:58.017992  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 278174us
I20260709 12:21:57.981329 10311 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:58.019347  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:58.027403  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 326443us
I20260709 12:21:58.021936  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:58.028601  8730 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:21:57.997287 10303 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.210s	user 0.022s	sys 0.001s
I20260709 12:21:58.023545 10364 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.030543  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.032846  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.034127  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.026s
W20260709 12:21:58.037348  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.000s	sys 0.026s
I20260709 12:21:58.037757  8214 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:58.037907  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 615603us
I20260709 12:21:58.034235  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:57.976413 10246 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:21:57.847074 10355 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:57.903309 10341 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.005414 10353 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:58.043327 10211 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:58.043813 10345 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.054s	sys 0.086s
W20260709 12:21:58.054734  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.034446 10163 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.039863  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:58.075213  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:58.015094 10360 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:58.065125 10211 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:58.065395 10345 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.054s	sys 0.087s
I20260709 12:21:58.065156 10371 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:58.066582 10338 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.069074 10311 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.062252  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.040315 10303 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.036365 10352 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:57.940660 10315 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:21:58.087708  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:58.145790  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.146907  8220 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:58.126557  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.034s
W20260709 12:21:58.148186  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.034s
I20260709 12:21:58.124712 10211 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:58.133592 10257 consensus_meta.cc:287] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.101s	user 0.016s	sys 0.006s
I20260709 12:21:58.070055 10248 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:58.157581  8068 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:58.154351 10116 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.556s	user 0.013s	sys 0.001s
I20260709 12:21:58.136227 10077 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:58.158983 10077 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:58.159951 10377 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.160305 10077 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:58.127630  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 219523us
I20260709 12:21:58.160959 10377 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:58.162694  8110 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.025s (SENT)
I20260709 12:21:58.163163  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:58.163285  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 134319us
I20260709 12:21:58.168423  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.174055  8218 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:58.180928  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.181684  8220 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:21:58.185746  8138 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:21:58.188561  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 113435us
I20260709 12:21:58.189972  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:58.193045  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:58.194200  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 117646us
I20260709 12:21:58.149924 10352 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.158025 10353 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:58.198256 10257 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:58.202893  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 172458us
I20260709 12:21:58.182699 10234 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.197186  8211 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:58.199436 10315 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.200975  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.201907 10361 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:21:58.202384 10374 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.191689 10347 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.194478 10281 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:58.124998 10360 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.204078 10371 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.197710 10352 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:58.060132 10356 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.203584 10353 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:58.193353 10303 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:21:58.188406 10248 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.183898 10116 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:58.246451 10369 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:21:58.246937 10116 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.216066 10162 consensus_meta.cc:287] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.467s	user 0.008s	sys 0.016s
I20260709 12:21:58.157380 10213 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:58.239421 10212 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.184s	user 0.009s	sys 0.012s
I20260709 12:21:58.241464 10339 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.238678 10347 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.256414 10348 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:21:58.244025 10353 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.212452 10234 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:58.266376 10372 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:21:58.253396 10292 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.216s	user 0.015s	sys 0.005s
I20260709 12:21:58.259898 10284 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.275542 10366 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:58.272815 10339 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.280812 10347 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:58.281055 10336 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.225s	user 0.006s	sys 0.008s
W20260709 12:21:58.284803 10349 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.005s
I20260709 12:21:58.291576 10349 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.291865 10355 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.293861 10360 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.332752  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1353) took 1280 ms. Trace:
I20260709 12:21:58.333701  8061 rpcz_store.cc:276] 0709 12:21:57.052641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.025050 (+972409us) service_pool.cc:224] Handling call
0709 12:21:58.063544 (+ 38494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.120216 (+ 56672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:58.126514 (+  6298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:58.135070 (+  8556us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:58.140215 (+  5145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.144309 (+  4094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.332432 (+188123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:58.336113  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:58.337523  8061 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:58.341713  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.342675  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.353528  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1351) took 1312 ms. Trace:
I20260709 12:21:58.354012  8062 rpcz_store.cc:276] 0709 12:21:57.041350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.766282 (+724932us) service_pool.cc:224] Handling call
0709 12:21:57.766666 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:57.781727 (+ 15061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.781776 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:57.782349 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:21:58.061265 (+278916us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:58.352192 (+290927us) log.cc:844] Serialized 14 byte log entry
0709 12:21:58.352800 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.352976 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:58.353041 (+    65us) raft_consensus.cc:1685] finished
0709 12:21:58.353055 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:58.353326 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11831,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":5188,"raft.queue_time_us":40911,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":414843,"threads_started":2,"wal-append.queue_time_us":322830}
I20260709 12:21:58.358680  8062 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:58.360693  8062 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:58.362437  8062 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:58.364039  8062 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:21:58.368753  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.368760  8062 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [2.4-5.6]
W20260709 12:21:58.387580  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 219171us
I20260709 12:21:58.393124 10392 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:58.199147  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:58.402410  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.407675  8211 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:21:58.237289  8731 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.126s (SENT)
I20260709 12:21:58.409781  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.411088 10075 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.405349  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 206140us
I20260709 12:21:58.412082  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.413235  8211 raft_consensus.cc:2376] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3. Re-sending same reply.
I20260709 12:21:58.259158 10162 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.243600 10205 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:58.437538 10257 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.437842 10205 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:58.438758 10257 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:58.402752  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.441409 10281 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:58.403297  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.442689 10343 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.006s
I20260709 12:21:58.261907 10212 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.461347 10162 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:58.461732  9866 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.415134  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.425089  8061 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:21:58.411079  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 173740us
I20260709 12:21:58.400542  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.282912 10292 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.474594  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 352) took 1325 ms. Trace:
I20260709 12:21:58.475024  8064 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:58.446187 10336 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:58.477717 10292 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.448547 10257 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.449410  8217 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:58.286259 10339 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.455700 10347 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.444360  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.465168 10297 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:58.466735  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1333) took 1558 ms. Trace:
I20260709 12:21:58.480172  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.480813 10338 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.481189 10281 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:58.481878  8146 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:58.482174 10349 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.482781  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.443609 10343 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.475108  8138 rpcz_store.cc:276] 0709 12:21:57.149085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.510422 (+361337us) service_pool.cc:224] Handling call
0709 12:21:58.472944 (+962522us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.474346 (+  1402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376686848}
I20260709 12:21:58.502171 10336 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.502900 10336 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:58.503528 10336 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.504719 10343 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.505581  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:58.506210  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:58.506573  8062 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.507377  8070 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:58.485301 10381 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.489814  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1207) took 1878 ms. Trace:
I20260709 12:21:58.483778 10212 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.494975  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1199) took 2637 ms (client timeout 2989 ms). Trace:
I20260709 12:21:58.499866  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.488919  8065 rpcz_store.cc:276] 0709 12:21:56.907306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.907512 (+   206us) service_pool.cc:224] Handling call
0709 12:21:56.959717 (+ 52205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.983409 (+ 23692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.465348 (+1481939us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54001f6654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.465853 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52088192}
I20260709 12:21:58.501080  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1208) took 1893 ms. Trace:
I20260709 12:21:58.500407  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 475) took 1525 ms. Trace:
I20260709 12:21:58.440388 10205 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.477022  8211 raft_consensus.cc:2376] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3. Re-sending same reply.
I20260709 12:21:58.511382  8212 rpcz_store.cc:276] 0709 12:21:56.607624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.607744 (+   120us) service_pool.cc:224] Handling call
0709 12:21:56.608050 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:57.047582 (+439532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.485658 (+1438076us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002b5054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.486139 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948965632}
I20260709 12:21:58.512951  8763 rpcz_store.cc:276] 0709 12:21:56.975071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.975832 (+   761us) service_pool.cc:224] Handling call
0709 12:21:57.710338 (+734506us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:58.499859 (+789521us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54003106d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.500187 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129144448}
W20260709 12:21:58.511945  8218 rpcz_store.cc:269] 0709 12:21:55.857337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.869076 (+ 11739us) service_pool.cc:224] Handling call
0709 12:21:58.494376 (+2625300us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002a5dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.494707 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4223884032}
I20260709 12:21:58.512844  8217 rpcz_store.cc:276] 0709 12:21:56.607916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.609528 (+  1612us) service_pool.cc:224] Handling call
0709 12:21:58.500689 (+1891161us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400374454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.500962 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4227612544}
I20260709 12:21:58.533545  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.535676 10120 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.011s
I20260709 12:21:58.536249 10205 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:58.536377 10120 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:58.545457  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.518807 10381 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.554752 10381 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.555042  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:58.559767  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.561143  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 85150.4us
I20260709 12:21:58.560503 10120 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.567443  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.579679 10338 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.581756  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:58.582043 10316 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.964s	user 0.007s	sys 0.019s
I20260709 12:21:58.527748 10384 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:21:58.585336  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:58.586254  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:58.588551 10278 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:58.589283 10278 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:58.580359 10338 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:58.572103  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 171911us
I20260709 12:21:58.591234 10278 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.559536 10211 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.605595  8211 raft_consensus.cc:2376] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4. Re-sending same reply.
I20260709 12:21:58.596153 10338 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.607206  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.611635  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.612310  8211 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:21:58.609982  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:58.624118  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.625451  8214 raft_consensus.cc:2410] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:58.626091  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1209) took 2017 ms. Trace:
I20260709 12:21:58.626611  8215 rpcz_store.cc:276] 0709 12:21:56.608225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.610667 (+  2442us) service_pool.cc:224] Handling call
0709 12:21:56.643155 (+ 32488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:57.475139 (+831984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.982071 (+506932us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b5400340e20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8fa02 00007f498ca8bdd6 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:21:58.625536 (+643465us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54003a7354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.625874 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626331648}
I20260709 12:21:58.627172  8214 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:21:58.611356 10185 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.034s
I20260709 12:21:58.633170  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.636746  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.598793 10316 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.636055 10384 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.650830  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66991.9us
I20260709 12:21:58.648958 10344 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:58.652439 10344 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:58.652496 10121 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.652942 10344 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:58.653241 10121 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.655566 10249 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.670058  8062 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:58.675730  8215 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:58.684342  8211 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:21:58.685225  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.685127 10353 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.685482  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1217) took 1654 ms. Trace:
I20260709 12:21:58.686098  8211 rpcz_store.cc:276] 0709 12:21:57.031393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.634304 (+1602911us) service_pool.cc:224] Handling call
0709 12:21:58.657508 (+ 23204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:58.685067 (+ 27559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.685368 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:58.687531 10353 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.687688  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:21:58.688764 10124 consensus_meta.cc:287] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.011s
I20260709 12:21:58.689425  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:58.690160 10185 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:58.691223  9578 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:58.691995  9578 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:58.695292 10267 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:58.697506  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 113810us
W20260709 12:21:58.679162 10302 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.687s	user 0.020s	sys 0.002s
I20260709 12:21:58.702459 10122 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:58.701259 10302 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.691154 10185 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:58.666848 10257 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:58.674108 10249 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.714654  8211 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.720971 10311 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:58.722062 10311 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.721014 10120 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.723388 10120 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.725817 10120 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.727121  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.726925  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:58.727319  9735 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.131s	user 0.014s	sys 0.019s
I20260709 12:21:58.728278  8143 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:58.727939  9735 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.728837  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:58.729380  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:58.729642  8140 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.730283  8139 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:58.730639  9735 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.732048  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:58.722651 10217 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.235s	user 0.020s	sys 0.020s
I20260709 12:21:58.732837  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:58.708444 10216 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.733839  8144 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:58.734110 10216 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:58.734835 10397 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:58.735039 10216 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.736799  8142 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:58.737545 10311 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.679160 10384 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.732863  8141 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:58.716719  8214 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:58.732936 10217 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.715991  9578 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.746685 10257 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.714247 10121 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.756474  8063 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:58.746696  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 487453us
I20260709 12:21:58.757740  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.764573  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:58.764981  8216 raft_consensus.cc:2368] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:21:58.765388 10316 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.765736  8065 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:58.766602  8110 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.109s (SENT)
I20260709 12:21:58.766701  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2483) took 1004 ms. Trace:
I20260709 12:21:58.767146  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.767916 10353 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.732765 10297 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:58.768597 10353 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:58.771008 10364 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.697s	user 0.015s	sys 0.004s
I20260709 12:21:58.771210 10353 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.771575 10364 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.773499  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1352) took 1727 ms. Trace:
I20260709 12:21:58.773658 10211 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.773927  8064 rpcz_store.cc:276] 0709 12:21:57.046267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.813779 (+767512us) service_pool.cc:224] Handling call
0709 12:21:57.814108 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.475693 (+661585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.773237 (+297544us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54002030d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.773435 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518756224}
I20260709 12:21:58.775856  8137 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:58.768896  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62551.1us
I20260709 12:21:58.776391  8141 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:58.719998 10185 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.781260  8138 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:58.785420  8139 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:58.767196  8216 rpcz_store.cc:276] 0709 12:21:57.762529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.499202 (+736673us) service_pool.cc:224] Handling call
0709 12:21:58.766483 (+267281us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000cc1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.766639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534952704}
I20260709 12:21:58.753381 10077 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:21:58.808175  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:58.811324 10216 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.812713 10360 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.818023 10025 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:58.818615 10025 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:58.820596 10352 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.000s
I20260709 12:21:58.820514  8140 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:58.821305 10352 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.821717  8144 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:58.822279  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:58.825512 10217 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:21:58.828039 10333 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.720s	user 0.002s	sys 0.000s
I20260709 12:21:58.830924  8145 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:58.831670  8143 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:58.832051  8143 pending_rounds.cc:85] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
I20260709 12:21:58.832319  8143 pending_rounds.cc:107] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:58.833410  8141 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:58.833767 10396 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:21:58.835515  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:58.832610  8143 raft_consensus.cc:2889] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.837950  8211 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:58.839780  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.840456  8216 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.836217  8144 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:21:58.841825  8215 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:58.843582  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.847069 10252 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:58.849094  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:58.852666 10395 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:21:58.852931 10302 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.848181  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:58.854457  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.814522  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.842823 10360 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:58.857636  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.858743  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:58.861238 10211 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.861907  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:58.862162  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1342) took 1950 ms. Trace:
I20260709 12:21:58.862054 10211 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.862646  8068 rpcz_store.cc:276] 0709 12:21:56.911629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.637052 (+725423us) service_pool.cc:224] Handling call
0709 12:21:57.637424 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.158132 (+520708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.861639 (+703507us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000fdcd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.861979 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195727232}
I20260709 12:21:58.863232 10155 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:58.863888 10155 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:58.864868 10155 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.866117  8067 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:21:58.868234 10084 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.868690  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.868821 10084 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.873337  8141 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:58.847116 10257 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:58.874733  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 281) took 2410 ms. Trace:
I20260709 12:21:58.875336  8213 rpcz_store.cc:276] 0709 12:21:56.464358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.488598 (+ 24240us) service_pool.cc:224] Handling call
0709 12:21:56.488923 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:57.982846 (+1493923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:58.874262 (+891416us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000e7254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:21:58.874539 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3419141376}
I20260709 12:21:58.876573  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.877355  8213 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:58.878338 10384 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.878579  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.879343  8213 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:21:58.879693 10341 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:58.881237  8763 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:58.881345  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1213) took 2271 ms (client timeout 1938 ms). Trace:
W20260709 12:21:58.881907  8219 rpcz_store.cc:269] 0709 12:21:56.609370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.643602 (+ 34232us) service_pool.cc:224] Handling call
0709 12:21:58.880823 (+2237221us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540017d4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.881079 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186731904}
I20260709 12:21:58.883010 10302 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:58.883260  8217 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:58.883627 10302 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:58.884583  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2471) took 1125 ms. Trace:
I20260709 12:21:58.884999  8217 rpcz_store.cc:276] 0709 12:21:57.759271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.596809 (+837538us) service_pool.cc:224] Handling call
0709 12:21:58.884354 (+287545us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400168fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.884522 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572979584}
I20260709 12:21:58.885636  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1171) took 1140 ms. Trace:
I20260709 12:21:58.886031  8146 rpcz_store.cc:276] 0709 12:21:57.744926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.811743 (+ 66817us) service_pool.cc:224] Handling call
0709 12:21:58.885389 (+1073646us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54002f1a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:58.885551 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314424704}
I20260709 12:21:58.886652  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.880378  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:58.881285  8211 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:21:58.893991  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 127443us
W20260709 12:21:58.902757 10403 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:21:58.903062 10258 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:58.888573 10302 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.907997  8213 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.914166  8217 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:58.914491  8144 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.864419 10211 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:58.911597  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.904985 10292 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.910096 10252 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:21:58.919180 10292 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.932569  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:21:58.935949  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.199s (SENT)
I20260709 12:21:58.937270  8763 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:58.938758  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.935521  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:58.939805 10244 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.133s	user 0.011s	sys 0.017s
I20260709 12:21:58.939939 10338 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.940423 10244 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.941392 10339 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.858922 10077 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:58.939870  8764 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:58.943635  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.944559  8214 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:58.946731  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.948048  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:58.949160  8212 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:58.950474 10234 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:58.948954 10370 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:21:58.937007 10292 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:58.911353 10360 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:58.959019  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:58.959103  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:58.975921  8217 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:21:58.970141  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46760.9us
I20260709 12:21:58.976454  8062 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:21:58.982764  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.942515 10346 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.986090  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:58.986397  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:58.958442 10216 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.990123  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:21:58.951646 10341 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:58.967607 10402 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:21:58.961897 10352 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:58.992268  8110 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.310s (SENT)
I20260709 12:21:58.992888 10338 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:59.001705  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53734.7us
I20260709 12:21:58.953727 10124 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:59.013371 10212 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.952050 10364 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:59.014443 10323 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.527s	user 0.006s	sys 0.002s
I20260709 12:21:59.010998  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:58.969251 10315 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:58.971302 10077 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:59.022713  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 80579.2us
I20260709 12:21:59.032035  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:59.030510 10278 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 12:21:59.034646  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.017670 10341 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.024402  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:58.943936 10344 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.011715 10346 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.962903 10311 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.029847  8144 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:21:59.039970  8064 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.037312  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.031710 10364 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.031167 10216 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.023628 10124 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.030572 10212 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.046268  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:59.046921  8213 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:21:59.048162  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.039036 10341 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.056492  8211 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.051126 10364 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:59.042580 10346 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.036188 10316 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.034497 10315 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.065430 10315 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.065474 10185 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.066854 10122 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:59.067356 10122 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.067755 10122 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.069790  8757 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:59.071928  8765 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:59.058377 10212 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.073311  8763 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:21:59.074479  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:59.074666  8067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1331) took 3999 ms (client timeout 2098 ms). Trace:
I20260709 12:21:59.066812  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:59.075121  8067 rpcz_store.cc:269] 0709 12:21:55.075128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.784227 (+709099us) service_pool.cc:224] Handling call
0709 12:21:59.063711 (+3279484us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b54003228d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:59.074568 (+ 10857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7022643968}
I20260709 12:21:59.076614  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.077354  8213 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:59.049625 10278 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:59.051004 10075 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:59.080693  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.066047  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:59.083143  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:21:59.083410  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.081974 10339 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:21:59.085402  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93189.4us
I20260709 12:21:59.085665  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.086673  8146 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.087646  8217 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:59.089363  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.090108  8141 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.091701  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.093791 10338 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:59.094266 10338 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.094617 10338 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.094779  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.096350  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.097110  8138 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.099079  8137 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:59.063603 10233 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:59.107388  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:59.086233  8110 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.387s (SENT)
W20260709 12:21:59.109814  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43876.8us
I20260709 12:21:59.107625  8064 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
W20260709 12:21:59.110937  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.114324 10279 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:59.115151  9730 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:59.115715 10344 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.114355 10114 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.121042 10278 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:59.123827  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.123963  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.122907 10075 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.125936 10185 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:59.125674 10278 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.126291 10075 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.128543 10383 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:59.128979 10383 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:59.129987 10383 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.131278  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.131903  8219 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:21:59.135190  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:59.138017  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 54927.3us
I20260709 12:21:59.108878 10244 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.147740  8138 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:59.148252  8065 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:59.148603  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2488) took 1145 ms. Trace:
I20260709 12:21:59.150885  8215 rpcz_store.cc:276] 0709 12:21:57.992801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.684047 (+691246us) service_pool.cc:224] Handling call
0709 12:21:58.838392 (+154345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.842265 (+  3873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.135140 (+292875us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b540017cfd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:59.138469 (+  3329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222021888}
I20260709 12:21:59.151456 10352 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:59.152245  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.153474  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.154426  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.155159  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.155365  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.157466 10316 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:59.175457  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 89248.2us
I20260709 12:21:59.159096 10120 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:59.123272 10279 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:59.127031 10185 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:59.162235 10377 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:59.167251  8217 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:59.167577  8215 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:59.169164  8764 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:59.178061  8216 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:59.178925  8146 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:59.182687  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.131310 10383 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.195513  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.200007  8070 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:59.205011  8110 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.521s (SENT)
I20260709 12:21:59.176065 10316 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:59.212100  8063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1348) took 2185 ms (client timeout 1683 ms). Trace:
W20260709 12:21:59.220100  8063 rpcz_store.cc:269] 0709 12:21:57.026643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.121876 (+ 95233us) service_pool.cc:224] Handling call
0709 12:21:59.195049 (+2073173us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400193cd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:59.211978 (+ 16929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2928821120}
I20260709 12:21:59.212591  8213 raft_consensus.cc:2376] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5. Re-sending same reply.
I20260709 12:21:59.203411  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.216930  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.222569  8217 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:21:59.224728  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.225917  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.217008  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:59.202705 10336 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.698s	user 0.001s	sys 0.015s
I20260709 12:21:59.189323 10185 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:59.225414  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.231897 10248 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.235411  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:59.235994 10410 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:21:59.236742  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 289) took 1538 ms. Trace:
I20260709 12:21:59.237123 10216 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.238622  8216 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.229730  8219 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.245568  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:59.246413  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89919.2us
I20260709 12:21:59.237350 10244 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:59.255357  8144 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.251263  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.267118  8217 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:59.256465  8212 rpcz_store.cc:276] 0709 12:21:57.698720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.560774 (+862054us) service_pool.cc:224] Handling call
0709 12:21:59.236467 (+675693us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400133b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:59.236662 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763625344}
I20260709 12:21:59.258397  8757 raft_consensus.cc:2410] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:59.225279 10316 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:59.264503  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.271235  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.272691  8213 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:59.209030 10122 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.249328 10349 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:59.275689  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:21:59.283422  8211 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:59.285384 10360 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.306061  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.287307 10185 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.307462 10185 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:59.288057  9578 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:59.316704  8759 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:21:59.317960  8731 leader_election.cc:336] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.753s (SENT)
I20260709 12:21:59.318493  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:59.318583  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.319556  8218 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:59.319988  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2468) took 1741 ms (client timeout 2310 ms). Trace:
I20260709 12:21:59.320214 10279 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.320920  9578 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.322482 10124 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:59.323163  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52467.8us
I20260709 12:21:59.324549  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.325271  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:21:59.320349  8218 rpcz_store.cc:269] 0709 12:21:57.578924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.521802 (+942878us) service_pool.cc:224] Handling call
0709 12:21:59.318498 (+796696us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967f8c 00007f4989967ef6 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:21:59.319932 (+  1434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16893184}
I20260709 12:21:59.333753  8216 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:21:59.325667  9903 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:21:59.287230  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.323513 10124 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.346609  8215 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:59.349962 10102 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:59.351020 10122 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.280644 10352 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:59.244966 10336 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.339332  8144 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:21:59.352694  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 156113us
W20260709 12:21:59.355038  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 79449us
I20260709 12:21:59.241681 10311 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:21:59.241492 10377 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.357384  8212 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:59.288502 10025 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.358234 10352 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:21:59.282722 10349 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:59.381999  8756 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:59.382323 10335 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:21:59.383249 10377 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.352659 10077 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:21:59.383730  8066 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:21:59.386560  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.387063  8140 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:59.376999 10248 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:59.401625  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.339633 10216 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:21:59.356137 10339 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:21:59.384361 10258 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.355479 10292 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.409345  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.417766  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.422418  8138 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:21:59.427623  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.426568  8063 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:59.431103  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.401196 10311 consensus_queue.cc:1243] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:59.407017 10114 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.413672 10248 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.398408 10212 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.479624  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:59.468422  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.497466  8068 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:59.480268  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1345) took 2556 ms (client timeout 1668 ms). Trace:
I20260709 12:21:59.424155 10239 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 12:21:59.437765 10384 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:59.512805 10384 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:59.515204 10077 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:59.515687 10077 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:59.516614 10077 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.517612 10084 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.517800 10077 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.521044 10384 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.525127  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:59.527709 10114 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.529749 10025 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:59.528180 10384 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.531131 10336 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.534492  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:21:59.507606  8066 rpcz_store.cc:269] 0709 12:21:56.923790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.708093 (+784303us) service_pool.cc:224] Handling call
0709 12:21:59.480035 (+1771942us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540011dad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:21:59.480194 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430662016}
W20260709 12:21:59.541121  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 269801us
I20260709 12:21:59.477757  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:21:59.477509 10418 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:59.477674 10213 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:59.480494 10337 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:21:59.567626  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 227369us
I20260709 12:21:59.582186  8218 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:59.582774  8218 pending_rounds.cc:85] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:21:59.583103  8218 pending_rounds.cc:107] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:59.583418  8218 raft_consensus.cc:2889] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.541929 10114 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.421378 10258 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.589720  8146 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:21:59.590799  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:59.570798 10077 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:59.612345  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.573315 10370 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:59.575083 10337 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:21:59.617636  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 291862us
I20260709 12:21:59.587568 10213 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.493227 10352 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.548941 10364 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.622679  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.597625 10122 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:59.612174 10077 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:21:59.631047  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.577667 10155 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:21:59.512362 10349 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.641109  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:59.638232  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81157.4us
I20260709 12:21:59.639597  8137 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:59.586479 10339 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:21:59.648943  8137 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:21:59.604344 10338 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.509s	user 0.013s	sys 0.000s
I20260709 12:21:59.643455 10114 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:59.659087  8760 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:59.661839 10231 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.661979  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.662719  8139 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.663610 10316 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.664912  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.669471 10122 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.670161 10316 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.672086 10122 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.651016  9903 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.676801  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.677840  8145 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:59.641501 10077 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.681895 10337 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.683537 10213 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.643784 10084 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:21:59.688024 10084 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.741317  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:21:59.741954  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 151229us
I20260709 12:21:59.722258  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:21:59.748011  8218 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:59.651324 10292 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.749387  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.743108  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:21:59.696832 10341 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 12:21:59.753314  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.757860  8141 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:59.696405 10352 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.696015 10114 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.763947  8139 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:59.768239  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.768886  8143 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.769018  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.770153  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:21:59.764977 10383 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.563s	user 0.002s	sys 0.010s
I20260709 12:21:59.660391 10338 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.756805 10244 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:59.778093  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.761029 10339 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:59.782974  8762 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:59.787119  8764 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.774621  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.759865 10353 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:21:59.793174  8756 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:59.795884  8137 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:59.796801  8139 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:21:59.781248  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:59.799109  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.659269 10248 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.798264  8142 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.767555 10341 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.804380  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.809672  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.789698 10244 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:21:59.804414 10422 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:21:59.824462 10315 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 12:21:59.825023 10315 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.826313  8069 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:59.827358 10315 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.816406  8145 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.827957 10338 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.819233 10341 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:21:59.828361 10346 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.732s	user 0.000s	sys 0.009s
I20260709 12:21:59.835963  8765 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:21:59.808897 10425 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:21:59.841915  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.842705  8138 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:21:59.839278  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.843978  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.844605  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.845561  8142 raft_consensus.cc:2410] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:59.846393  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.847076  8142 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:21:59.849253  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.850382 10341 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:59.851859 10341 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:59.852317 10341 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.836889 10077 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:21:59.856178 10077 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:21:59.842772 10212 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.841048 10346 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:21:59.857287  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.857563  8138 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.802821 10339 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:59.866784  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:21:59.793691 10433 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:21:59.869469  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.875661 10346 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:21:59.877848 10433 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:59.878302 10433 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:21:59.879173 10433 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:21:59.885490  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45400.4us
I20260709 12:21:59.886577  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:21:59.887632 10434 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:59.888507 10434 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:59.889282 10120 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:59.889729 10120 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:21:59.890698 10120 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.891122 10339 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.898345  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:59.898627  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:59.899284  8061 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:59.900188  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:21:59.900930  8066 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.901859 10258 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:21:59.902669  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:21:59.904832  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.908063 10421 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:21:59.910403  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.910466  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.914474  8138 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:21:59.861179 10341 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.880473 10433 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.924589  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.920212  8143 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:21:59.924813  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.929795  8063 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:59.926352  8064 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.931474  8215 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.927157  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:21:59.932001  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:21:59.935225  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.935837  8142 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.937827  8070 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:59.939123  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.941473  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.942171  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.927263 10257 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.925199  8061 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:21:59.943467  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.947144  8214 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:59.946385  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.950765  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.955344  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.944974  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.956852  8762 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:21:59.942901  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:21:59.962738  8068 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.966259 10434 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:59.966810 10434 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.968087  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:21:59.959299  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:21:59.969149  8760 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:21:59.933862 10258 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:59.857753 10114 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:21:59.974303 10213 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:59.977705  9730 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:59.944128  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:21:59.978102  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:21:59.999007  8217 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:59.941044 10338 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:22:00.007017  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:21:59.967196 10434 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.943364 10257 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.027118  8138 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:21:59.996019 10213 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:21:59.997094 10258 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.009368  8756 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:00.035844  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:00.028012 10084 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.059737  8144 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:00.059078  8219 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.026122  9730 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:00.034178 10384 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 12:22:00.064306  8214 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.072360  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:21:59.984440  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:22:00.075384  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91282.3us
I20260709 12:22:00.061471 10281 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.077934  8220 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:00.078378  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:00.079704  8144 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:00.084203  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.084888  8138 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:00.073707 10287 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:00.086879  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:21:59.990073 10244 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.087888  9730 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.116994  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.121130  8215 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.121678  8144 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.122118  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.122799  8142 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.123994  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:00.091374  8214 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.093456 10163 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.094106  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:00.127255  8217 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:00.096129  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1190) took 1006 ms. Trace:
W20260709 12:22:00.097434  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.099215  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.129113  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.130038  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.103385  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:00.104166  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.109169  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.101680 10257 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:00.111581  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.114164 10213 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:00.129123  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.136615  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.127856  8140 rpcz_store.cc:276] 0709 12:21:59.089909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.093936 (+  4027us) service_pool.cc:224] Handling call
0709 12:21:59.094249 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:59.396454 (+302205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.095854 (+699400us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400312754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:00.096046 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672875264}
W20260709 12:22:00.147617  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.089524 10287 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.170603  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.136754 10315 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:00.171473  8063 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:00.146625 10084 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:00.163223 10287 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:00.179500  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.191531  8146 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:00.083482 10281 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.198832 10162 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:00.199347 10162 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:00.200378 10162 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.209162  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.209741 10162 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:00.210122  8063 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:00.210866  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.211730  8070 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:00.213315  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:00.213829  8070 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:00.218609  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.219435  8063 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.219558  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.221717  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:00.222165  8110 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.998s (SENT)
I20260709 12:22:00.222702  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:00.223861  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.225732  8142 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:00.238579  8064 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:00.240298  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.190855 10315 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.135471  8144 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.149003 10163 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.258956  8214 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:00.204957 10084 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.263492  8138 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:00.166523 10258 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.267309  8138 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:00.243686 10419 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:00.264374  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.274559  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.269237  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.270615  8138 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:00.281513  8064 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:00.282383  8216 raft_consensus.cc:2368] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:00.284384  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:00.284588  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62470.2us
I20260709 12:22:00.288915 10315 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.291798  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.292557  8063 raft_consensus.cc:2376] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4. Re-sending same reply.
I20260709 12:22:00.293610  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.294296  8063 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.295068  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.300712  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.299564  8756 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:00.311054 10434 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.313318 10434 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:00.315346 10364 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.329608  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:00.349310  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46398.2us
I20260709 12:22:00.351047 10419 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:00.351876 10419 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.355278 10419 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:00.356490  8110 connection.cc:256] RPC call timeout handler was delayed by -1.7609476489997178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 12:22:00.357129  8110 connection.cc:256] RPC call timeout handler was delayed by -1.7168476489996465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 12:22:00.357612  8110 connection.cc:256] RPC call timeout handler was delayed by -1.6394476489999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:22:00.358050  8110 connection.cc:256] RPC call timeout handler was delayed by -1.5071476489997622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:22:00.358489  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4477476489996661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:22:00.358948  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4441476489996603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:22:00.359383  8110 connection.cc:256] RPC call timeout handler was delayed by -1.3982476490000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 12:22:00.360816 10419 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:00.361689 10419 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.366976  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:00.365052 10419 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.380069  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:00.387638  8138 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:00.394423  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:00.400581  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.401556  8067 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.383576 10122 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:00.381620  9730 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:00.426749 10122 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.422180 10336 raft_consensus.cc:2764] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:00.433300 10122 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:00.434330  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2469) took 2820 ms (client timeout 2387 ms). Trace:
W20260709 12:22:00.434756  8220 rpcz_store.cc:269] 0709 12:21:57.615748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.532856 (+917108us) service_pool.cc:224] Handling call
0709 12:22:00.434119 (+1901263us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540016a3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:00.434267 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3548592512}
I20260709 12:22:00.437019 10349 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.438180 10084 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:00.449214 10341 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.003s
I20260709 12:22:00.449875 10341 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:00.451392  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.454267 10352 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.001s
I20260709 12:22:00.457650  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1228) took 1407 ms. Trace:
I20260709 12:22:00.458081  8211 rpcz_store.cc:276] 0709 12:21:59.049873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.234244 (+184371us) service_pool.cc:224] Handling call
0709 12:21:59.234648 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.283834 (+ 49186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.457357 (+1173523us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:00.457569 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102822784}
I20260709 12:22:00.462759 10120 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:00.454425 10338 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:00.455144 10341 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.465510  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.468760  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:00.468773  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.470393  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:00.470593  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:00.468706  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.473943  8067 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:00.474658  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.466221 10338 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:00.478567  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48166.8us
I20260709 12:22:00.467424 10419 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:00.490330  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.503032  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.504160  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.505157  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.492163 10464 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:00.493587  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.479628 10338 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.510041 10464 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.510262 10338 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.511627 10338 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:00.512523 10464 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.522771  8143 raft_consensus.cc:2410] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:00.499794  8759 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:00.477581 10124 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:00.501157 10341 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.507010  9903 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.542001  9578 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.507124 10234 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.507447 10434 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:00.502141 10336 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:00.507908 10335 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:00.545145 10336 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.544948 10341 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.528985 10124 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.545537 10335 consensus_queue.cc:1243] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:00.545658 10336 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:00.546103 10124 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.546320 10335 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:00.546738 10335 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:00.547657 10335 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.509006  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.540942 10419 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.543952 10287 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.550597  8063 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.549597  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.477114 10292 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:00.557786 10292 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.558210 10292 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.561022 10434 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:00.545480 10439 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.433s	user 0.001s	sys 0.003s
I20260709 12:22:00.563581  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.546178 10248 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:00.565017 10248 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.565304 10120 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.561029  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 480) took 1368 ms. Trace:
I20260709 12:22:00.566113  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:00.566375  8765 rpcz_store.cc:276] 0709 12:21:59.193149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.193315 (+   166us) service_pool.cc:224] Handling call
0709 12:22:00.560856 (+1367541us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54004c2f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:00.560973 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278965120}
I20260709 12:22:00.539390  8067 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:00.553649  8110 leader_election.cc:400] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:00.554220 10287 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.555950 10341 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.556950  8070 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:00.557226  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.573122  9903 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:00.573773  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.573870  9903 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:00.564857 10234 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.568856 10434 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:00.576917  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:00.567099 10120 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.594311  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1365) took 1505 ms. Trace:
I20260709 12:22:00.594853  8069 rpcz_store.cc:276] 0709 12:21:59.088661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.101530 (+ 12869us) service_pool.cc:224] Handling call
0709 12:21:59.101916 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:59.826708 (+724792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.593928 (+767220us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54003962d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:00.594222 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665183104}
I20260709 12:22:00.595552 10120 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:00.596208 10120 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:00.600926  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.602483  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.577169 10419 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.604542  8064 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:00.608595  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:00.586144 10335 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:00.611650  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 137786us
I20260709 12:22:00.608114 10434 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.637931  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:00.614239 10419 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:00.614804 10433 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:00.580402 10248 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.652931  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:00.653259 10248 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.653614  8142 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:00.644914  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.632807  9903 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.657637  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.658733  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.659837  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.645090  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:00.645850  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:00.646960  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.647332  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:00.662564  8214 raft_consensus.cc:2368] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:00.647681  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.660490  8217 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.648451  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:00.649629  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 75892.3us
I20260709 12:22:00.650244  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:00.663472  8140 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:00.648074  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:00.669000  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.671540  8216 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:00.670773  8069 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:00.614977 10077 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:22:00.688318  8139 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:00.692905  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:00.693385  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.694272  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.696727  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:00.699770  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.642017 10468 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.708699  8211 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:00.672163 10434 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.676342 10433 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:00.696084 10349 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:00.762598  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.757154  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:00.752588  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 106865us
I20260709 12:22:00.740491  8140 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:00.763898  8220 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:00.749717  8213 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:00.769853  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.770287  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:00.761186  8214 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:00.770545  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 78428us
W20260709 12:22:00.724009  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.769232  8142 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 2: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:00.761623  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:00.770965  8140 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:00.718525  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:00.753404 10466 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:00.776180  8216 raft_consensus.cc:2368] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:00.773747  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:00.725212 10461 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:22:00.778254  8213 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:00.778697  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:00.781070 10287 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:00.718317 10469 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:00.705258 10124 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.777797  8110 leader_election.cc:400] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:00.788908  8110 leader_election.cc:403] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:00.787873  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 690931us
I20260709 12:22:00.769284 10349 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:00.786912  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:00.781728 10287 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:00.794659  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:00.787478  8140 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:00.785957  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:00.727305 10434 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.750694 10336 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.781989 10213 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:00.782625 10281 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.792182 10469 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.774526 10382 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:22:00.788869  9903 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.810458 10287 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.811545 10364 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.813983 10012 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:00.814366 10364 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.817626  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.818495  9903 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.819865 10345 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:00.820971  9903 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.794332 10370 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.801497 10213 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:00.830024 10213 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:00.829396  7965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 172) took 11293 ms (client timeout 15000 ms). Trace:
I20260709 12:22:00.752318 10292 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.795429 10349 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:00.840973  8146 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:00.837728  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.840942  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:00.855237  8214 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:00.857398  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.800984 10234 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:00.865804  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 96039.9us
W20260709 12:22:00.869695  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.871343  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.872905  9578 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:00.865720 10338 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:00.832942  7965 rpcz_store.cc:269] 0709 12:21:49.503635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.503824 (+   189us) service_pool.cc:224] Handling call
0709 12:22:00.793004 (+11289180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:57.039640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:57.248535 (+208895us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:57.248593 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:21:57.248653 (+    60us) tablet.cc:662] Decoding operations
0709 12:21:57.249832 (+  1179us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:57.249916 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:57.249960 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:21:57.250764 (+   804us) tablet.cc:701] Row locks acquired
0709 12:21:57.250790 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:21:57.250992 (+   202us) write_op.cc:270] Start()
0709 12:21:57.251154 (+   162us) write_op.cc:276] Timestamp: P: 1783599717250928 usec, L: 0
0709 12:21:57.251185 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:21:57.509302 (+258117us) log.cc:844] Serialized 2835 byte log entry
0709 12:21:57.729396 (+220094us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f49899820ac 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b
0709 12:21:58.299178 (+569782us) op_driver.cc:464] REPLICATION: finished
0709 12:21:58.300928 (+  1750us) write_op.cc:301] APPLY: starting
0709 12:21:58.450109 (+149181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:58.450606 (+   497us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:58.450673 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:58.452125 (+  1452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:58.464288 (+ 12163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:21:58.464385 (+    97us) write_op.cc:312] APPLY: finished
0709 12:21:58.465254 (+   869us) log.cc:844] Serialized 59 byte log entry
0709 12:21:58.465598 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:58.466021 (+   423us) write_op.cc:454] Released schema lock
0709 12:21:58.487610 (+ 21589us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:58.601994 (+114384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:58.604394 (+  2400us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":270,"mutex_wait_us":3007561,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1450,"apply.run_cpu_time_us":5765,"apply.run_wall_time_us":264842,"num_ops":7,"prepare.queue_time_us":303453,"prepare.run_cpu_time_us":39227,"prepare.run_wall_time_us":1024099,"raft.queue_time_us":51019,"raft.run_cpu_time_us":1893,"raft.run_wall_time_us":165225,"replication_time_us":1047796,"spinlock_wait_cycles":20719488,"thread_start_us":813769,"threads_started":4,"wal-append.queue_time_us":549593,"wal-append.run_cpu_time_us":11920,"wal-append.run_wall_time_us":1398806}]]}
I20260709 12:22:00.881439  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:00.893646  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.863674 10370 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:00.864130 10234 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.897349  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.884654  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:00.869369 10025 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:00.877774  9903 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.848238 10469 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.909489  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:00.898293 10281 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.899708 10234 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:00.915180 10370 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:00.917894 10124 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.920702 10279 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:00.859298 10433 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:00.931625 10025 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:00.912384  9903 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:00.933616 10382 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.935288 10212 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:00.937724  8142 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:00.940696 10364 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:00.915510  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 141112us
I20260709 12:22:00.946661 10163 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:00.911561 10468 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.905048 10338 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:00.975045  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2248882120002236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:22:01.003247  8035 connection.cc:256] RPC call timeout handler was delayed by -1.1717882120001377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:22:00.978287  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.979080  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.005506  8140 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:00.913337 10474 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:00.992159  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:01.004089  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:01.008114  8035 connection.cc:256] RPC call timeout handler was delayed by -1.060290933000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 12:22:00.975564  8061 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:01.014955  8146 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:01.022554  8110 leader_election.cc:400] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:01.023881  8110 leader_election.cc:403] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:01.020871  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 139525us
I20260709 12:22:00.990177 10162 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:01.039462  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:01.043898  8146 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:01.051900  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.053414  8142 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:01.069141  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:01.072443  8066 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.073482  8063 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:01.073117 10370 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.071897 10213 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.047395 10341 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.081746 10341 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.082504 10213 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:01.028123 10248 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.084973 10469 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.085654 10336 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:01.061195 10479 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.033684 10473 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:00.995451 10382 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.090159  8066 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:01.090953 10382 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.003507 10212 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.046517 10102 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:01.099272 10212 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.099190 10102 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.105906 10483 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:00.974846 10281 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.084372 10248 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.111464 10434 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.113070 10248 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:01.106873  8731 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.753s (SENT) [suppressed 32 similar messages]
I20260709 12:22:01.116744 10338 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.119390  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:01.106879 10483 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:01.120249  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
W20260709 12:22:01.127774  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.043458 10162 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:01.143637  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:01.145459  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.147446  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:01.148200  8069 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.141993 10469 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.151553  8760 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:01.153427  8764 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:01.157087  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:01.159410  8138 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:01.163110  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:01.163735  8765 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:22:01.167599  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1250) took 1243 ms. Trace:
I20260709 12:22:01.168188  8219 rpcz_store.cc:276] 0709 12:21:59.934109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.940299 (+  6190us) service_pool.cc:224] Handling call
0709 12:22:01.167364 (+1227065us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000e6354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.167530 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236326272}
W20260709 12:22:01.169741  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 374) took 1246 ms (client timeout 1526 ms). Trace:
W20260709 12:22:01.170176  8143 rpcz_store.cc:269] 0709 12:21:59.923501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.931510 (+  8009us) service_pool.cc:224] Handling call
0709 12:22:01.169526 (+1238016us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54001c34d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.169681 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318283136}
I20260709 12:22:01.170735  8145 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:01.171207  8145 pending_rounds.cc:85] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 4
I20260709 12:22:01.171468  8145 pending_rounds.cc:107] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:01.171744  8145 raft_consensus.cc:2889] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.118913 10292 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.174896  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:01.182734  8146 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:01.184589  8760 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:01.186506 10468 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:01.208863  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.210048  8218 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:01.151296 10469 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.208120  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:01.214995  8764 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.227861  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:01.229421  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 207092us
I20260709 12:22:01.230571  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.211376 10468 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.247875  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:01.248569  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.248890  8765 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
W20260709 12:22:01.251240  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53550.3us
I20260709 12:22:01.253122 10257 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:01.261253  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 235107us
I20260709 12:22:01.266458  8764 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:01.211174  8219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:01.252791 10434 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.268236  8219 raft_consensus.cc:606] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.246114 10484 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:01.273361  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:01.274284  8760 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:01.269366  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.264853  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.271266  8219 raft_consensus.cc:614] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:01.218552 10162 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.280663  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:01.282248  8764 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.282914  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.284562  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.258467 10163 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.290676 10490 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:01.271327 10257 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.300104 10257 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.302445 10257 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:01.305516 10162 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.309044  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 372) took 1436 ms. Trace:
I20260709 12:22:01.308857 10163 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.309587  8145 rpcz_store.cc:276] 0709 12:21:59.872394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.214077 (+341683us) service_pool.cc:224] Handling call
0709 12:22:01.170265 (+956188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.172451 (+  2186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.308817 (+136366us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54001c34d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.308958 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197033344}
W20260709 12:22:01.313446 10481 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:01.279598 10434 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.318624 10434 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.305469 10349 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.279364 10486 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.337025  8764 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:01.312350 10163 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.339529  8760 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:22:01.340077  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 233240us
W20260709 12:22:01.340494  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57729.5us
W20260709 12:22:01.351471  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 67211.8us
I20260709 12:22:01.352571  8069 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:01.337353 10114 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.319257 10488 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.354941  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.338781 10341 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.356045 10475 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:01.366700  8761 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:01.342165 10490 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.368441 10279 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:01.288978 10468 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.358450  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:01.378206  8760 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.383912  8218 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:01.388100 10484 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.389010 10484 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.389449 10349 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:01.389884 10484 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:01.341872 10486 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.393009 10486 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.394222  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.395753  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:01.396888  8764 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:22:01.396360  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 104602us
I20260709 12:22:01.406904  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:01.408810  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.377385 10469 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:01.423969  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45151us
I20260709 12:22:01.428251  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.438040  8760 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:01.433910  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:01.398492 10025 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.405005 10486 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:01.420884 10292 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.426750 10239 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:01.474115  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.424777 10488 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.476306  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:01.423038 10484 consensus_queue.cc:1243] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:01.477902  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:01.479715  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.480970  8146 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:01.475756  8145 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:01.490432  8142 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:01.427822 10341 raft_consensus.cc:2764] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:01.463980 10469 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.490682  8145 pending_rounds.cc:85] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 4
I20260709 12:22:01.503408  8145 pending_rounds.cc:107] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:01.503729  8145 raft_consensus.cc:2889] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.497715  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.504796  8143 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:22:01.506932  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81986.5us
I20260709 12:22:01.507493 10504 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:01.507508  8756 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:01.508482 10469 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:01.509174 10469 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.509444 10433 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:01.509871 10433 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:01.510000 10469 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.510768 10433 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.511459 10469 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.512070 10433 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:01.508581  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:01.525152 10484 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:01.525660 10484 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:01.526069 10484 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:01.534520  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45147.5us
I20260709 12:22:01.536139  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:01.537446  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.538160  8143 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:22:01.551785  8146 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:01.480796 10489 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.394634 10490 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.668772  8143 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 12:22:01.668480  8139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 371) took 1838 ms (client timeout 1753 ms). Trace:
I20260709 12:22:01.549032  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.624256  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:01.553258  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:01.552394  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.623027  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:01.673808  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 121580us
I20260709 12:22:01.670110  8143 pending_rounds.cc:85] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:22:01.674494  8143 pending_rounds.cc:107] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:22:01.674615  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:01.670269  8139 rpcz_store.cc:269] 0709 12:21:59.830200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.837985 (+  7785us) service_pool.cc:224] Handling call
0709 12:22:01.668212 (+1830227us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400352354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.668404 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856181504}
W20260709 12:22:01.672536  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118630us
I20260709 12:22:01.674783  8143 raft_consensus.cc:2889] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.675523  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:01.623836  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 115324us
I20260709 12:22:01.646776  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.624607  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:01.676937  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 127957us
W20260709 12:22:01.648782 10234 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.003s
I20260709 12:22:01.681227  8137 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:01.681494  8145 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:01.591893 10370 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:22:01.683024  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.537508 10434 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.166s
I20260709 12:22:01.707720  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2499) took 1069 ms. Trace:
I20260709 12:22:01.716747  8212 rpcz_store.cc:276] 0709 12:22:00.637928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.638064 (+   136us) service_pool.cc:224] Handling call
0709 12:22:01.707172 (+1069108us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002a5dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.707648 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397905664}
W20260709 12:22:01.702083  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 321) took 1949 ms (client timeout 2144 ms). Trace:
I20260709 12:22:01.603154 10239 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.591583 10475 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.623401 10316 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.725077  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.762203  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.763145  8218 raft_consensus.cc:2410] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:01.767493  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.768689  8214 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:01.769537  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.678524 10469 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.680759 10419 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:01.727008  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.726819 10244 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:22:01.732036 10337 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.733258  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.690627 10500 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:01.689132 10488 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.737468  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:01.724171  8759 rpcz_store.cc:269] 0709 12:21:59.752201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.752611 (+   410us) service_pool.cc:224] Handling call
0709 12:22:01.683280 (+1930669us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.701993 (+ 18713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507394304}
I20260709 12:22:01.675755 10279 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:01.792490 10279 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:01.792999 10279 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:01.793526 10468 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:01.799361  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.721614 10234 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.804736 10336 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.805589  8213 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:01.805490 10336 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.806337 10234 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.807605 10336 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:01.807735  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.790414  8220 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:01.804872 10316 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:01.810046  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76885.5us
W20260709 12:22:01.810509  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:01.816279  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.815765  8215 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:22:01.704399 10489 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:01.785169  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 86163.7us
I20260709 12:22:01.819145  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.829227  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2495) took 1212 ms. Trace:
I20260709 12:22:01.824960  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.829686  8215 rpcz_store.cc:276] 0709 12:22:00.616445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.616561 (+   116us) service_pool.cc:224] Handling call
0709 12:22:01.829059 (+1212498us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002b4154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:01.829168 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672346880}
I20260709 12:22:01.832010  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:01.816082  8220 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:22:01.833177  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.837625  8142 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:01.842550  8216 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:01.787811 10419 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:01.847090  8220 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:22:01.847645  8220 pending_rounds.cc:85] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 3
I20260709 12:22:01.847980  8220 pending_rounds.cc:107] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:22:01.848325  8220 raft_consensus.cc:2889] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.851625  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.761439 10239 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.855782  8216 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:01.818840 10077 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.816707  9903 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.861636  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.831339 10500 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.866936  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.867739 10249 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.869741 10489 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.873358  8142 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:01.878082  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:01.873999  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:01.857069 10316 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:01.879596  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 139363us
I20260709 12:22:01.879721  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.884455  8139 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:01.845585 10419 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.827539 10488 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.898438  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.885944  8730 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:01.871665 10337 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:01.844260 10364 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:01.902171  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.907068  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.903513  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.904009  8215 raft_consensus.cc:606] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.907961  8215 raft_consensus.cc:614] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:01.908208  8216 raft_consensus.cc:2368] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:01.822625 10475 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.879021 10338 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.914395  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:01.920037  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47532us
I20260709 12:22:01.920125  8216 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:22:01.897020  9903 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.907799  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:01.915501  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.876111 10077 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.881357 10292 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.921187  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:01.880935 10490 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.872028 10484 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.921691  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:01.922489  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:01.930346  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63503.7us
I20260709 12:22:01.943154  8217 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:01.944200  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.944356  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:01.944828  8217 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
W20260709 12:22:01.943205  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.905613 10012 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.860217 10279 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.946735  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:01.955017  8110 leader_election.cc:400] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:01.955672 10012 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.956229  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.909554 10370 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:22:01.913942 10249 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:01.952450  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.908751 10337 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:01.956141 10012 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.909442 10339 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:22:01.958710 10500 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:01.961457 10482 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.848s	user 0.002s	sys 0.007s
I20260709 12:22:01.969384  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:01.969553  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.958700  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:01.969738  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:01.977792  8139 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:01.968351 10120 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.968802 10249 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.958390 10162 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:01.986291 10249 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:01.986431 10162 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.987275 10239 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:01.959348 10489 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:01.932935 10338 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.988768 10162 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.990898 10338 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.992816 10498 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:01.973757 10234 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:01.995424 10234 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:01.995875 10234 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:01.949620 10292 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.998273 10336 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:01.998834 10336 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:01.998910 10292 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:01.999305  8110 leader_election.cc:400] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:01.999755  8110 leader_election.cc:403] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:01.999889 10336 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.001741 10468 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:02.002689 10489 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:02.003676 10489 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:01.945618  9903 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.005152 10484 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.006122  9903 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.008113  8142 raft_consensus.cc:2376] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8. Re-sending same reply.
I20260709 12:22:02.009495  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.946943  8214 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:02.010617  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.008302  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.009196  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:02.013214  8216 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:02.014521  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.015754  8139 raft_consensus.cc:2410] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:02.013844  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:02.017463  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 137798us
I20260709 12:22:02.018482  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.019246  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.021339  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.022117  8217 raft_consensus.cc:2376] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4. Re-sending same reply.
I20260709 12:22:02.024062  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.024907  8139 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
W20260709 12:22:02.025018  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.026029  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.008888 10163 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:02.032517  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.033563  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:01.977814 10488 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.034233  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.043555  8216 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:02.044186  8215 raft_consensus.cc:2376] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5. Re-sending same reply.
I20260709 12:22:02.022192 10120 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:02.034014  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:02.027565  9903 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:02.038640  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 153030us
I20260709 12:22:02.033663  8139 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:02.027393 10484 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:02.068105  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.026875 10498 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:02.029749 10292 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:02.072448  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.029685 10339 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.042964 10163 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:02.081185  8139 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:02.084745  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.029635 10503 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:02.068979  9903 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.067827 10120 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:02.096730  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.098315  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:02.070102 10498 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.045032  9735 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:02.102466  8215 raft_consensus.cc:606] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.105187  8215 raft_consensus.cc:614] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:02.069712 10484 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:02.072053 10488 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:02.065375 10430 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:22:02.088310 10163 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:02.102319  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 200241us
I20260709 12:22:02.089766 10162 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:02.042028 10234 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.103689 10120 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:02.134189  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64277.8us
I20260709 12:22:02.106127  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.101464  9903 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:02.102537 10338 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:22:02.088814 10339 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.112759 10498 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:02.108443 10503 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.140246 10475 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:02.145089 10234 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.168282 10430 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:02.198545  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.120788  9735 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.137120 10012 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.189519  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1311) took 2033 ms. Trace:
I20260709 12:22:02.140303 10292 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:02.190505  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.125578 10513 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:22:02.111008 10488 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.126370 10370 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.190510  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.207934  8762 raft_consensus.cc:2376] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7. Re-sending same reply.
I20260709 12:22:02.210775 10281 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:02.211416 10512 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:22:02.213200  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.214133  8145 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:02.214874  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.194417  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.196537  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.110777 10484 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:02.189042 10341 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:02.196647 10335 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:02.201802  8144 rpcz_store.cc:276] 0709 12:22:00.156838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.279012 (+122174us) service_pool.cc:224] Handling call
0709 12:22:00.284273 (+  5261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.295765 (+ 11492us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:00.942326 (+646561us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b18002877a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:00.942673 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.220708 (+278035us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.221345 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.221524 (+   179us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:01.221573 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.221670 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.886473 (+664803us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:02.189218 (+302745us) raft_consensus.cc:1685] finished
0709 12:22:02.189252 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.189438 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3938,"prepare.queue_time_us":656429,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":116316,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":2697,"spinlock_wait_cycles":55460352,"thread_start_us":276357,"threads_started":2,"wal-append.queue_time_us":105355}
I20260709 12:22:02.196727  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.221994  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.202937  8763 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:02.197633 10337 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.198418 10430 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:02.201596  9735 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.230872  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:02.232511  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 92194.6us
I20260709 12:22:02.225229  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.198271 10503 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.254133  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.217962  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.236667  8144 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:02.257169  8756 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:02.258026  8761 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:02.258143  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.258786  8144 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:02.259320  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:02.237783  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.237121 10335 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:02.241911 10478 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.141s	user 0.005s	sys 0.003s
I20260709 12:22:02.243834 10120 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.263196 10498 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.264339 10335 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.266155  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:02.266742 10503 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.266995 10433 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.267931 10337 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:02.268177 10433 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:02.268328 10337 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.272019 10337 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.222776 10523 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:22:02.245101 10430 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.246738 10339 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.218573 10292 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.220296 10279 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.219302 10349 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:02.229573 10526 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:02.248483 10519 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:02.230216 10370 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.207356 10488 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.250300 10419 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.201033 10475 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.268642 10433 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:02.302127 10430 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:02.302910 10433 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.303675 10475 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.304081 10433 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:02.245190  8757 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:02.307066  8146 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:02.307664 10497 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.795s	user 0.000s	sys 0.007s
I20260709 12:22:02.309428  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 320) took 1144 ms. Trace:
I20260709 12:22:02.265285 10120 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.318030  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:02.270218 10163 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.271521 10498 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.276717  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:02.283684  8218 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:02.282770  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:02.285218  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.216573 10077 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.283809 10341 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:02.248113  9903 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.285090  8765 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.296191  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.284725 10335 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.309785  8211 rpcz_store.cc:276] 0709 12:22:01.164851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.164996 (+   145us) service_pool.cc:224] Handling call
0709 12:22:01.187184 (+ 22188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.187570 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.187605 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.188162 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.357291 (+169129us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:01.357356 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.357479 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.307091 (+949612us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:02.309150 (+  2059us) raft_consensus.cc:1685] finished
0709 12:22:02.309172 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.309367 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12862,"raft.queue_time_us":1769,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":18558,"spinlock_wait_cycles":180711808,"thread_start_us":168325,"threads_started":1,"wal-append.queue_time_us":282899}
I20260709 12:22:02.290022 10503 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.293553 10349 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:02.333854  8146 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:02.337105  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51969.1us
I20260709 12:22:02.289060 10473 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:22:02.344167  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 104471us
W20260709 12:22:02.346690  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 109464us
I20260709 12:22:02.347038 10534 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:02.349291  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.294714 10287 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:02.366946  8763 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:02.349798  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:02.367684  8214 raft_consensus.cc:606] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:02.368039  8214 raft_consensus.cc:614] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:02.368297  8138 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:02.353931  8218 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:02.370388  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.364957  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:02.329624 10475 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:02.329440  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.382114  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.329077 10163 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.344957 10514 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.390743  8070 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:02.387023  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.388054  8218 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:02.389397  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.343631 10341 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.393474  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:02.347826 10534 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.393896  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:02.395745  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.401099  8761 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:02.404059  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.410590  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.411520  8065 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:02.412423  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.413193  8065 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:02.405419  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.399219  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.406985  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.368049 10287 consensus_queue.cc:1243] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:22:02.408663  8034 connection.cc:256] RPC call timeout handler was delayed by -1.0984417550002945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:22:02.420588  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.415766  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.434789  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.435431  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.438524  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.439620  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:02.440976  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.349556 10352 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:22:02.394153 10515 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:02.449261  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:02.449822  8214 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:02.449683  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.398768  8756 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:02.373760 10012 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:22:02.448982  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.364375 10162 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:22:02.399364 10239 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.463682  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.433817 10503 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.368194 10249 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.453413  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.348740 10335 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.455008  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:02.455127  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:02.349673 10530 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 12:22:02.447763 10077 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:02.479076 10521 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:22:02.463910  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.476229  8138 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:02.479962  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.434403 10279 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:02.484400  8214 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:02.451365  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.414847 10341 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.494916 10341 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.464814 10473 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.444976 10163 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:02.461858 10515 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:02.497613  8069 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:02.497798  8067 raft_consensus.cc:2410] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:02.452251 10338 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:22:02.501317  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:02.399513 10514 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.509464 10545 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:02.509969  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.521665  8212 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:02.522114  8212 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
I20260709 12:22:02.522174  8065 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:02.515364 10526 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.473095  9735 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.528785  9735 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.529156  8070 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:22:02.496006 10473 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.461194 10533 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:22:02.477020 10239 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.484717 10503 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.522437  8212 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 12:22:02.533295 10532 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:22:02.571898 10484 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.576525 10484 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.582723 10534 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:02.574324 10535 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:22:02.587853 10515 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.590134 10473 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.593176  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.530475 10370 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:02.595645 10249 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.598555 10337 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.606109  9903 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.608692 10335 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:02.611101 10529 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:22:02.615993  8756 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:02.533082  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.533514  8064 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:02.627526  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:02.570097  8212 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:02.638232  8218 raft_consensus.cc:606] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.638716  8218 raft_consensus.cc:614] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:02.642222  8218 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:02.643373  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 235001us
I20260709 12:22:02.649789  8062 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:02.652519  8729 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.651635  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:02.533243 10419 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.672206  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:02.628422 10514 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.675688  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.678022  7967 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 2 to 3, term changed from 1 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to <none>, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:02.682313  7967 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:02.684526  8067 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:02.689424  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.673115 10516 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:02.694161  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:02.691021  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 236393us
I20260709 12:22:02.693485  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.708277  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.698531  8765 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:02.698832  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.711230  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.690726 10514 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.712011  7967 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:02.715056  7967 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 3, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:02.694427 10337 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.711603 10249 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.716821  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.717615  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.717918 10120 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:02.719031 10542 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:02.724123  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 385) took 1179 ms. Trace:
W20260709 12:22:02.746716 10546 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:02.697074 10550 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:02.748898  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:02.749333 10550 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.751546  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.751683 10550 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.746814  8143 rpcz_store.cc:276] 0709 12:22:01.545088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.545249 (+   161us) service_pool.cc:224] Handling call
0709 12:22:01.668356 (+123107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:01.680920 (+ 12564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.723936 (+1043016us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400352350. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:02.724065 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282304256}
I20260709 12:22:02.754855  8139 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:02.756119  8068 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:02.758414  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:02.760373  8066 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:02.726413  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.730402  7967 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:02.710115 10516 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:02.737629  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:02.742237 10278 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:02.767568  8067 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:02.743443 10120 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:02.770411 10430 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:02.696400 10528 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:22:02.736579 10315 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:02.774787 10553 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:02.776685 10337 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:02.782610 10102 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.788546 10239 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:02.789515 10503 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.790587 10488 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.791990  8213 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:02.747577 10249 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.794018  8061 raft_consensus.cc:2376] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5. Re-sending same reply.
I20260709 12:22:02.722267 10514 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.768962  7967 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.771384  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1331) took 1052 ms. Trace:
W20260709 12:22:02.748350 10552 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:02.770954 10430 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.747313 10349 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:02.801677  8217 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:02.931322  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:02.993707  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:02.994506  8144 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:02.996167  8143 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:02.996984  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 270670us
I20260709 12:22:02.998562  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:02.818598  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:02.828040  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.795255 10249 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:03.000317  8142 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:03.000803 10339 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:03.001157  8138 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:03.002215  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.003152 10349 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.005172 10212 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.006105 10364 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:03.008484 10120 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:02.843521 10124 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 12:22:02.842336 10533 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.167s
I20260709 12:22:02.757404 10163 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:02.736696 10487 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:03.014112  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.864678 10239 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.023489  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:03.023269  7967 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.025758  8144 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:02.797926 10494 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.418s	user 0.003s	sys 0.006s
I20260709 12:22:03.028111  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:03.033169  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:02.994902  8137 rpcz_store.cc:276] 0709 12:22:01.718814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.719058 (+   244us) service_pool.cc:224] Handling call
0709 12:22:01.724344 (+  5286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.966931 (+242587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.966976 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.967585 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.071382 (+103797us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:02.123324 (+ 51942us) log.cc:844] Serialized 14 byte log entry
0709 12:22:02.124341 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.760296 (+635955us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54002f1f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:02.760334 (+    38us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.760387 (+    53us) raft_consensus.cc:1685] finished
0709 12:22:02.771184 (+ 10797us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.771324 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13730,"prepare.queue_time_us":121858,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":5082,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":9180,"spinlock_wait_cycles":556880128,"thread_start_us":129034,"threads_started":2,"wal-append.queue_time_us":159127}
I20260709 12:22:03.031095  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:03.058418  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.029130 10488 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:02.807953  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:03.026520 10278 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:03.027292 10486 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.022472 10339 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:03.047605  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:03.051908  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.034363 10503 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.075245  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.042953 10163 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:03.044571 10281 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.070499  8142 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:03.047509 10515 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.110350  8137 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:03.079015  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.112915  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:03.114535  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.115321  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.072423 10339 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.063612  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.076766  8145 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:03.052927 10257 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.079612  8143 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:03.080986  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:03.120575  8063 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:03.121897  8068 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.083002  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:02.806401 10516 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:03.087028  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.058936  7967 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 5 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.087914  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:03.038811 10212 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.038637 10364 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.070114 10557 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:03.050278 10487 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.077880 10162 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.064898 10279 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.069950 10278 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.098042 10430 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:03.099068 10553 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.099490  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.166280  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:03.084578  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.053503 10239 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.118350 10124 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:03.154235  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.147123  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.156332  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.149883  7967 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:03.074818 10503 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:03.167846  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68450us
I20260709 12:22:03.123137  8762 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.173754  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.173576  7967 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:22:03.168460  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 102196us
I20260709 12:22:03.174628  8218 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.175344  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.175920  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:03.177520  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.178133  8212 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:03.179351  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.179603  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.180023  8212 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:03.180217  8216 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:03.182029  8758 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:03.126066 10540 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.159987 10534 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:03.187114  8139 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:03.197453  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:03.167315 10102 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.214309  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:03.203008 10503 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:03.203204 10278 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:03.204290  8213 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:22:03.207051 10502 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.678s	user 0.002s	sys 0.016s
I20260709 12:22:03.209309  8068 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:03.124146 10515 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.217854  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.172343 10337 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:03.172098 10430 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.182931 10554 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.183331 10523 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.188025  8759 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:03.185460 10352 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.228257  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:03.187187 10540 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.223660  8143 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:03.166981 10533 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:03.167575 10279 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.248754  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:03.252861  8143 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:03.253142  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.254010  8068 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:03.185119 10249 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:22:03.255283  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:03.260044  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.224995 10430 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.192619 10528 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:22:03.263373  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78615.2us
I20260709 12:22:03.267314  8143 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:03.276191  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:03.231134 10442 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.245208 10344 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:03.291685 10344 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.295985 10344 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:03.297336 10570 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:03.186954 10163 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.301460 10212 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.251297 10556 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.305263 10556 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:22:03.307720 10556 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.309249 10279 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.272023 10430 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.311008  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 321) took 1942 ms. Trace:
I20260709 12:22:03.311486  8219 rpcz_store.cc:276] 0709 12:22:01.369034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.369208 (+   174us) service_pool.cc:224] Handling call
0709 12:22:01.370599 (+  1391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.371004 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.371035 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.371602 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.481820 (+110218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:01.481871 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.481946 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.206506 (+1724560us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:03.310638 (+104132us) raft_consensus.cc:1685] finished
0709 12:22:03.310662 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.310951 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1286,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":21034368,"thread_start_us":109517,"threads_started":1,"wal-append.queue_time_us":156988}
I20260709 12:22:03.312583 10487 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:03.313570 10559 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:22:03.251646 10540 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.275874 10514 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:03.225131 10102 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.321971  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:03.322844  8143 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:03.326237  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:03.326911  8062 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:03.327214  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:03.327793  8143 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:03.286451 10162 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:03.335017  8762 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:03.364535  8143 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:03.367705  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.366194  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:03.373212  8143 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.296582 10344 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:03.289299 10442 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.365424 10534 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:03.384197  8062 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
W20260709 12:22:03.385515  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 162908us
I20260709 12:22:03.393539  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.395008  8062 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:22:03.357121 10162 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.378417  8758 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:03.385416 10364 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:03.377854 10530 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:22:03.387166 10515 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.404198  8062 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:03.438776  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.393738 10486 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:03.445992  8143 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:03.450812 10573 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:22:03.421157 10102 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.422794 10442 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.396529 10582 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:22:03.403743 10344 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.454070  8144 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:03.456207 10344 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:03.457010  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89400us
W20260709 12:22:03.409927 10571 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:22:03.458868  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.462826  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.463470  8217 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:03.463536  8220 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:22:03.425078 10345 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.465021 10345 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.467206 10345 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.424652 10162 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:03.469138 10442 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:03.469817 10442 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:03.470842 10442 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.417207 10579 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:03.473064 10579 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.475605 10579 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:03.415688 10114 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:22:03.412110 10577 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:22:03.488410  8220 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:03.489606  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.490048  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.490783  8220 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:03.493429  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.493510  8765 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:03.493497  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:03.495829  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 416869us
I20260709 12:22:03.496016  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.496613  8763 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:03.498346  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.499923  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.499845  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.501097  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.501966  8217 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:03.505496  8212 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:03.444988 10430 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.510228  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.511066  8763 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:03.511106 10430 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:03.445894 10124 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:03.518893  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.522184  8216 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:03.523675  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:03.529457  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:03.530664  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:03.531915  8214 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:03.533864  8765 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:03.535269  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:03.537688  8762 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:03.538978  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:03.539469  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.543557  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:03.543648  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.544302  8757 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:03.548520  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.550766  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:03.551473  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.552445  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:03.553965  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:03.557096  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.518457 10102 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:03.560771  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:03.567164  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:03.569962  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:03.432703 10534 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.538398 10582 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.543283 10469 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:03.499810 10530 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:22:03.600118  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.597177 10513 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.556711 10257 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:03.568717 10556 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:03.554991 10579 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:03.555270 10349 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:03.564831 10514 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.542574 10509 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:03.570207  8759 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:03.559221 10345 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.559428 10486 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:03.565160 10484 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:03.555339 10434 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.576997 10533 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:03.542737 10114 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:22:03.652449  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 83115us
W20260709 12:22:03.661577  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.662693  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 93029.9us
I20260709 12:22:03.661706  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:03.600772 10587 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:03.665100  8146 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:03.601481 10590 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:03.665982 10590 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.666344 10590 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:03.667737  8146 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:22:03.665333 10587 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.600418 10577 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:22:03.633812 10257 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:03.668967  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.633419 10528 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:03.671878  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.601642 10523 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:22:03.653350 10345 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.671795 10587 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:03.688879  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.693097  8065 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:03.649888 10556 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:03.601486 10580 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 12:22:03.696705  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 136024us
I20260709 12:22:03.662222 10533 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.699540  8065 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:03.599294 10582 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.669981 10486 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:03.675168 10257 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:03.601512 10513 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.648597 10349 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.696923 10345 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.633225 10124 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.660343 10484 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.703322 10533 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:03.699717 10580 consensus_queue.cc:1243] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:03.732072  8219 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:03.736685 10527 raft_consensus.cc:2764] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:22:03.738838 10591 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:03.740903 10524 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:03.696445 10577 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:03.757349 10590 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:03.703868 10434 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 12:22:03.955648  8070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1410) took 1544 ms (client timeout 1885 ms). Trace:
W20260709 12:22:04.184343  8218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.001s	sys 0.024s
I20260709 12:22:03.956022  8067 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:04.358099  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2475) took 1600 ms (client timeout 1648 ms). Trace:
W20260709 12:22:04.301610  8218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.001s	sys 0.037s
I20260709 12:22:04.358460  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1393) took 1970 ms. Trace:
I20260709 12:22:04.352662  8064 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:04.362799  8069 rpcz_store.cc:276] 0709 12:22:02.387745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.387881 (+   136us) service_pool.cc:224] Handling call
0709 12:22:02.388179 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.502314 (+114135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.358190 (+1855876us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003953d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:04.358384 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251184000}
W20260709 12:22:04.363523  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 618447us
W20260709 12:22:04.363781  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 615302us
W20260709 12:22:04.362210  8061 rpcz_store.cc:269] 0709 12:22:02.757927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.758181 (+   254us) service_pool.cc:224] Handling call
0709 12:22:04.357836 (+1599655us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:04.358020 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80458624}
W20260709 12:22:03.881507  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 212154us
I20260709 12:22:04.368484  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:04.245935  8070 rpcz_store.cc:269] 0709 12:22:02.411396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.451844 (+ 40448us) service_pool.cc:224] Handling call
0709 12:22:03.955404 (+1503560us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54000fcdd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:03.955576 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130711936}
W20260709 12:22:04.113003  8141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.013s
W20260709 12:22:03.982239  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 281699us
I20260709 12:22:03.990605  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1269) took 1636 ms. Trace:
W20260709 12:22:04.246416  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 584735us
W20260709 12:22:04.193665  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.014s	sys 0.025s
I20260709 12:22:04.371062  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:04.301141  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 310) took 1295 ms. Trace:
W20260709 12:22:04.371451  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.026s	sys 0.037s
I20260709 12:22:04.370687  8211 rpcz_store.cc:276] 0709 12:22:02.354319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.434015 (+ 79696us) service_pool.cc:224] Handling call
0709 12:22:03.990329 (+1556314us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b54002b4b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:03.990510 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39534848}
W20260709 12:22:04.369807  8141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.005s	sys 0.021s
I20260709 12:22:04.371950  8066 rpcz_store.cc:276] 0709 12:22:03.006118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.006262 (+   144us) service_pool.cc:224] Handling call
0709 12:22:03.006539 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.029999 (+ 23460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.030028 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:03.030065 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:03.030095 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.300771 (+1270676us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54003214d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:04.300832 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.301074 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53550848}
I20260709 12:22:03.717959 10544 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.807s
W20260709 12:22:03.906744 10540 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.002s
I20260709 12:22:04.109108 10549 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.385707  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.386024 10549 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.386423  8069 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:04.387382  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.388211 10549 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.389906  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:03.956490 10336 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.374303  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.392339  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.844262 10239 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.375480  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1354) took 1163 ms. Trace:
W20260709 12:22:04.376305  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.732254 10586 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:03.725944 10595 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:04.300534 10124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.021s
I20260709 12:22:04.399791  8141 rpcz_store.cc:276] 0709 12:22:03.211865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.219901 (+  8036us) service_pool.cc:224] Handling call
0709 12:22:03.246908 (+ 27007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.247374 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:03.272717 (+ 25343us) log.cc:844] Serialized 14 byte log entry
0709 12:22:03.983294 (+710577us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4800011058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:04.375046 (+391752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:04.375130 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:04.375208 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.375295 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.375420 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269889,"prepare.queue_time_us":27087,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":276951,"raft.run_cpu_time_us":2685,"raft.run_wall_time_us":428556,"spinlock_wait_cycles":7722880,"thread_start_us":832028,"threads_started":1}
I20260709 12:22:04.363760 10598 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:03.847185 10553 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:04.385044 10540 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:03.940335 10593 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 12:22:04.388423  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:03.993409 10349 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.402469  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:04.377974  8061 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:04.404640  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:04.447052  8220 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:04.405638  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.417490 10474 raft_consensus.cc:2764] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:04.448025  8063 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:04.407588  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.079367 10442 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.406658  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:04.414734  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43779.1us
I20260709 12:22:04.449448  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:04.449173  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.450876  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.451370  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:04.302127 10513 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.449120  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:04.451942  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.369416 10484 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:03.956723 10120 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:04.415858  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.419152 10603 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:04.360427 10587 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.004s
I20260709 12:22:03.763420 10582 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:04.458246  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55902.3us
I20260709 12:22:04.419454  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:04.422242  8062 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:04.391395 10530 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.399574 10524 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.418135 10595 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.459515 10442 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.472469 10524 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.473948 10595 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.406553 10586 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:04.474330  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1263) took 1385 ms. Trace:
I20260709 12:22:04.474643 10586 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.456699 10349 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:04.475788 10349 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.476212 10349 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:04.474756  8142 rpcz_store.cc:276] 0709 12:22:03.088870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.107604 (+ 18734us) service_pool.cc:224] Handling call
0709 12:22:03.108383 (+   779us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:03.495330 (+386947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.495358 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:03.517507 (+ 22149us) log.cc:844] Serialized 52 byte log entry
0709 12:22:03.851542 (+334035us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18002fd220. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:04.321941 (+470399us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:04.322008 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.322118 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.474054 (+151936us) raft_consensus.cc:1685] finished
0709 12:22:04.474075 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.474273 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801068,"raft.queue_time_us":389537,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":437947,"spinlock_wait_cycles":3434880,"thread_start_us":470072,"threads_started":1,"wal-append.queue_time_us":912170}
I20260709 12:22:04.420778 10553 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:04.478864 10533 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.626s	user 0.002s	sys 0.007s
I20260709 12:22:04.479296 10533 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.410153 10487 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:04.480311 10487 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.480950  8142 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:04.228219 10345 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.448320  8139 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:22:04.452518  8143 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:04.453217  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:04.455125  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:03.732167 10555 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.885s
I20260709 12:22:03.769326 10486 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.431569 10124 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.773075 10556 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:03.956918 10475 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.444s
I20260709 12:22:04.404870 10336 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.446688 10577 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:04.470566  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1264) took 1372 ms. Trace:
I20260709 12:22:04.464280  8213 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:04.471155 10590 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.470974 10587 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.471527 10530 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.478312 10553 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:04.419802 10257 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
I20260709 12:22:04.415612 10544 consensus_queue.cc:1243] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:04.491797 10595 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:04.492228 10487 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.494663  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:04.484297  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:04.466266 10239 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:04.458630 10490 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:04.457742 10608 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:04.474676 10524 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.474897 10442 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.503441  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:04.517423 10337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.020s	sys 0.021s
I20260709 12:22:04.500308  8137 rpcz_store.cc:276] 0709 12:22:03.098642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.155246 (+ 56604us) service_pool.cc:224] Handling call
0709 12:22:03.178729 (+ 23483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:03.519697 (+340968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.519728 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:03.545998 (+ 26270us) log.cc:844] Serialized 52 byte log entry
0709 12:22:03.872959 (+326961us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:03.873027 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.873137 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.470350 (+597213us) raft_consensus.cc:1685] finished
0709 12:22:04.470370 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.470498 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":720943,"raft.queue_time_us":359650,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":413756,"thread_start_us":258334,"threads_started":1,"wal-append.queue_time_us":870717}
I20260709 12:22:04.519778  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 391) took 1493 ms. Trace:
I20260709 12:22:04.676016 10608 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.500258 10603 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:04.562604  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68018.3us
I20260709 12:22:04.542837 10257 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:04.583088  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98854.4us
I20260709 12:22:04.730621  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:04.516314 10577 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.657722 10544 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 12:22:04.646631  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 117292us
W20260709 12:22:04.500864 10287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.020s	sys 0.053s
I20260709 12:22:04.492435 10605 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:22:04.510072 10484 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.509889 10503 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.493623 10549 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:22:04.494297 10527 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:22:04.656766  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:04.746220  8142 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:04.563406  8759 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:22:04.496266 10244 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:04.423686 10598 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:04.736833 10287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.030s	sys 0.066s
I20260709 12:22:04.750192  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:04.492261 10602 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.169s
W20260709 12:22:04.690945  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 695) took 2523 ms (client timeout 2052 ms). Trace:
I20260709 12:22:04.649595 10239 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.497725 10586 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.562760 10595 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.649869 10490 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.542013 10474 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.498739 10124 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.660785 10590 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:04.659368 10434 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.663050 10487 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:04.694195 10553 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:04.541553 10576 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.160s
I20260709 12:22:04.497956 10120 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.719772  8138 rpcz_store.cc:276] 0709 12:22:03.026715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.026839 (+   124us) service_pool.cc:224] Handling call
0709 12:22:03.027230 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:03.483283 (+456053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.483319 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:03.483992 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 12:22:03.543235 (+ 59243us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:03.543303 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.543424 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.519576 (+976152us) raft_consensus.cc:1685] finished
0709 12:22:04.519594 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.519722 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":902540,"raft.queue_time_us":464339,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":457311,"thread_start_us":58257,"threads_started":1,"wal-append.queue_time_us":166070}
I20260709 12:22:04.727962  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:04.566448  8066 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:04.740038  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:04.719234 10337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.024s	sys 0.023s
I20260709 12:22:04.742200  8763 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 12:22:04.729454 10603 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.827024 10603 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:04.741869 10524 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.790498 10590 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.744385 10580 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.764366  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:04.836488  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:04.755649 10527 consensus_queue.cc:1243] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:04.751524 10442 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.790715  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:04.750522 10613 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:04.733192 10608 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.772701 10239 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:04.772221 10533 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.768175 10102 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.747275 10484 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.748265 10503 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.777904 10595 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:04.786507 10474 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.833928 10617 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:04.930457 10474 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.930392 10617 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.931056 10474 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:04.931706 10474 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:04.932022 10474 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.751806 10513 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:22:04.778100 10490 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:04.754529  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:04.784863 10475 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.933889  8215 raft_consensus.cc:2376] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4. Re-sending same reply.
I20260709 12:22:04.812474 10487 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.827128 10577 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.792894 10345 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
W20260709 12:22:04.814354  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 175273us
W20260709 12:22:04.842077  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.818557 10434 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.822484 10544 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.904001  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:04.954734  8146 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:04.921751 10613 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.955900 10613 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.940894 10442 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.843727 10244 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:04.962347 10244 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:04.963528 10442 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.839349 10549 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:04.964695 10549 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:04.965919 10549 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.967497 10549 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.830260 10336 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:04.909950 10607 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:22:04.828598 10120 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.972848 10120 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:04.973649  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1284) took 1479 ms. Trace:
I20260709 12:22:04.975301  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:04.974196  8218 rpcz_store.cc:276] 0709 12:22:03.493773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.494021 (+   248us) service_pool.cc:224] Handling call
0709 12:22:03.494339 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:03.499424 (+  5085us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:03.535244 (+ 35820us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.362746 (+827502us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.363886 (+  1140us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.364619 (+   733us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:04.364854 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.365315 (+   461us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.973401 (+608086us) raft_consensus.cc:1685] finished
0709 12:22:04.973421 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.973569 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26914,"prepare.queue_time_us":35617,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":5226,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":9734,"thread_start_us":795346,"threads_started":1,"wal-append.queue_time_us":969789}
I20260709 12:22:04.913987 10527 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.976467  8146 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:04.976959 10527 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:04.978142  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 250284us
I20260709 12:22:04.978406  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.978917  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:04.979157 10527 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.979627  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.980212  8070 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:04.926671 10503 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.980919 10503 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:22:04.981146  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 241215us
I20260709 12:22:04.981775 10503 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:04.982270 10631 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:04.983165 10631 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:04.935483  8142 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:04.937740  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:04.983633 10631 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:04.983947  8069 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:04.833276 10604 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:22:04.985646  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1256) took 1941 ms. Trace:
I20260709 12:22:04.986037  8144 rpcz_store.cc:276] 0709 12:22:03.044687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.065108 (+ 20421us) service_pool.cc:224] Handling call
0709 12:22:03.065386 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.455984 (+390598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.985406 (+1529422us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400255654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:04.985578 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893095296}
I20260709 12:22:04.987113  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:04.932441 10474 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:04.988209  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:04.988839  8757 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:04.990844  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.951377  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.992228 10613 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:04.992712  8109 connection.cc:256] RPC call timeout handler was delayed by -1.2451042409998081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:22:04.993104  8109 connection.cc:256] RPC call timeout handler was delayed by -1.1286441349998313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 12:22:04.993729 10527 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:04.827730 10124 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.994189  8069 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:04.994519  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:04.995344 10629 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:04.995738 10629 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:04.996124 10629 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:04.996783 10567 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.746s	user 0.004s	sys 0.000s
I20260709 12:22:04.997786 10613 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.998292  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 390) took 3167 ms. Trace:
I20260709 12:22:04.998414 10613 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.998955 10613 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.998751  8140 rpcz_store.cc:276] 0709 12:22:01.830726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.830829 (+   103us) service_pool.cc:224] Handling call
0709 12:22:01.844137 (+ 13308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.844519 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.844561 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.845048 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:22:02.796361 (+951313us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18003cb7a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:03.031793 (+235432us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:03.031840 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.031933 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:04.996095 (+1964162us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:04.998048 (+  1953us) raft_consensus.cc:1685] finished
0709 12:22:04.998071 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.998208 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12083,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5433,"spinlock_wait_cycles":64915712,"thread_start_us":235213,"threads_started":1,"wal-append.queue_time_us":1338493}
I20260709 12:22:05.002640  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1419) took 1917 ms. Trace:
I20260709 12:22:05.003027  8062 rpcz_store.cc:276] 0709 12:22:03.084782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.439644 (+354862us) service_pool.cc:224] Handling call
0709 12:22:03.439849 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.464704 (+1024855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.002380 (+537676us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540011dad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:05.002573 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258905856}
I20260709 12:22:05.004197  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.015005  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.016033  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.980324 10120 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:04.983206 10503 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:05.016934  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2482) took 1521 ms. Trace:
I20260709 12:22:05.017217 10503 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:05.017501  8064 rpcz_store.cc:276] 0709 12:22:03.495227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.701346 (+206119us) service_pool.cc:224] Handling call
0709 12:22:03.701694 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.362852 (+661158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.016584 (+653732us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:05.016854 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496614272}
I20260709 12:22:05.018448 10503 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.020251  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.004802 10629 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.020385  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2486) took 1512 ms. Trace:
I20260709 12:22:05.019734  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.023398  8066 rpcz_store.cc:276] 0709 12:22:03.508152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.400419 (+892267us) service_pool.cc:224] Handling call
0709 12:22:04.414372 (+ 13953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.828590 (+414218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.020083 (+191493us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:05.020311 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349246208}
I20260709 12:22:05.019205  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.004663 10474 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.005333  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.921785 10540 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.007612 10336 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:05.007845 10613 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:04.828321 10337 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:04.963594 10244 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.994256 10527 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:04.841408 10587 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:05.040139  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 83836.5us
I20260709 12:22:05.025882  8068 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:05.006115  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.027405  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:05.041795  8145 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:04.954207 10577 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:04.763062  8758 rpcz_store.cc:269] 0709 12:22:02.168228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.188326 (+ 20098us) service_pool.cc:224] Handling call
0709 12:22:02.807740 (+619414us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:04.690582 (+1882842us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54006086d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:04.690784 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323857024}
W20260709 12:22:05.030256  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46167.2us
I20260709 12:22:05.020689 10503 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.936852 10617 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.835037 10524 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.941473 10487 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:05.034644  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:04.834851 10590 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:05.041303 10469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.005s	sys 0.005s
I20260709 12:22:05.035772 10336 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.045570 10474 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.046535 10626 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:05.047037  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:05.048384 10434 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.049081 10586 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:04.843919 10580 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.050015 10484 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.026945 10544 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.950038 10475 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.061391  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.069485  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:05.073558  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:05.105101  8215 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:05.105748  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.104439  8068 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:05.107579  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.079702  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:05.081204  8214 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:05.064457 10120 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.086879  8216 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:22:05.079941 10611 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260709 12:22:05.080387 10469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.005s	sys 0.005s
W20260709 12:22:05.094141  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60691.5us
I20260709 12:22:05.097239  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:04.937223 10102 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.065156 10577 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:04.984558 10631 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.101876  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:05.098223 10534 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:05.123910  8216 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:05.119660  8064 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:05.127655  8144 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:05.129990  8145 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:05.130939  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:05.131650  8144 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:05.127838  8070 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:05.128795  8137 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:22:05.135260  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:05.147181  8109 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.648s (SENT)
I20260709 12:22:05.285732  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.290202  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:05.122545 10469 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:05.293700  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:05.295310  8064 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:05.098508 10628 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:22:05.138163 10523 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:05.243279 10598 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:05.119108 10120 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.292516 10631 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:05.253448 10534 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:05.336020 10626 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.297333 10315 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:22:05.336733 10344 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:05.295277 10486 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.337872 10102 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.339205 10530 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.100904 10337 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.341548 10580 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.343120 10577 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:05.352218 10612 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:05.349691 10629 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:05.305593 10624 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:22:05.336830 10544 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:05.303512 10633 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:22:05.348066 10608 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.294268 10287 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:22:05.307189 10628 consensus_queue.cc:1243] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:22:05.378115  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 257942us
W20260709 12:22:05.390897  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.353340 10523 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:05.365144 10344 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:05.373517 10620 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
W20260709 12:22:05.391803  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.307595 10528 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:22:05.343222 10595 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.372022 10626 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:05.390400 10349 consensus_meta.cc:287] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.908s	user 0.009s	sys 0.003s
I20260709 12:22:05.391978 10469 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.389637 10527 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:05.414566  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:05.416121  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:05.416935  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:05.430895  8764 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:05.417862  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:05.417958  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:05.374356 10486 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.438632 10486 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:05.414515  8757 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:05.440666  8757 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:05.403895 10523 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:05.436520  8761 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:05.450148  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.467947  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:05.468247  8764 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:05.470701  8142 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:05.471853  8761 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:05.467357 10513 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:05.472186 10524 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.474094 10336 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:05.465229 10612 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:22:05.477033  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 289319us
I20260709 12:22:05.475590 10344 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.485636  8762 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:05.429219 10349 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.411093 10534 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.477005 10513 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:05.741657 10513 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:05.732028 10503 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:22:05.743336 10513 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:05.720691 10524 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:05.744669  8146 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:05.744383 10524 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.746026  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:05.487353  8760 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:22:05.556387  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1366) took 1148 ms. Trace:
I20260709 12:22:05.747314  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:05.616109  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.748410  8141 rpcz_store.cc:276] 0709 12:22:04.407929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.459906 (+ 51977us) service_pool.cc:224] Handling call
0709 12:22:04.460215 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:04.467993 (+  7778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.468044 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.482106 (+ 14062us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.794992 (+312886us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:04.795050 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.795145 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.556096 (+760951us) raft_consensus.cc:1685] finished
0709 12:22:05.556128 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.556301 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7308,"raft.queue_time_us":8268,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":274332,"threads_started":1,"wal-append.queue_time_us":346062}
W20260709 12:22:05.772315 10648 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.280s	user 0.005s	sys 0.005s
I20260709 12:22:05.764366 10370 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.773514 10370 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.777850 10120 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:05.540408 10603 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.004s
W20260709 12:22:05.541863 10549 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 12:22:05.782083  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1278) took 2294 ms. Trace:
W20260709 12:22:05.618384 10606 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:22:05.794019  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:05.549275 10626 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.844342  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:05.491060  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73070.8us
I20260709 12:22:05.832571  8219 rpcz_store.cc:276] 0709 12:22:03.487327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.500224 (+ 12897us) service_pool.cc:224] Handling call
0709 12:22:03.541115 (+ 40891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.734563 (+193448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.781811 (+2047248us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540017cad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:05.782017 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438556544}
I20260709 12:22:05.708190 10639 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.698403 10595 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:06.015714  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.026377  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:05.861800  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.040812  8064 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:22:05.954838  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.781683 10344 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:06.039299  8141 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:22:05.884743  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.930868 10639 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:05.954082 10487 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.000s
I20260709 12:22:06.076958 10487 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.843097 10603 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:05.831756 10543 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.864224 10576 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.076262 10639 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:05.918155  8762 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:06.081633 10523 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.000s
I20260709 12:22:05.981271 10349 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:05.967597 10475 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.109630 10523 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:05.960160 10577 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:06.110574 10590 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.026s	user 0.011s	sys 0.000s
I20260709 12:22:06.110838 10577 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.111076 10590 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:05.967094 10490 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.013s	user 0.011s	sys 0.002s
I20260709 12:22:06.081764  8143 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:06.118607  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:06.070842  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:06.156896  8141 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:22:06.124107  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.112996  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 267131us
W20260709 12:22:06.159663  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.011s	sys 0.026s
W20260709 12:22:06.161031  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.011s	sys 0.026s
I20260709 12:22:05.975153 10524 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.112000 10523 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:06.089535 10239 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.149s	user 0.012s	sys 0.000s
W20260709 12:22:06.109159 10553 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.284s	user 0.006s	sys 0.006s
W20260709 12:22:06.107671 10631 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.003s
I20260709 12:22:06.172381  8212 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:06.174904  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:06.156704 10544 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:06.109046 10639 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.084308 10603 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.080592 10487 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.164338 10513 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:06.182101  8214 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:22:06.165925 10630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.013s	sys 0.029s
I20260709 12:22:06.163743 10490 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.203538 10490 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.204305  8140 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:06.178121 10239 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.209782 10239 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.199971 10639 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.214354 10590 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:06.216863 10513 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.105580 10576 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.177268 10657 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.082113 10543 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.181356 10626 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:06.200433 10630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.013s	sys 0.030s
W20260709 12:22:06.332240  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 106474us
W20260709 12:22:06.333043  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 107023us
W20260709 12:22:06.352276  8730 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.746s (SENT) [suppressed 11 similar messages]
I20260709 12:22:06.383316 10658 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:06.347018 10249 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.385895 10249 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:22:06.189198 10544 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.409555 10650 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:22:06.410238 10662 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:22:06.413941 10576 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:06.425067  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.417845 10249 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.349774 10626 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:06.230195 10549 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 12:22:06.405834 10523 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:06.543771  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.548209  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.023s	sys 0.068s
I20260709 12:22:06.460412 10626 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:06.552152  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.023s	sys 0.068s
I20260709 12:22:06.349086 10657 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:06.553144  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.555503  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:06.589579  8218 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:06.542091 10523 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:06.545164 10469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.105s	sys 0.147s
I20260709 12:22:06.721060  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1427) took 2314 ms. Trace:
I20260709 12:22:06.725045  8061 rpcz_store.cc:276] 0709 12:22:04.375165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.456048 (+ 80883us) service_pool.cc:224] Handling call
0709 12:22:04.456419 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:04.830529 (+374110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.830581 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:04.831421 (+   840us) log.cc:844] Serialized 52 byte log entry
0709 12:22:05.024254 (+192833us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:05.099769 (+ 75515us) log.cc:844] Serialized 14 byte log entry
0709 12:22:05.122453 (+ 22684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.590407 (+1467954us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54001072d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:06.590467 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:06.590513 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:06.689247 (+ 98734us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.689492 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46012,"prepare.queue_time_us":319384,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":29621,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":14205,"spinlock_wait_cycles":846481792,"thread_start_us":144834,"threads_started":2,"wal-append.queue_time_us":157176}
W20260709 12:22:06.725842  8036 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.071s	sys 0.100s
W20260709 12:22:06.756871  8036 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.077s	sys 0.107s
W20260709 12:22:06.757383  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 1.06902e+06us
I20260709 12:22:06.547188 10659 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
W20260709 12:22:06.720906 10534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.026s	sys 0.076s
I20260709 12:22:06.755964 10543 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.599270 10514 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:06.672081 10590 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:06.764096 10576 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.774662 10657 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.775959 10544 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:06.724988 10469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.106s	sys 0.147s
W20260709 12:22:06.763667 10534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.026s	sys 0.077s
I20260709 12:22:06.758569 10647 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.831086 10647 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.834133  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1273) took 2325 ms. Trace:
I20260709 12:22:06.834656  8142 rpcz_store.cc:276] 0709 12:22:04.508341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.985851 (+477510us) service_pool.cc:224] Handling call
0709 12:22:04.986132 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.471285 (+485153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.833900 (+1362615us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54000442d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:06.834069 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113795328}
I20260709 12:22:06.799925 10514 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:06.819885  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1272) took 2311 ms. Trace:
I20260709 12:22:06.823467 10626 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.824783 10639 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:06.795923 10344 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.002s
I20260709 12:22:06.800172 10523 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.797609 10513 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:06.829164 10653 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.212s	user 0.013s	sys 0.022s
I20260709 12:22:06.829995 10599 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:06.838155  8146 rpcz_store.cc:276] 0709 12:22:04.508045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.977295 (+469250us) service_pool.cc:224] Handling call
0709 12:22:04.977578 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.745161 (+767583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.819579 (+1074418us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002f1054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:06.819813 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763543296}
I20260709 12:22:06.846915  8065 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:06.842537 10163 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:06.843345 10257 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.817802 10576 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:06.848043  8070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2492) took 1859 ms (client timeout 2057 ms). Trace:
W20260709 12:22:06.850960 10649 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.355s	user 0.017s	sys 0.018s
I20260709 12:22:06.851723  8066 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:06.853106  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 451469us
I20260709 12:22:06.816540 10590 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:06.860994  8730 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.033s
W20260709 12:22:06.861512  8070 rpcz_store.cc:269] 0709 12:22:04.989112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.019505 (+ 30393us) service_pool.cc:224] Handling call
0709 12:22:06.847742 (+1828237us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b5400396cd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:06.847971 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225344384}
I20260709 12:22:06.834201 10647 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.856604 10599 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:06.872740  8730 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.033s
W20260709 12:22:06.873135  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 520886us
I20260709 12:22:06.857409 10523 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:06.860765 10654 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.109s	user 0.017s	sys 0.034s
I20260709 12:22:06.883615  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:06.885866 10599 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.859575 10514 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.897712 10514 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.898276  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1270) took 2390 ms. Trace:
I20260709 12:22:06.907353 10244 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:06.910616 10672 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.911257 10672 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:06.914001 10576 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:06.917075  8063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1417) took 3834 ms (client timeout 1753 ms). Trace:
W20260709 12:22:06.917574  8063 rpcz_store.cc:269] 0709 12:22:03.082628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.122072 (+ 39444us) service_pool.cc:224] Handling call
0709 12:22:06.916842 (+3794770us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:06.916992 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936932096}
I20260709 12:22:06.919129 10582 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:06.919704 10582 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:06.920876 10582 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:06.922176 10582 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:06.922442  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:06.924505  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.925114  8061 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:06.925398  8070 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:06.925817  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.924505  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.925979  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2479) took 3859 ms. Trace:
I20260709 12:22:06.926447  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:06.925418  8758 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:06.927139  8062 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.927877  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:06.926873  8067 rpcz_store.cc:276] 0709 12:22:03.066888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.067017 (+   129us) service_pool.cc:224] Handling call
0709 12:22:03.955568 (+888551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.361408 (+405840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.925776 (+2564368us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b54000fcdd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:06.925917 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2042811648}
W20260709 12:22:06.929250  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 352) took 1796 ms (client timeout 1523 ms). Trace:
I20260709 12:22:06.929648  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:06.930085  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 349) took 1841 ms. Trace:
I20260709 12:22:06.930269  8760 raft_consensus.cc:2376] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4. Re-sending same reply.
I20260709 12:22:06.926512  8068 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
W20260709 12:22:06.929668  8214 rpcz_store.cc:269] 0709 12:22:05.132516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.132681 (+   165us) service_pool.cc:224] Handling call
0709 12:22:06.929082 (+1796401us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400373f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:06.929182 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049456000}
I20260709 12:22:06.933733  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.934813  8064 raft_consensus.cc:2410] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:06.930491  8217 rpcz_store.cc:276] 0709 12:22:05.088997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.089142 (+   145us) service_pool.cc:224] Handling call
0709 12:22:05.097265 (+  8123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.287716 (+190451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:05.287763 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:05.287825 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:05.287870 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.929867 (+1641997us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54002256d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:06.929911 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.930020 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437349248}
I20260709 12:22:06.933810  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:06.883100 10625 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.942261  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:06.943219  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.930653 10672 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:06.943302  8068 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:06.898831  8139 rpcz_store.cc:276] 0709 12:22:04.507441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.939602 (+432161us) service_pool.cc:224] Handling call
0709 12:22:04.940047 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:05.030371 (+ 90324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:05.030404 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:05.031060 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 12:22:05.371268 (+340208us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:05.371320 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.371390 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:06.850028 (+1478638us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:06.897851 (+ 47823us) raft_consensus.cc:1685] finished
0709 12:22:06.897883 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.898191 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7989,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8517,"spinlock_wait_cycles":161060736,"thread_start_us":311421,"threads_started":1,"wal-append.queue_time_us":377433}
I20260709 12:22:06.936510  8063 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:06.947875 10668 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:06.949054  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:06.949054  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.950863  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.951210  8067 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:06.951720  8070 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:06.950546  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:06.952971  8069 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:06.953320  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:06.954082  8064 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:06.953936  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 360) took 1536 ms (client timeout 1817 ms). Trace:
W20260709 12:22:06.954522  8762 rpcz_store.cc:269] 0709 12:22:05.417008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.417625 (+   617us) service_pool.cc:224] Handling call
0709 12:22:06.953620 (+1535995us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54005460d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:06.953777 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113536256}
I20260709 12:22:06.955091  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:06.955749  8068 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:22:06.934890 10654 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:06.961331  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.961422  8069 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:06.967103  8062 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:06.969924 10590 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:06.971263 10626 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:06.974704  8063 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:06.964020 10647 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:06.944533 10625 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:06.967305 10650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.057s	sys 0.045s
W20260709 12:22:06.984777 10650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.057s	sys 0.045s
I20260709 12:22:05.706782  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.979997 10647 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.014358  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.018798 10614 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.018939 10287 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:07.019393  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 350) took 3329 ms. Trace:
I20260709 12:22:07.019511 10614 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.019924  8759 rpcz_store.cc:276] 0709 12:22:03.690137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.695053 (+  4916us) service_pool.cc:224] Handling call
0709 12:22:03.852206 (+157153us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:04.750221 (+898015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.019025 (+2268804us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b540064e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:07.019301 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457050496}
W20260709 12:22:07.020731  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.021310  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.021688  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.021898  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2500) took 1275 ms. Trace:
I20260709 12:22:07.022861  8065 rpcz_store.cc:276] 0709 12:22:05.746884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.747027 (+   143us) service_pool.cc:224] Handling call
0709 12:22:07.021728 (+1274701us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:07.021835 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522368896}
I20260709 12:22:07.023198 10287 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.025139  8220 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:22:07.026376  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 347) took 1948 ms (client timeout 1746 ms). Trace:
W20260709 12:22:07.026803  8220 rpcz_store.cc:269] 0709 12:22:05.078489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.078612 (+   123us) service_pool.cc:224] Handling call
0709 12:22:07.026170 (+1947558us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400134054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:07.026303 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4406744832}
I20260709 12:22:07.027756 10370 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.028532 10287 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.029307  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1280) took 2074 ms. Trace:
I20260709 12:22:07.029691  8140 rpcz_store.cc:276] 0709 12:22:04.954588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.013509 (+ 58921us) service_pool.cc:224] Handling call
0709 12:22:05.013899 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:06.205215 (+1191316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.029044 (+823829us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400311354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:07.029247 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736927616}
I20260709 12:22:07.031957 10586 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:07.041940  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.033378 10344 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:07.042112  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.035292  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:07.043687  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 104283us
I20260709 12:22:07.045531  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.045192  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:07.049777  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.051934  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.053388  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:07.021945 10614 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.054226  8760 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:07.050634 10287 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:07.056509  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:07.045428  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.045750 10344 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.057267 10639 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.045794 10163 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:07.064906  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.087075  8220 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:07.032864 10645 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:07.069597  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2537) took 2314 ms. Trace:
I20260709 12:22:07.072731  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:07.073333 10625 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.075174  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.076294  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.057814 10669 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.054378 10513 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:07.048050 10488 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.096714 10669 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.097057 10488 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.098966 10669 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.083330 10543 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.099982 10543 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.101279 10577 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.055765 10544 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:22:07.085687  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.065644  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.103652  8217 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:07.103848  8213 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:22:07.091307  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.105233 10647 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.093070  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.092187  8212 rpcz_store.cc:276] 0709 12:22:04.755031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.755310 (+   279us) service_pool.cc:224] Handling call
0709 12:22:04.763434 (+  8124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:06.175307 (+1411873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.069331 (+894024us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540016b2d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:07.069532 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3239553408}
I20260709 12:22:07.093951 10163 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.106292  8218 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:07.108029 10163 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.072288  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.099378 10488 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.112926  8220 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:07.082161 10344 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.109033  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.088568  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.110141  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:07.102118 10543 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.114573  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1432) took 2207 ms. Trace:
I20260709 12:22:07.119823 10344 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.095989 10680 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:07.116932  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.078250 10287 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.120179  8066 rpcz_store.cc:276] 0709 12:22:04.907505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.029860 (+122355us) service_pool.cc:224] Handling call
0709 12:22:06.851426 (+1821566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:06.870018 (+ 18592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.114286 (+244268us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400396cd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:07.114489 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4172989824}
I20260709 12:22:07.125008  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:07.126399  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:07.127751  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:07.115851 10163 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.118846 10544 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:07.134600  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.135876  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.136797  8217 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:07.138032  8213 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:07.139577  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.140393  8213 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:22:07.141741  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.142571  8213 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.092187 10639 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.144589  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:07.131628 10677 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.084s	user 0.004s	sys 0.000s
I20260709 12:22:07.146893  8217 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:07.131870 10676 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:07.138150 10163 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.129233 10488 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.146915 10544 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.170363 10544 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.171279 10639 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.172127 10639 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.130578 10625 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:07.173851 10625 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.174237 10625 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.120546 10514 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:22:07.152884 10287 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.129766 10647 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:07.129501 10638 raft_consensus.cc:2764] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:07.130527 10680 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.158979  8762 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:22:07.158993  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:07.160245  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.189917  8762 pending_rounds.cc:85] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 6
I20260709 12:22:07.160879  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.128240 10669 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:07.168898 10488 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.184077  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.190394  8762 pending_rounds.cc:107] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:22:07.191339  8762 raft_consensus.cc:2889] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.191942  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.190389  8212 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:07.192703  8214 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.195354  8211 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.199129  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.162753 10513 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.200075  8212 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:07.203300  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44411.5us
I20260709 12:22:07.190366  8213 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:07.205798  8217 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.182744 10676 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:07.204106  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:07.192014 10658 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.181249 10647 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:07.202239  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.210942  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.210680  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.209503  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:07.221352  8065 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:07.222023  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:07.229591  8069 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:07.230840  8214 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:07.222846  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1265) took 2712 ms (client timeout 2232 ms). Trace:
W20260709 12:22:07.231655  8143 rpcz_store.cc:269] 0709 12:22:04.502899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.503070 (+   171us) service_pool.cc:224] Handling call
0709 12:22:07.214647 (+2711577us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400254254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:07.214761 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3263172480}
I20260709 12:22:07.223304  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.233218  8219 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.224445  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:07.206389 10582 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:07.236442  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:07.219141  8063 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:07.216318 10647 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:07.184084 10639 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.248816 10681 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:07.248889 10686 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:07.249719 10488 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.215829 10339 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:07.248281  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:07.249344 10681 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.222836  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:07.215682 10430 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:07.199008 10669 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.230726  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:07.246737  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:07.255738  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.39165e+06us
I20260709 12:22:07.215408 10658 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.260277  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.236505 10337 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:07.261184  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:07.265743  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.253472 10534 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:07.269222  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1259493719999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:22:07.260905 10681 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.269626  8215 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:22:07.252768 10503 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.259783 10430 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.263772 10582 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:07.281844 10120 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.263550 10349 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:07.275763 10487 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:07.265662 10475 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.289856 10244 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:07.290565 10120 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.270157 10534 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:07.255928 10488 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:22:07.294128  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:07.305933 10163 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.307523 10669 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.262413 10595 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:22:07.309129 10430 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.279644 10608 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.311798 10625 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.275990 10680 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:07.371691  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.372673  8142 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:07.228885 10513 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.322333  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:07.374338  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52102.3us
I20260709 12:22:07.375182  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:07.326753  8143 pending_rounds.cc:85] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:07.376154  8143 pending_rounds.cc:107] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:22:07.376562  8143 raft_consensus.cc:2889] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.282066 10336 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:07.334539  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:07.284207 10639 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:07.337419  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56237.2us
I20260709 12:22:07.329667 10469 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:07.266383 10676 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.348493  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:07.393293  8137 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.353181  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:07.394376  8186 connection.cc:256] RPC call timeout handler was delayed by -2.0320266969997647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 12:22:07.300705 10582 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:07.365264  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:07.394919  8186 connection.cc:256] RPC call timeout handler was delayed by -1.6801266970001052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 12:22:07.356673  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:07.395524  8186 connection.cc:256] RPC call timeout handler was delayed by -1.6315266970000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:22:07.395884  8186 connection.cc:256] RPC call timeout handler was delayed by -1.5883266969999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 12:22:07.327219 10603 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.327011 10605 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.379686  8213 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:07.356244 10638 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:07.382750  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:07.337105  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 227291us
I20260709 12:22:07.289253 10503 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.347198  8146 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:07.363408 10163 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.319815 10637 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:22:07.357777 10631 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.385448 10430 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.393536 10533 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:07.407136  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1289) took 2275 ms. Trace:
I20260709 12:22:07.367808 10621 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.398253 10582 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:07.407822  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73397.8us
I20260709 12:22:07.327268 10487 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.370817 10669 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:22:07.399987 10469 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.324335 10349 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.390148  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 124665us
I20260709 12:22:07.423643  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.328521 10475 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.427461 10337 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:07.430107 10599 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:07.407022 10488 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:07.384208 10287 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:07.432063  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2531) took 3030 ms. Trace:
W20260709 12:22:07.434280  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.396301  8186 connection.cc:256] RPC call timeout handler was delayed by -1.2829932230001759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:22:07.372167 10608 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.396412 10336 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:07.828374  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 445671us
W20260709 12:22:07.467128  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.834918  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 424467us
I20260709 12:22:07.838783  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:07.839287  8137 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:07.846318  8214 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.845188  8211 rpcz_store.cc:276] 0709 12:22:04.401338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.410013 (+  8675us) service_pool.cc:224] Handling call
0709 12:22:04.421538 (+ 11525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.195817 (+2774279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.431803 (+235986us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b540016a3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:07.431995 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6378791808}
W20260709 12:22:07.848846  8219 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.615s	user 0.016s	sys 0.004s
I20260709 12:22:07.829067  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.849431  8219 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:07.849668  8146 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:07.409298 10645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37796 (request call id 0) took 5109 ms. Trace:
I20260709 12:22:07.850446  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:07.850745  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:07.851097  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:07.840507  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:07.859144  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.408713 10490 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.860666  8219 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.464761 10533 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.866035  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.866643  8137 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:07.867492  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:07.858862  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:07.868553  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.869663  8137 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:07.870527  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:07.868598  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:07.463331 10546 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:07.887842  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.889258  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.891510  8214 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:22:07.892740 10469 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.894044 10469 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:07.894771 10339 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.003s
I20260709 12:22:07.895344 10339 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:07.895701 10339 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.896086 10339 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.442705  8145 rpcz_store.cc:276] 0709 12:22:05.131392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.252227 (+120835us) service_pool.cc:224] Handling call
0709 12:22:05.252603 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.252853 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:05.297317 (+ 44464us) log.cc:844] Serialized 14 byte log entry
0709 12:22:07.229526 (+1932209us) log.cc:844] Serialized 14 byte log entry
0709 12:22:07.406352 (+176826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.406420 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:07.406517 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.406657 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:07.406891 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1931719,"prepare.queue_time_us":52348,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":134,"raft.queue_time_us":2105874,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":19519360,"thread_start_us":174791,"threads_started":2,"wal-append.queue_time_us":380560}
I20260709 12:22:07.897094 10704 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:07.897547 10704 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.897861 10503 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.898046 10704 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:07.898231 10475 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.898473 10697 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.898813 10475 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:07.899093 10697 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:07.899364 10475 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:07.901360 10665 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:07.901772 10665 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:07.902690 10665 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.904368  8139 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:07.904708 10442 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.905299 10442 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.906224  8142 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:07.882539  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.878885  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:07.463256 10690 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:07.505618 10595 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:07.423046 10543 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.474s
I20260709 12:22:07.897460  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:07.865082 10621 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.884842  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44488.3us
I20260709 12:22:07.907599  8140 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:07.414367 10163 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:07.884222  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.413808 10603 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.421006 10686 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.487s
I20260709 12:22:07.908004  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:07.830708 10120 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:07.849965 10683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.015s	sys 0.024s
I20260709 12:22:07.625537  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:07.831080 10699 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.899997 10697 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:07.829699 10685 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.495s	user 0.001s	sys 0.000s
I20260709 12:22:07.864928 10533 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:07.836315 10488 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:07.855844 10287 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:07.885921 10344 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.005s
I20260709 12:22:07.912032  8146 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:07.942087  8219 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:08.013854  8219 pending_rounds.cc:85] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
I20260709 12:22:08.014209  8219 pending_rounds.cc:107] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:08.014429  8219 raft_consensus.cc:2889] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.414173 10605 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.867681 10702 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:07.970847  8211 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:07.972040  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:07.612946 10647 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.442320 10631 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:07.900254 10475 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.974864 10625 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:07.978122 10339 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:07.980320 10621 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:07.830070 10681 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:07.985460 10693 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:22:07.411422 10534 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:07.989521  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 81607.5us
I20260709 12:22:07.935279 10163 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.898468 10503 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:22:07.462383 10695 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.528s
I20260709 12:22:07.876893 10688 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 12:22:07.955421 10663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.030s	sys 0.034s
I20260709 12:22:07.981040 10337 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:08.016794  8064 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:07.912395 10490 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:08.017896  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166919us
I20260709 12:22:08.170209  8137 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:08.485772  8145 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:22:08.011354  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.004s
W20260709 12:22:08.384689  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 466802us
W20260709 12:22:08.012367  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 170346us
I20260709 12:22:08.492779  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1379) took 1133 ms. Trace:
I20260709 12:22:08.499995  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:07.857307 10645 rpcz_store.cc:276] 0709 12:22:02.276344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.276939 (+   595us) service_pool.cc:224] Handling call
0709 12:22:02.344179 (+ 67240us) log.cc:844] Serialized 501 byte log entry
0709 12:22:04.373988 (+2029809us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b5400716c20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca01dbe 00007f498ca0c930 00007f498ca0c8d8 00007f498ca0c858 00007f498ca0c813 00007f498ca0ba9c 00007f49928f72f6 00007f49928f1aa8 00007f498ca487cb 00007f498ca4b2c0
0709 12:22:06.999206 (+2625218us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400716c20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca02aaa 00007f498ca01dd9 00007f498ca0c930 00007f498ca0c8d8 00007f498ca0c858 00007f498ca0c813 00007f498ca0ba9c 00007f49928f72f6 00007f49928f1aa8 00007f498ca487cb
0709 12:22:07.385953 (+386747us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12263,"raft.run_cpu_time_us":988,"raft.run_wall_time_us":985,"spinlock_wait_cycles":468880128,"thread_start_us":295347,"threads_started":2,"wal-append.queue_time_us":258505}
W20260709 12:22:08.334415  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.256860  8143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.024s	sys 0.028s
W20260709 12:22:08.501441  8143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.033s	sys 0.036s
I20260709 12:22:08.012058 10287 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:08.503299  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.503787  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.500058  8139 rpcz_store.cc:276] 0709 12:22:07.359541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.364904 (+  5363us) service_pool.cc:224] Handling call
0709 12:22:08.492518 (+1127614us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001c34d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:08.492697 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170247040}
W20260709 12:22:08.498339  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.008s	sys 0.041s
W20260709 12:22:08.017786 10696 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
W20260709 12:22:08.447866 10469 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
W20260709 12:22:08.129029 10430 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.000s
W20260709 12:22:08.413054 10544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.027s	sys 0.048s
W20260709 12:22:08.213789 10685 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:22:08.510622  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:08.485424 10663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.035s	sys 0.043s
I20260709 12:22:08.491798 10702 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:08.228385 10692 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:22:08.010690 10701 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:08.539824  8215 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:08.513754  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:08.500646 10608 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.445856 10706 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:08.010365 10698 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:08.413161 10487 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.550509  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:08.554643  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1381) took 1194 ms. Trace:
I20260709 12:22:08.574658  8139 rpcz_store.cc:276] 0709 12:22:07.360112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.510326 (+1150214us) service_pool.cc:224] Handling call
0709 12:22:08.554567 (+ 44241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.556967  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.557256  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 325) took 1338 ms. Trace:
I20260709 12:22:08.450436 10349 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:08.561159  8211 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:08.505081 10603 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:08.537124 10544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.027s	sys 0.053s
I20260709 12:22:08.380563 10336 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.579304  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:08.563136  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.580118  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.580219  8139 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:08.580747  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1311) took 1192 ms. Trace:
I20260709 12:22:08.575971  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1283) took 3552 ms. Trace:
I20260709 12:22:08.012001 10699 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:08.567202 10706 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:08.553481 10599 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.002s
I20260709 12:22:08.537322 10621 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:08.569278  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.002s	sys 0.022s
W20260709 12:22:08.598421  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.002s	sys 0.022s
I20260709 12:22:08.546581 10695 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:08.553297 10704 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 12:22:08.538038 10469 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:08.576777  8218 raft_consensus.cc:2368] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6.
I20260709 12:22:08.576033  8141 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:22:08.581203  8139 rpcz_store.cc:276] 0709 12:22:07.388833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.578966 (+1190133us) service_pool.cc:224] Handling call
0709 12:22:08.580689 (+  1723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.581429  8138 rpcz_store.cc:276] 0709 12:22:05.023468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.029251 (+  5783us) service_pool.cc:224] Handling call
0709 12:22:05.029640 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.099164 (+ 69524us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:05.130523 (+ 31359us) log.cc:844] Serialized 14 byte log entry
0709 12:22:05.130870 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 12:22:06.927029 (+1796159us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18002fd160. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:07.226444 (+299415us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b18002fd160. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:22:07.226620 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.226675 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:07.226740 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.575727 (+1348987us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b540008edd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:08.575777 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.575909 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1978497,"prepare.queue_time_us":1824071,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":8407,"raft.queue_time_us":2095564,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":17199,"spinlock_wait_cycles":406221312}
W20260709 12:22:08.568246 10686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.019s
I20260709 12:22:08.570268 10701 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:08.589576  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:08.559885 10702 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:08.596760  8731 connection.cc:256] RPC call timeout handler was delayed by -1.1393770169997879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:22:08.699263  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:08.700459  8218 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:22:08.580471 10543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.021s
I20260709 12:22:08.593636  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:08.281201 10488 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:08.601640  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:08.601848  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 332) took 1364 ms. Trace:
I20260709 12:22:08.703644  8062 rpcz_store.cc:276] 0709 12:22:07.237131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.240841 (+  3710us) service_pool.cc:224] Handling call
0709 12:22:07.241171 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.250363 (+  9192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.250394 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.250875 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:22:07.406175 (+155300us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:07.406256 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.406389 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:07.906214 (+499825us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:08.596864 (+690650us) raft_consensus.cc:1685] finished
0709 12:22:08.596904 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.601782 (+  4878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8810,"raft.queue_time_us":12320,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5122,"spinlock_wait_cycles":68445952,"thread_start_us":140292,"threads_started":1,"wal-append.queue_time_us":252076}
I20260709 12:22:08.690372  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.575887  8063 rpcz_store.cc:276] 0709 12:22:07.218381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.218496 (+   115us) service_pool.cc:224] Handling call
0709 12:22:07.218802 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.219021 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:07.380242 (+161221us) log.cc:844] Serialized 14 byte log entry
0709 12:22:08.556781 (+1176539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:08.556862 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:08.556928 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.557020 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.557178 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49776,"thread_start_us":1126305,"threads_started":1}
I20260709 12:22:08.697427  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1307) took 1310 ms. Trace:
W20260709 12:22:08.698227  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 108942us
I20260709 12:22:08.707490  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:08.706941  8138 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:08.710970  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1313) took 1321 ms. Trace:
I20260709 12:22:08.711299  8138 rpcz_store.cc:276] 0709 12:22:07.389451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.690099 (+1300648us) service_pool.cc:224] Handling call
0709 12:22:08.710908 (+ 20809us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:08.712147  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 118608us
I20260709 12:22:08.712284  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.712927  8138 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:08.707217  8141 rpcz_store.cc:276] 0709 12:22:07.387328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.552535 (+1165207us) service_pool.cc:224] Handling call
0709 12:22:08.697350 (+144815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.713397  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1380) took 1353 ms. Trace:
W20260709 12:22:08.694303 10686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.006s	sys 0.019s
I20260709 12:22:08.701316  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.713711  8138 rpcz_store.cc:276] 0709 12:22:07.359848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.712030 (+1352182us) service_pool.cc:224] Handling call
0709 12:22:08.713344 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.718958  8139 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:08.719461  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1378) took 1360 ms. Trace:
I20260709 12:22:08.719338  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.598253 10621 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:08.713918  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.601380 10695 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:08.719818  8139 rpcz_store.cc:276] 0709 12:22:07.359168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.697919 (+1338751us) service_pool.cc:224] Handling call
0709 12:22:08.719403 (+ 21484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.599664 10605 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.714775  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:08.720028  8138 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:22:08.703014 10543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.013s	sys 0.022s
I20260709 12:22:08.689836 10714 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.746493 10339 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:08.754104 10699 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:08.755317 10631 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:08.756824 10706 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:08.693356 10704 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:08.763252 10647 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.704509 10599 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:08.700759  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.818755  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 104062us
I20260709 12:22:08.759454 10658 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:08.842866  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:09.009076  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 166159us
W20260709 12:22:08.966737  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.013005  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.990005  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1310) took 1601 ms. Trace:
I20260709 12:22:09.013670  8138 rpcz_store.cc:276] 0709 12:22:07.388363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.719063 (+1330700us) service_pool.cc:224] Handling call
0709 12:22:08.989748 (+270685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.015522  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:08.738831  8141 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:08.993034  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.017649  8139 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:09.017552  8141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1386) took 1655 ms (client timeout 2182 ms). Trace:
W20260709 12:22:09.018066  8141 rpcz_store.cc:269] 0709 12:22:07.361806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.713669 (+1351863us) service_pool.cc:224] Handling call
0709 12:22:09.017310 (+303641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.019531  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:08.965343  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 466012us
I20260709 12:22:09.021255  8138 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:09.021560  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:09.019487  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.022517  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.023144  8139 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:09.012193  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:09.023669  8141 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:09.025460  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.026836  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:09.026505  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.027928  8139 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:09.028842  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1309) took 1640 ms. Trace:
I20260709 12:22:09.030663  8141 rpcz_store.cc:276] 0709 12:22:07.388086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.024881 (+1636795us) service_pool.cc:224] Handling call
0709 12:22:09.028784 (+  3903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.023540  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1377) took 1664 ms. Trace:
I20260709 12:22:09.032100  8138 rpcz_store.cc:276] 0709 12:22:07.358766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.022076 (+1663310us) service_pool.cc:224] Handling call
0709 12:22:09.023463 (+  1387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.033933  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1300) took 1180 ms. Trace:
I20260709 12:22:09.034577  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.035691  8138 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:09.034355  8219 rpcz_store.cc:276] 0709 12:22:07.853551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.013116 (+159565us) service_pool.cc:224] Handling call
0709 12:22:08.013549 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:08.128163 (+114614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.128207 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:08.168868 (+ 40661us) log.cc:844] Serialized 52 byte log entry
0709 12:22:08.588878 (+420010us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:08.588970 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.589068 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.033423 (+444355us) raft_consensus.cc:1685] finished
0709 12:22:09.033461 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.033708 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112727,"raft.queue_time_us":143991,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":419482,"threads_started":1,"wal-append.queue_time_us":749065}
I20260709 12:22:09.036651  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.030055  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.037794  8139 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:09.038341  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.038802  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.039687  8139 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:09.040426  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.040750  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.033387  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:09.042068  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.042577  8141 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:09.043061  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1384) took 1682 ms. Trace:
I20260709 12:22:09.043473  8141 rpcz_store.cc:276] 0709 12:22:07.361144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.032940 (+1671796us) service_pool.cc:224] Handling call
0709 12:22:09.042999 (+ 10059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.041589  8138 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:09.046101  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:09.046932  8138 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:09.048691  8110 connection.cc:256] RPC call timeout handler was delayed by -1.9348023739999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:22:09.051115  8110 connection.cc:256] RPC call timeout handler was delayed by -1.9261133439999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:22:08.867221  8731 leader_election.cc:336] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.523s (SENT)
I20260709 12:22:09.044790  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:08.895574 10533 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.000s
I20260709 12:22:08.908105 10576 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:08.898101 10582 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.014s	user 0.011s	sys 0.000s
I20260709 12:22:09.126119 10576 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:09.126655 10582 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:09.127823  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2552) took 1969 ms (client timeout 1551 ms). Trace:
I20260709 12:22:08.886713 10621 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.128824 10533 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.130251 10621 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:08.866724 10663 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.133574 10663 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.135939 10582 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:08.893328 10681 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.150256  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.150641  8213 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:22:08.729744 10683 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:09.159155  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.127838 10576 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.160818 10576 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.161092  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.163543  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.165972  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 516) took 2119 ms. Trace:
I20260709 12:22:09.166455  8762 rpcz_store.cc:276] 0709 12:22:07.046848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.047141 (+   293us) service_pool.cc:224] Handling call
0709 12:22:07.047539 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.191778 (+144239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.165307 (+1973529us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54006702d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:09.165693 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255396736}
I20260709 12:22:08.814785 10686 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.169328  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.169397 10686 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.170836  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.171254  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:08.915020 10694 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:09.173048 10694 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:09.173228  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.174135  8061 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:09.174638  8138 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:09.174551 10694 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:08.813470 10695 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.173060  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:08.878842 10701 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.049144  8139 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:09.181293  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.176127  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.182384  8139 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:08.911440 10702 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:08.836762 10699 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:08.904909 10700 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.199s	user 0.000s	sys 0.015s
I20260709 12:22:08.903527 10704 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:08.833570 10714 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.083690  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:09.084411 10680 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:09.084946 10599 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.086083 10697 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:09.087550  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.088459 10705 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:09.089021  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62479.9us
I20260709 12:22:09.089218 10669 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:09.089625  8759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.003s	sys 0.010s
W20260709 12:22:09.098278  8142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1314) took 1708 ms (client timeout 1518 ms). Trace:
I20260709 12:22:09.105594  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:09.105857  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84645.6us
W20260709 12:22:09.106545 10163 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 12:22:09.107403  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:09.108753  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 241379us
I20260709 12:22:09.108832  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.109938 10723 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:09.110666 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.608s	user 0.015s	sys 0.015s
I20260709 12:22:09.118775  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1296) took 1786 ms. Trace:
W20260709 12:22:09.120995  8146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1308) took 1733 ms (client timeout 1632 ms). Trace:
I20260709 12:22:09.123637  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:08.913704 10665 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:09.138247  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:09.126489  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1302) took 1193 ms (client timeout 1521 ms). Trace:
W20260709 12:22:09.128402  8217 rpcz_store.cc:269] 0709 12:22:07.158296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.160585 (+  2289us) service_pool.cc:224] Handling call
0709 12:22:09.127325 (+1966740us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54002b4654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.127601 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34063744}
I20260709 12:22:09.178390  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:09.164611  8216 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:09.184619  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:09.191371  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 139556us
I20260709 12:22:09.224900  8138 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:09.203859  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:09.232450  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 224352us
I20260709 12:22:09.689657  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 400) took 1203 ms. Trace:
W20260709 12:22:09.578611  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.690225  8138 rpcz_store.cc:276] 0709 12:22:08.486079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.175617 (+689538us) service_pool.cc:224] Handling call
0709 12:22:09.689590 (+513973us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:09.504892  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.505149  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.689675  8141 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:09.676240  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.697631  8067 raft_consensus.cc:2410] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:22:09.270361  8064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 329) took 2048 ms (client timeout 2538 ms). Trace:
I20260709 12:22:09.274598  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1289) took 1429 ms. Trace:
W20260709 12:22:09.688243  8146 rpcz_store.cc:269] 0709 12:22:07.387765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.858893 (+471128us) service_pool.cc:224] Handling call
0709 12:22:09.120463 (+1261570us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54000528d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.120757 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118879616}
W20260709 12:22:09.269446  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1312) took 1880 ms (client timeout 1756 ms). Trace:
I20260709 12:22:09.296734  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1298) took 1448 ms. Trace:
I20260709 12:22:09.268939  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1295) took 1421 ms. Trace:
I20260709 12:22:09.692225  8140 rpcz_store.cc:276] 0709 12:22:07.332345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.332484 (+   139us) service_pool.cc:224] Handling call
0709 12:22:07.332806 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.917479 (+584673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.118132 (+1200653us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001c2ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:09.118495 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321506688}
W20260709 12:22:09.690073  8142 rpcz_store.cc:269] 0709 12:22:07.389877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.398547 (+  8670us) service_pool.cc:224] Handling call
0709 12:22:09.097781 (+1699234us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54002f1554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.098007 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154432896}
W20260709 12:22:09.196798 10676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.279s	user 0.015s	sys 0.015s
W20260709 12:22:09.510836  8145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1315) took 2120 ms (client timeout 1886 ms). Trace:
I20260709 12:22:09.702010  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1311) took 1524 ms. Trace:
W20260709 12:22:09.701990  8064 rpcz_store.cc:269] 0709 12:22:07.221743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.221852 (+   109us) service_pool.cc:224] Handling call
0709 12:22:09.269941 (+2048089us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54001f7f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.270152 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792644864}
W20260709 12:22:09.706175  8137 rpcz_store.cc:269] 0709 12:22:07.389149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.870323 (+481174us) service_pool.cc:224] Handling call
0709 12:22:09.269049 (+1398726us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400352854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.269257 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687075712}
I20260709 12:22:09.706526  8213 rpcz_store.cc:276] 0709 12:22:07.852750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.976913 (+124163us) service_pool.cc:224] Handling call
0709 12:22:09.149866 (+1172953us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:09.158100 (+  8234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.296452 (+138352us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002b4650. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.296641 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672676224}
W20260709 12:22:09.635058 10287 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.132s	user 0.014s	sys 0.006s
I20260709 12:22:09.512717 10534 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:09.692539  8215 rpcz_store.cc:269] 0709 12:22:07.932480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.971803 (+ 39323us) service_pool.cc:224] Handling call
0709 12:22:09.125964 (+1154161us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b5400372654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.126228 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86295936}
I20260709 12:22:09.522507 10544 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:09.192894 10663 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:09.490535 10694 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.496724 10533 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:09.709357 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.207s	user 0.019s	sys 0.029s
W20260709 12:22:09.720227  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.698252 10705 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.509972 10488 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.613826 10695 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.516031 10490 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.197266 10686 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:09.679692 10442 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.632797 10475 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:09.725591  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:09.762269  8062 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:22:09.709555  8759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.003s	sys 0.022s
I20260709 12:22:09.698138 10723 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:09.728819  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:09.718781 10676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.816s	user 0.015s	sys 0.032s
W20260709 12:22:09.713294  8145 rpcz_store.cc:269] 0709 12:22:07.390151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.897213 (+507062us) service_pool.cc:224] Handling call
0709 12:22:09.510432 (+1613219us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002f0b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.510635 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309459840}
I20260709 12:22:09.717516  8216 rpcz_store.cc:276] 0709 12:22:08.163557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.160375 (+996818us) service_pool.cc:224] Handling call
0709 12:22:09.687845 (+527470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.732448  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.711869 10163 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.702194  8212 rpcz_store.cc:276] 0709 12:22:07.845230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.845705 (+   475us) service_pool.cc:224] Handling call
0709 12:22:07.972516 (+126811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.972712 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.972738 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:07.972779 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:07.972810 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.972862 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.274156 (+1301294us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b540017c0d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.274412 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194506880}
I20260709 12:22:09.619498 10621 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:09.733852  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:09.734575  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.767484  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.767915  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.722059  8065 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.730125  8066 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:09.730707  8144 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:09.769452  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 416) took 1190 ms. Trace:
I20260709 12:22:09.259402 10698 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:09.740798  8069 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:22:09.770665  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.741465  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:09.771072  8110 connection.cc:256] RPC call timeout handler was delayed by -1.3401717879996795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2889s for a response
I20260709 12:22:09.742815  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:09.743342  8035 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.287s (SENT)
I20260709 12:22:09.747216  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa46cdee469046e0a85f4a03d2e03f92 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:09.723330 10544 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:09.749061 10747 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:09.750083 10704 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.748977  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.751221 10639 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.754657 10714 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.754741  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.756063  8139 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.586156  7965 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.706889  8214 rpcz_store.cc:276] 0709 12:22:07.847096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.892171 (+ 45075us) service_pool.cc:224] Handling call
0709 12:22:07.892524 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:07.905259 (+ 12735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.905294 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:07.905941 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 12:22:08.598843 (+692902us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:08.906724 (+307881us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b48000b0c58. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:09.227228 (+320504us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.266856 (+ 39628us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.268199 (+  1343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.268342 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.268508 (+   166us) raft_consensus.cc:1685] finished
0709 12:22:09.268523 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.268729 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":563938,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":106,"raft.queue_time_us":55316,"raft.run_cpu_time_us":26137,"raft.run_wall_time_us":937543,"spinlock_wait_cycles":48475520,"thread_start_us":1142183,"threads_started":2,"wal-append.queue_time_us":960051}
W20260709 12:22:09.742323  8731 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.540s (SENT)
I20260709 12:22:09.769766  8144 rpcz_store.cc:276] 0709 12:22:08.579388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.137434 (+558046us) service_pool.cc:224] Handling call
0709 12:22:09.769392 (+631958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.772961  8145 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:09.779560  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.735841 10705 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.774865  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:09.785926  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.780200  8068 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.785048  8141 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:09.787680  8146 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:09.788657  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.788923  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.789809  8217 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:09.790275  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1309) took 1627 ms. Trace:
I20260709 12:22:09.790611  8217 rpcz_store.cc:276] 0709 12:22:08.162918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.766212 (+1603294us) service_pool.cc:224] Handling call
0709 12:22:09.790191 (+ 23979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.791602  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.793320  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.794173  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:09.794945  8067 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.795523  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:09.796911  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:09.797183  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:09.797675  8069 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:09.797995  8764 raft_consensus.cc:2368] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:09.798908  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.799733  8764 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:09.796947 10639 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.764706 10723 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:09.801487  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 412) took 1248 ms. Trace:
I20260709 12:22:09.801852  8140 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:09.801888  8141 rpcz_store.cc:276] 0709 12:22:08.553612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.720367 (+1166755us) service_pool.cc:224] Handling call
0709 12:22:09.801429 (+ 81062us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:09.793503  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50270.6us
W20260709 12:22:09.803258  8035 connection.cc:256] RPC call timeout handler was delayed by -2.1355148239999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:22:09.803427  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 417) took 1115 ms. Trace:
W20260709 12:22:09.803627  8035 connection.cc:256] RPC call timeout handler was delayed by -2.064977397000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 12:22:09.803814  8146 rpcz_store.cc:276] 0709 12:22:08.688569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.733715 (+1045146us) service_pool.cc:224] Handling call
0709 12:22:09.803368 (+ 69653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.805554  8219 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:09.789819  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.806059  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1301) took 2428 ms. Trace:
I20260709 12:22:09.806442  8145 rpcz_store.cc:276] 0709 12:22:07.357907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.765575 (+2407668us) service_pool.cc:224] Handling call
0709 12:22:09.766020 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.784326 (+ 18306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.786390 (+  2064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.801000  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.809512  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 415) took 1241 ms. Trace:
I20260709 12:22:09.809885  8140 rpcz_store.cc:276] 0709 12:22:08.567941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.742481 (+1174540us) service_pool.cc:224] Handling call
0709 12:22:09.809447 (+ 66966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.794219  8756 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:09.774077 10490 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:09.800451  8758 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:09.818682  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.807943  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:09.820142  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1305) took 1651 ms (client timeout 2199 ms). Trace:
W20260709 12:22:09.820572  8215 rpcz_store.cc:269] 0709 12:22:08.161493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.763025 (+1601532us) service_pool.cc:224] Handling call
0709 12:22:09.812297 (+ 49272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.812659  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 401) took 1326 ms. Trace:
I20260709 12:22:09.821447  8137 rpcz_store.cc:276] 0709 12:22:08.486341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.754421 (+1268080us) service_pool.cc:224] Handling call
0709 12:22:09.812576 (+ 58155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:09.814678  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.812222  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47781us
I20260709 12:22:09.728574 10287 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.794966  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.831598  8138 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:09.832297  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 419) took 1105 ms. Trace:
I20260709 12:22:09.832687  8138 rpcz_store.cc:276] 0709 12:22:08.730524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.732023 (+1001499us) service_pool.cc:224] Handling call
0709 12:22:09.832231 (+100208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.833633  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.839344  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.839869  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1319) took 1395 ms. Trace:
I20260709 12:22:09.845674  8216 rpcz_store.cc:276] 0709 12:22:08.444568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.777452 (+1332884us) service_pool.cc:224] Handling call
0709 12:22:09.839798 (+ 62346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.847594  8138 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:09.847944  8137 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:09.849007  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1316) took 2458 ms. Trace:
I20260709 12:22:09.849491  8137 rpcz_store.cc:276] 0709 12:22:07.390422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.839555 (+2449133us) service_pool.cc:224] Handling call
0709 12:22:09.847406 (+  7851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.848677 (+  1271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.848934 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.851567  8137 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:09.852836 10704 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.808241 10475 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.857317  8144 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:09.858091  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1382) took 2497 ms. Trace:
I20260709 12:22:09.858505 10475 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:09.858417  8144 rpcz_store.cc:276] 0709 12:22:07.360417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.808996 (+2448579us) service_pool.cc:224] Handling call
0709 12:22:09.856986 (+ 47990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.857747 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.857922 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.859159 10475 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.859663 10475 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.860752  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.847973  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.861944  8214 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:09.862149  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.863255  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.863555  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.848255  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1317) took 2457 ms. Trace:
I20260709 12:22:09.864800  8138 rpcz_store.cc:276] 0709 12:22:07.390717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.833471 (+2442754us) service_pool.cc:224] Handling call
0709 12:22:09.847230 (+ 13759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.847961 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.848183 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.869529  7967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 266) took 10855 ms. Trace:
I20260709 12:22:09.844324  8066 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:09.873350  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68263.1us
I20260709 12:22:09.873562  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.874269  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:09.874771  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.875685  8066 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:09.876825  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:09.876951 10721 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:09.876999  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.877588 10721 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.878041 10721 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.878891  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.852444  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 399) took 1366 ms. Trace:
I20260709 12:22:09.824123 10621 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.880595  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.880971 10699 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:09.893127  8214 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:09.894145  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.847416  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.897183 10747 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.884819 10244 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.881356  8062 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:09.898736 10244 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.899441 10647 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:09.899703  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:09.884346  8137 rpcz_store.cc:276] 0709 12:22:08.485759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.850586 (+1364827us) service_pool.cc:224] Handling call
0709 12:22:09.851200 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.852106 (+   906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.852350 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.895354  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.893258 10699 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.835630  7965 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.905109 10699 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.905697 10621 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:09.906404 10621 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:09.906224  7965 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:09.907387 10621 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:09.908802  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:09.909529 10740 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:22:09.910872 10742 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:09.911298 10742 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:09.911545  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1295) took 2587 ms. Trace:
I20260709 12:22:09.911911  8143 rpcz_store.cc:276] 0709 12:22:07.324298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.326052 (+  1754us) service_pool.cc:224] Handling call
0709 12:22:07.326499 (+   447us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:08.502161 (+1175662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.502213 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:09.116484 (+614271us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b2c00010c48. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:09.118213 (+  1729us) log.cc:844] Serialized 78 byte log entry
0709 12:22:09.491972 (+373759us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:09.492046 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.596218 (+104172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.911067 (+314849us) raft_consensus.cc:1685] finished
0709 12:22:09.911090 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.911346 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127965,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":10521856,"thread_start_us":1423217,"threads_started":2,"wal-append.queue_time_us":540035}
I20260709 12:22:09.916695  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.915370 10699 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:09.918917  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62024.1us
I20260709 12:22:09.920888  8214 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:09.920394 10698 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:09.921322  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 179128us
W20260709 12:22:09.922992  8731 connection.cc:256] RPC call timeout handler was delayed by -1.0691749650004567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 12:22:09.923105 10699 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:09.925040 10626 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:09.926367  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.927352  8763 raft_consensus.cc:2368] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6.
I20260709 12:22:09.929301 10702 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.930115 10702 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:09.930506 10702 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:09.931536 10702 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.918146 10287 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:09.933231  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56661.5us
I20260709 12:22:09.937589 10639 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:09.938408  8064 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:09.885917  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.939675  8756 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:09.940701  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:09.941905  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.942700 10676 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.943096  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.901459  8062 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:09.943943  8062 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 2
I20260709 12:22:09.944182  8062 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:09.944469  8062 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:09.860034  8144 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:09.946645  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 405) took 1459 ms. Trace:
I20260709 12:22:09.946980  8144 rpcz_store.cc:276] 0709 12:22:08.487427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.859335 (+1371908us) service_pool.cc:224] Handling call
0709 12:22:09.859735 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.946411 (+ 86676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.946589 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.947481  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:09.943512 10676 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.869944  7967 rpcz_store.cc:276] 0709 12:21:59.014024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.016716 (+  2692us) service_pool.cc:224] Handling call
0709 12:22:09.869292 (+10852576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:03.465293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:03.466063 (+   770us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:03.466119 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:22:03.466139 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:03.467330 (+  1191us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:03.467453 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:03.467482 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:22:03.498524 (+ 31042us) tablet.cc:701] Row locks acquired
0709 12:22:03.542826 (+ 44302us) write_op.cc:260] PREPARE: finished
0709 12:22:03.573033 (+ 30207us) write_op.cc:270] Start()
0709 12:22:03.633521 (+ 60488us) write_op.cc:276] Timestamp: P: 1783599723564963 usec, L: 0
0709 12:22:03.637116 (+  3595us) op_driver.cc:348] REPLICATION: starting
0709 12:22:03.713415 (+ 76299us) log.cc:844] Serialized 4441 byte log entry
0709 12:22:04.920271 (+1206856us) op_driver.cc:464] REPLICATION: finished
0709 12:22:05.350329 (+430058us) write_op.cc:301] APPLY: starting
0709 12:22:05.350469 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:05.350810 (+   341us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:05.350951 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:05.473988 (+123037us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:05.475880 (+  1892us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:22:05.475935 (+    55us) write_op.cc:312] APPLY: finished
0709 12:22:05.476280 (+   345us) log.cc:844] Serialized 83 byte log entry
0709 12:22:05.486483 (+ 10203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:05.544191 (+ 57708us) write_op.cc:454] Released schema lock
0709 12:22:05.558525 (+ 14334us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:05.721088 (+162563us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:05.731024 (+  9936us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105673,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":358999,"apply.run_cpu_time_us":11382,"apply.run_wall_time_us":367537,"num_ops":11,"prepare.queue_time_us":108098,"prepare.run_cpu_time_us":19970,"prepare.run_wall_time_us":628250,"raft.queue_time_us":339711,"raft.run_cpu_time_us":37459,"raft.run_wall_time_us":270197,"replication_time_us":1197014,"thread_start_us":794656,"threads_started":4,"wal-append.queue_time_us":747731,"wal-append.run_cpu_time_us":77698,"wal-append.run_wall_time_us":2387723}]]}
W20260709 12:22:09.956570  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1329) took 1376 ms (client timeout 1538 ms). Trace:
W20260709 12:22:09.957062  8219 rpcz_store.cc:269] 0709 12:22:08.580038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.041654 (+461616us) service_pool.cc:224] Handling call
0709 12:22:09.956358 (+914704us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540014ee54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:09.956493 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753740544}
I20260709 12:22:09.958293  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.959116  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1322) took 1479 ms. Trace:
I20260709 12:22:09.959424  8219 rpcz_store.cc:276] 0709 12:22:08.479778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.957937 (+1478159us) service_pool.cc:224] Handling call
0709 12:22:09.959055 (+  1118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.928274  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.886809  8761 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
W20260709 12:22:09.848052  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 264368us
W20260709 12:22:09.966022 10737 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.319s	user 0.003s	sys 0.000s
I20260709 12:22:09.889117  8762 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:09.887742  8035 connection.cc:256] RPC call timeout handler was delayed by -1.8240805079999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 12:22:09.969394  8035 connection.cc:256] RPC call timeout handler was delayed by -1.7679773970003225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 12:22:09.969784  8035 connection.cc:256] RPC call timeout handler was delayed by -1.7265773970002556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:22:09.886500  8141 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:09.970118  8035 connection.cc:256] RPC call timeout handler was delayed by -1.5969773970005008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2383s for a response
W20260709 12:22:09.970494  8035 connection.cc:256] RPC call timeout handler was delayed by -1.4557792070004325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:22:09.892225  8068 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:09.909541  8216 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:09.900640  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:09.970896  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2768844659999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:22:09.976805  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2354844659998889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:22:09.977105  8035 connection.cc:256] RPC call timeout handler was delayed by -1.068961099000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 12:22:09.977380  8035 connection.cc:256] RPC call timeout handler was delayed by -1.0536610990002373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:22:09.907821  7965 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 5, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.885645  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1306) took 2498 ms. Trace:
I20260709 12:22:09.890424  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2539) took 2649 ms. Trace:
I20260709 12:22:09.881975  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:09.985127  8140 rpcz_store.cc:276] 0709 12:22:07.387046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.816695 (+2429649us) service_pool.cc:224] Handling call
0709 12:22:09.885042 (+ 68347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.885300 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.885331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:09.885376 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:09.885409 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.885464 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.885586 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.960333  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.864418  8063 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:09.944376  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:09.900103 10647 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:09.993032  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1388) took 2608 ms. Trace:
I20260709 12:22:09.993472  8141 rpcz_store.cc:276] 0709 12:22:07.362510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.808937 (+2446427us) service_pool.cc:224] Handling call
0709 12:22:09.886240 (+ 77303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.970362 (+ 84122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.970549 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.994864  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.999289  8067 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:10.000998  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1326) took 1420 ms. Trace:
I20260709 12:22:09.876438  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.002099  8069 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:09.889799  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.009876  8215 rpcz_store.cc:276] 0709 12:22:08.566733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.832349 (+1265616us) service_pool.cc:224] Handling call
0709 12:22:09.986896 (+154547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.010103  8066 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:22:10.005839  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.013310  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1325) took 1465 ms. Trace:
I20260709 12:22:10.007377  8764 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:10.013743  8217 rpcz_store.cc:276] 0709 12:22:08.547816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.792619 (+1244803us) service_pool.cc:224] Handling call
0709 12:22:10.013244 (+220625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:09.779055 10599 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:09.890959 10163 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.011087  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.011710  7965 catalog_manager.cc:5697] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:10.021029  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 136942us
I20260709 12:22:10.017215  8139 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:10.187717  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:10.079751  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.236050  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:10.230486  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 77454.9us
I20260709 12:22:10.236558  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 407) took 1748 ms. Trace:
I20260709 12:22:10.238144  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 411) took 1724 ms. Trace:
I20260709 12:22:10.238657  8143 rpcz_store.cc:276] 0709 12:22:08.513702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.913824 (+1400122us) service_pool.cc:224] Handling call
0709 12:22:09.977969 (+ 64145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.213053 (+235084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.213098 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.237769 (+ 24671us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:10.237832 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.237919 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.238073 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.244277  8756 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:10.244477 10742 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.246012  8756 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:10.246361 10742 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:10.247471  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.248788  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.986011  8220 rpcz_store.cc:276] 0709 12:22:07.133334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.144800 (+ 11466us) service_pool.cc:224] Handling call
0709 12:22:07.148265 (+  3465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.148747 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.148789 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.157026 (+  8237us) log.cc:844] Serialized 26 byte log entry
0709 12:22:07.369646 (+212620us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:07.369686 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.369752 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:08.904331 (+1534579us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:09.733143 (+828812us) raft_consensus.cc:1685] finished
0709 12:22:09.738693 (+  5550us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.783143 (+ 44450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50176,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":8008,"spinlock_wait_cycles":55741312,"thread_start_us":212231,"threads_started":1,"wal-append.queue_time_us":274177}
I20260709 12:22:10.249621  8067 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:22:10.237030  8731 leader_election.cc:336] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.746s (SENT)
I20260709 12:22:10.236981  8139 rpcz_store.cc:276] 0709 12:22:08.488014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.196798 (+708784us) service_pool.cc:224] Handling call
0709 12:22:10.236489 (+1039691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.230506  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:10.253566  8063 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:10.229872  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1303) took 2843 ms. Trace:
I20260709 12:22:10.259807  8216 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:10.259718  8146 rpcz_store.cc:276] 0709 12:22:07.386088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.817426 (+2431338us) service_pool.cc:224] Handling call
0709 12:22:10.188568 (+371142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.229482 (+ 40914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.229508 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.229569 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:10.229603 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.229668 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.229790 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.271567  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:09.974746 10490 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:10.291124  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.291354 10695 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:10.291844  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.292822 10490 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.293804  7965 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:10.295545  8109 connection.cc:256] RPC call timeout handler was delayed by -1.8594972830001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 12:22:10.295974  8109 connection.cc:256] RPC call timeout handler was delayed by -1.1985662770002818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 12:22:10.297225  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.295754  7965 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.299384  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.299117  7965 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.301106  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1324) took 1768 ms. Trace:
I20260709 12:22:10.301482  8216 rpcz_store.cc:276] 0709 12:22:08.532658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.005485 (+1472827us) service_pool.cc:224] Handling call
0709 12:22:10.301027 (+295542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.301249  7965 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:10.302475 10599 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:10.303169 10695 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:10.303900 10695 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:10.303330  7965 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 5, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.304847  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:10.305639 10490 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:10.305172  7965 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:10.306123 10490 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:10.307428  8067 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:10.306816  7965 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:10.307147 10490 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.089203  8760 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:10.309320  8140 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:22:10.311717  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 458558us
I20260709 12:22:10.309062  8212 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:10.152915  8219 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:10.314864  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1320) took 1863 ms. Trace:
W20260709 12:22:10.315428  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.315793  8219 rpcz_store.cc:276] 0709 12:22:08.451339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.960024 (+1508685us) service_pool.cc:224] Handling call
0709 12:22:10.314753 (+354729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.014077 10287 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.322881  8067 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:10.320245  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:09.889590 10544 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.300238 10723 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.335584  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:10.332607  8065 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 12:22:10.337298  8213 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:10.338634  8065 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
W20260709 12:22:10.339991  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1313) took 2175 ms (client timeout 2239 ms). Trace:
I20260709 12:22:10.329442  8061 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:22:10.340581  8213 rpcz_store.cc:269] 0709 12:22:08.164204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.084558 (+1920354us) service_pool.cc:224] Handling call
0709 12:22:10.339937 (+255379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.341858  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:10.342602  8213 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:10.343650  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:10.347158  8068 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:10.349743  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:10.350992  8065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1461) took 1175 ms (client timeout 1504 ms). Trace:
W20260709 12:22:10.351526  8065 rpcz_store.cc:269] 0709 12:22:09.175434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.178015 (+  2581us) service_pool.cc:224] Handling call
0709 12:22:10.350914 (+1172899us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:10.356302  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 349869us
I20260709 12:22:10.331089 10686 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.334044 10695 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:10.357745  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:10.370659  8215 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:10.374573  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2563) took 1324 ms. Trace:
I20260709 12:22:10.375093  8215 rpcz_store.cc:276] 0709 12:22:09.050503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.113321 (+1062818us) service_pool.cc:224] Handling call
0709 12:22:10.374481 (+261160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.379347  8067 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:10.379889  8067 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:10.382580  8065 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:10.387686  8035 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.521s (SENT)
I20260709 12:22:10.388142  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:10.389904  8035 leader_election.cc:336] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.538s (SENT)
I20260709 12:22:10.390697  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:10.333086 10287 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:10.398278  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 161294us
W20260709 12:22:10.401396  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81345.2us
I20260709 12:22:10.367969 10163 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:10.365514 10695 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:10.391988  8109 leader_election.cc:400] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:10.405642  8109 leader_election.cc:403] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:10.419128  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1301) took 2541 ms. Trace:
I20260709 12:22:10.419646  8217 rpcz_store.cc:276] 0709 12:22:07.862443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.309431 (+2446988us) service_pool.cc:224] Handling call
0709 12:22:10.339798 (+ 30367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.402473 (+ 62675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.402516 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.402583 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:10.402635 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.402766 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.402916 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.359026 10599 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:10.406306  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.427181  8219 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:22:10.435248  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 96528.6us
W20260709 12:22:10.418629 10705 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
W20260709 12:22:10.439584  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 146582us
I20260709 12:22:10.426848 10749 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.445951  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.429136  7965 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:10.448442  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:10.443435  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1312) took 2279 ms (client timeout 2383 ms). Trace:
W20260709 12:22:10.449868  8212 rpcz_store.cc:269] 0709 12:22:08.163882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.779858 (+1615976us) service_pool.cc:224] Handling call
0709 12:22:10.443196 (+663338us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000ca3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:10.443353 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194892672}
I20260709 12:22:10.451572  8212 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:22:10.451889  8212 pending_rounds.cc:85] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:22:10.452152  8212 pending_rounds.cc:107] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:10.406111 10163 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:10.452055  7965 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 4 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:10.452829 10163 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.453935  7965 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.455667  7965 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 3 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.459692  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1314) took 2295 ms. Trace:
I20260709 12:22:10.503468  8217 rpcz_store.cc:276] 0709 12:22:08.164512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.440712 (+2276200us) service_pool.cc:224] Handling call
0709 12:22:10.459050 (+ 18338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.459346 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.459369 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.459411 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:10.459443 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.459492 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.459619 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.504799  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:10.505586  8217 raft_consensus.cc:606] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.506008  8217 raft_consensus.cc:614] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:10.427613 10576 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.461305 10244 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.452435  8212 raft_consensus.cc:2889] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:10.508920  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1316) took 2214 ms. Trace:
I20260709 12:22:10.509279  8212 rpcz_store.cc:276] 0709 12:22:08.294276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.450714 (+2156438us) service_pool.cc:224] Handling call
0709 12:22:10.451120 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.508603 (+ 57483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.508830 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.510972  8212 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:10.418828 10695 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:10.449796 10705 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.464821  8215 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:10.465484  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72061.5us
I20260709 12:22:10.447307 10475 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.397790 10686 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.426137 10647 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.471565  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:10.484939  8731 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.764s (SENT)
W20260709 12:22:10.485339  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.526532  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.527132  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.485004  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 151686us
I20260709 12:22:10.474900 10698 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:10.488206  8220 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:22:10.482986  8067 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.406098 10442 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:10.511617  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1321) took 2047 ms. Trace:
I20260709 12:22:10.536005  8212 rpcz_store.cc:276] 0709 12:22:08.464555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.510137 (+2045582us) service_pool.cc:224] Handling call
0709 12:22:10.510528 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.511357 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.511547 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.445501 10749 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.523970  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1310) took 2353 ms. Trace:
I20260709 12:22:10.512275  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 368) took 3109 ms. Trace:
W20260709 12:22:10.489182  8036 connection.cc:256] RPC call timeout handler was delayed by -1.5415185319998272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:22:10.528689  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 84076.3us
I20260709 12:22:10.533667  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1307) took 2371 ms. Trace:
I20260709 12:22:10.526226  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:10.543488  8036 connection.cc:256] RPC call timeout handler was delayed by -1.1344183900000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:22:10.539623  8217 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:10.543700  8220 rpcz_store.cc:276] 0709 12:22:08.162294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.392614 (+2230320us) service_pool.cc:224] Handling call
0709 12:22:10.475640 (+ 83026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:10.533312 (+ 57672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.533583 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.544320  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2553) took 1540 ms. Trace:
I20260709 12:22:10.539242  8215 rpcz_store.cc:276] 0709 12:22:08.163242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.393473 (+2230231us) service_pool.cc:224] Handling call
0709 12:22:10.443217 (+ 49744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.516159 (+ 72942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.516436 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.544739  8217 rpcz_store.cc:276] 0709 12:22:09.004566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.513754 (+1509188us) service_pool.cc:224] Handling call
0709 12:22:10.527719 (+ 13965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.544037 (+ 16318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.544262 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:10.527665 10714 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.532248 10475 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:10.507797 10576 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.530355 10698 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:10.552192  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118425us
I20260709 12:22:10.490017 10599 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.554677  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:10.528944 10676 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.546455  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.561879  8067 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.561826  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:10.562831 10694 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.797s	user 0.002s	sys 0.008s
I20260709 12:22:10.563012  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.563473 10694 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.564781  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.565727 10751 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.566120 10599 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.566347 10576 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.566708  8065 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:10.568747 10759 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:10.569125 10534 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.005s
I20260709 12:22:10.549906 10287 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.569829 10705 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:10.564013 10694 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:10.550922 10488 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.001s
I20260709 12:22:10.575647  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.552985 10723 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.553530 10475 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:10.575021 10754 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:22:10.570631 10647 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:10.570883 10698 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.573494 10722 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.587116  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 410) took 2075 ms. Trace:
I20260709 12:22:10.588025 10699 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:10.604450 10699 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:10.598512 10722 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.591053  8212 raft_consensus.cc:606] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:10.603722  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.595211 10599 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:10.601327 10755 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:10.618505  8212 raft_consensus.cc:614] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:10.633674  8213 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:22:10.625063  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 146525us
W20260709 12:22:10.592499  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 202684us
I20260709 12:22:10.589707 10475 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:10.643460  8219 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
W20260709 12:22:10.647135  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 84252.7us
I20260709 12:22:10.648443  8063 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:10.649310  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.622107 10639 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:10.650417  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:10.641188  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 87081.7us
I20260709 12:22:10.658862  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1460) took 1472 ms. Trace:
I20260709 12:22:10.595711  8137 rpcz_store.cc:276] 0709 12:22:08.507492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.901991 (+1394499us) service_pool.cc:224] Handling call
0709 12:22:09.902730 (+   739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.903155 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:10.363333 (+460178us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.582171 (+218838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.582231 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:10.582277 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.582368 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.583238 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":579013,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":602673,"threads_started":3}
I20260709 12:22:10.668310  8069 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:10.668655  8067 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:10.669786  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:10.659518  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46757.6us
I20260709 12:22:10.670624  8067 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:10.660655  8061 rpcz_store.cc:276] 0709 12:22:09.175049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.191387 (+ 16338us) service_pool.cc:224] Handling call
0709 12:22:09.490825 (+299438us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:22:09.653113 (+162288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.653162 (+    49us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:22:09.726446 (+ 73284us) log.cc:844] Serialized 642 byte log entry
0709 12:22:10.006761 (+280315us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:10.643158 (+636397us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.646470 (+  3312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.646546 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.646587 (+    41us) raft_consensus.cc:1685] finished
0709 12:22:10.646599 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.647070 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9062,"raft.queue_time_us":2335,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":54292,"thread_start_us":225256,"threads_started":1,"wal-append.queue_time_us":635076}
I20260709 12:22:10.674552  8068 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:10.617795 10699 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:10.679771 10756 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:22:10.680102 10705 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:10.681605  8184 leader_election.cc:400] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6.
I20260709 12:22:10.681951  8184 leader_election.cc:403] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:10.682643 10488 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6.
I20260709 12:22:10.684399  8211 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:10.684064  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:10.685436  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:10.686062 10442 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:10.686088  8070 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:10.687703  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:10.689098  8035 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.756s (SENT)
I20260709 12:22:10.689520  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:10.690414 10762 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:10.690657  8035 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.817s (SENT)
W20260709 12:22:10.692414  8035 leader_election.cc:336] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.032s (SENT)
I20260709 12:22:10.693398 10769 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:10.693367  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:10.694322 10769 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:10.694463 10762 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:10.695008 10769 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:10.695945  8035 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.045s (SENT)
I20260709 12:22:10.696600  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:10.697299 10721 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.004s
I20260709 12:22:10.697773 10721 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.698200 10762 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:10.699832  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:10.700165  8035 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.095s (SENT)
I20260709 12:22:10.700981  8062 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:10.623718 10599 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:10.702431  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 409) took 2213 ms. Trace:
I20260709 12:22:10.704658  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:10.705451  8070 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:10.617959 10749 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.612545 10747 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.711346  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:10.712081  8070 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.724275  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.724984  8063 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:10.725507  8063 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:10.722289  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52205.7us
W20260709 12:22:10.728339  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.728734 10765 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:10.700486 10721 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.735970  8215 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:10.711656 10766 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:10.710893 10723 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:10.708439 10647 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:10.720124 10442 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:10.739946  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63721.3us
W20260709 12:22:10.743818  8035 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.157s (SENT)
I20260709 12:22:10.747331  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.757345  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.749575 10244 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:22:10.757833 10722 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.759393 10244 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:10.759780 10244 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:10.758308  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.761981  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 413) took 2197 ms. Trace:
I20260709 12:22:10.762423  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:10.762521  8144 rpcz_store.cc:276] 0709 12:22:08.564556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.947821 (+1383265us) service_pool.cc:224] Handling call
0709 12:22:09.948422 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.116788 (+168366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.116837 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.312224 (+195387us) log.cc:844] Serialized 501 byte log entry
0709 12:22:10.521872 (+209648us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:10.521922 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.521984 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.761703 (+239719us) raft_consensus.cc:1685] finished
0709 12:22:10.761729 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.761900 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":159290,"threads_started":1,"wal-append.queue_time_us":324808}
I20260709 12:22:10.764747  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.696221 10769 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.765466  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:10.766260 10647 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:10.767453 10647 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:10.767871 10758 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:22:10.758136  8143 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:10.763592  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:10.776127  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.769629 10665 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:10.765544 10244 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.767899 10647 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:10.787457  8063 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:22:10.790292  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 90516.6us
I20260709 12:22:10.543205  8759 rpcz_store.cc:276] 0709 12:22:07.403185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.419893 (+ 16708us) service_pool.cc:224] Handling call
0709 12:22:07.428492 (+  8599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:07.509346 (+ 80854us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:08.374213 (+864867us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.918802 (+1544589us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.430122 (+511320us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.448350 (+ 18228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.470122 (+ 21772us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:10.483525 (+ 13403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.489616 (+  6091us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.496192 (+  6576us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":800946,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":125,"raft.queue_time_us":108794,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":24233,"thread_start_us":2235380,"threads_started":3,"wal-append.queue_time_us":1096521,"wal-append.run_cpu_time_us":1303,"wal-append.run_wall_time_us":1001252}
I20260709 12:22:10.789340 10686 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.723423 10762 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:22:10.791180 10765 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:10.781340 10751 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5.
I20260709 12:22:10.807734  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.792475 10244 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.796018 10694 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:10.801038 10762 consensus_queue.cc:1243] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:10.810007 10698 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.791862 10695 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.828850 10721 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:10.829118  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.829324 10721 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.829733 10721 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:10.830718 10695 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.807551 10774 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:10.831400 10475 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.792785 10647 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.802376 10765 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:10.833189 10647 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.833786 10475 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.833663 10765 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.835950  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:10.805900  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65897.9us
I20260709 12:22:10.836562  8137 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:10.796277 10599 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.837719  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.838301  8137 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:10.839498  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.806876  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:10.812846 10742 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.003s
I20260709 12:22:10.744125 10163 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.808291  8215 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:10.808665  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67715.4us
W20260709 12:22:10.792582  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 57445.1us
I20260709 12:22:10.813001 10702 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:10.826349  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.840133  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:10.846288  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.792934 10770 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:10.841423  8143 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:10.842103  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:10.842839  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.843387 10475 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:10.844400  8220 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:10.845289  8144 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:10.849083 10770 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.851953 10770 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:10.852330  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:10.854055 10621 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:10.852288  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:10.855708 10742 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:10.856272 10742 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:10.856782 10742 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:10.860932  8141 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:10.862408  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:10.863015  8139 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.862861  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.854086  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:10.865300  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.865638 10695 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:10.866040 10698 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.866216 10695 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:10.843901 10722 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:10.866832 10695 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.866922 10722 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.867465 10722 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:10.870191  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.846707  8137 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:10.848552  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.841116  8070 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:10.846174  8140 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:10.849649  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.870406 10442 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:10.870612  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.854768 10621 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:10.847684  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.809470 10639 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:10.844513 10774 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.885990  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.888276 10757 raft_consensus.cc:2764] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:10.888325  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.889850 10757 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:10.892338  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43766.6us
I20260709 12:22:10.883713 10442 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:10.895720  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51029.4us
I20260709 12:22:10.890413 10757 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:10.898030  8213 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:10.855857 10665 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:22:10.890985 10759 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:10.904115  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:10.892750 10475 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:10.893657 10163 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:10.913569  8141 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:10.919322  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.920413  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:10.921213 10771 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:10.921777 10771 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:10.921586 10639 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.922242 10771 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.924806 10621 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.925398  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:10.891227 10686 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:22:10.901767 10757 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.930585  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.931994  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.932898  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.933350  8760 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:10.887092 10694 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:10.935938  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:10.937665  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.903498 10759 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.906188 10769 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:10.940097  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.940340  8146 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:22:10.940781  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:10.941272  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.941794 10714 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:10.935585 10723 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.942492  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.942404  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:10.943121  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55874.1us
I20260709 12:22:10.946367  8139 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:10.940588  8758 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:10.950831  8146 pending_rounds.cc:85] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:22:10.957176  8146 pending_rounds.cc:107] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:22:10.957427  8146 raft_consensus.cc:2889] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:10.958042  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.937726 10599 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:10.960518  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.963035  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.963454  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:10.963827  8764 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:22:10.961290  8063 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:10.895069 10774 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:10.947232 10759 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:10.964830  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0445400600001449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 12:22:10.902661 10776 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 12:22:10.969697  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0103400600000896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:22:10.955155 10769 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.972215  8756 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:10.965353 10751 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:10.941877 10475 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:10.976358  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1317) took 2600 ms (client timeout 1624 ms). Trace:
I20260709 12:22:10.980432  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:10.961228 10599 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:10.981902  8211 rpcz_store.cc:269] 0709 12:22:08.376373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.579358 (+202985us) service_pool.cc:224] Handling call
0709 12:22:10.974657 (+2395299us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:10.976264 (+  1607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4317317888}
I20260709 12:22:10.703126  8138 rpcz_store.cc:276] 0709 12:22:08.488587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.865770 (+1377183us) service_pool.cc:224] Handling call
0709 12:22:09.866308 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.866678 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:10.314158 (+447480us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.570833 (+256675us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.702051 (+131218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.702107 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:10.702158 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.702223 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.702364 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28334,"prepare.queue_time_us":564592,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":154055,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":18017,"thread_start_us":791629,"threads_started":4,"wal-append.queue_time_us":207483}
I20260709 12:22:10.997421 10721 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.987301  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.000298  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:11.001559  8067 raft_consensus.cc:2368] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:11.000605  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.957921 10723 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:10.980507 10769 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:10.969067  8759 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:22:11.015339  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64086.9us
I20260709 12:22:11.021183  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:10.989564 10599 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.026422  8063 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:10.999662 10721 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.029135  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.029429  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1305) took 3642 ms. Trace:
I20260709 12:22:11.030795  8145 rpcz_store.cc:276] 0709 12:22:07.386777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.813630 (+2426853us) service_pool.cc:224] Handling call
0709 12:22:09.896999 (+ 83369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.991988 (+ 94989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.992047 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:09.992126 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:09.992170 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.029116 (+1036946us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400052dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:11.029184 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.029355 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163620608}
I20260709 12:22:11.033166  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.045047 10722 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.048179 10722 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.049038 10665 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:11.049594 10701 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:11.049702 10442 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.050778  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.051473  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:11.053138  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 166994us
I20260709 12:22:11.065876  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:11.067873  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.068732  8211 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:11.065559  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.070812  8145 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:11.073283  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 104407us
I20260709 12:22:11.069731  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:11.068111  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.080538  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.053690 10665 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.081682  8215 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:11.081897 10665 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.082669  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.083310  8215 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 1.
I20260709 12:22:11.084183  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.085645 10781 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:11.086176 10778 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 12:22:11.089586  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:11.057947 10762 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:11.056294 10751 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:11.092782  8215 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:11.059175 10701 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.100896 10244 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:11.070076 10694 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:11.106170  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.106981  8146 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.118857  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.119143  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:11.119612  8211 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:11.068377 10714 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:11.079011 10621 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:11.123828  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:11.086220 10781 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.126209  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.126209  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.129705  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.068594 10721 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:11.131440  8217 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:11.133586  8211 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:11.116568 10701 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:11.136469  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 200596us
W20260709 12:22:11.141572  8064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1464) took 1965 ms (client timeout 2111 ms). Trace:
I20260709 12:22:11.141804  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:11.142115  8064 rpcz_store.cc:269] 0709 12:22:09.182607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.741032 (+558425us) service_pool.cc:224] Handling call
0709 12:22:11.141343 (+1400311us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54001da6d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.141506 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173230848}
I20260709 12:22:11.119863 10475 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:11.120601 10762 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:11.148146  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.148257  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:11.149556  8070 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:11.149004  8137 raft_consensus.cc:2376] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6. Re-sending same reply.
W20260709 12:22:11.153340  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 95031.4us
I20260709 12:22:11.154091  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.128759 10781 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.134476 10751 raft_consensus.cc:2764] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:11.155368  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:11.128091 10776 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.158916  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.160480 10699 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.162863  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:11.163841 10777 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:11.164003  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:11.164762  8759 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:11.166196  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.168812  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.169523  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.173539  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.174187  8764 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:11.174773  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.168166  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:11.181200  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.175436  8142 raft_consensus.cc:2376] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6. Re-sending same reply.
I20260709 12:22:11.185624  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.189309  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.191093 10723 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.191258  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:11.192970 10786 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:22:11.193748  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.194375  8212 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:11.195258  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 369) took 1199 ms. Trace:
I20260709 12:22:11.195773  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 524) took 1265 ms. Trace:
I20260709 12:22:11.196125  8761 rpcz_store.cc:276] 0709 12:22:09.930298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.964571 (+ 34273us) service_pool.cc:224] Handling call
0709 12:22:10.022684 (+ 58113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.187568 (+164884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.187604 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.187688 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:10.187730 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.187799 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.195590 (+1007791us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54004c2f50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.195695 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113713024}
I20260709 12:22:11.178081 10163 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:11.197024  8213 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:11.195619  8220 rpcz_store.cc:276] 0709 12:22:10.012366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.551638 (+539272us) service_pool.cc:224] Handling call
0709 12:22:10.576926 (+ 25288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.851211 (+274285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.195015 (+343804us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:11.195202 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614552832}
I20260709 12:22:11.201200  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1466) took 1425 ms. Trace:
I20260709 12:22:11.201611  8062 rpcz_store.cc:276] 0709 12:22:09.775866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.945751 (+169885us) service_pool.cc:224] Handling call
0709 12:22:09.946042 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.701646 (+755604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.200960 (+499314us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54002030d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:11.201136 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735552896}
W20260709 12:22:11.202822  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1323) took 2701 ms (client timeout 1564 ms). Trace:
I20260709 12:22:11.187111 10776 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:22:11.203234  8218 rpcz_store.cc:269] 0709 12:22:08.501084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.707119 (+206035us) service_pool.cc:224] Handling call
0709 12:22:11.202473 (+2495354us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.202653 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3878221056}
I20260709 12:22:11.206094  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.206413  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.206813  8140 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:11.210498  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.212229  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.214912 10770 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.215466 10704 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:11.216372 10695 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.176497 10751 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:11.220990  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2562) took 2171 ms (client timeout 2224 ms). Trace:
I20260709 12:22:11.221663 10626 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:11.221962  8216 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 2. Current term is 4. Ops: []
I20260709 12:22:11.222107 10626 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.223382  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1303) took 3253 ms. Trace:
I20260709 12:22:11.223627 10771 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.224970  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.225185 10792 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:11.221416  8214 rpcz_store.cc:269] 0709 12:22:09.050049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.916368 (+866319us) service_pool.cc:224] Handling call
0709 12:22:11.220804 (+1304436us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.220935 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4424960}
I20260709 12:22:11.203892 10742 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.227016  8142 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:11.228145  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.223767  8216 rpcz_store.cc:276] 0709 12:22:07.969731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.302163 (+2332432us) service_pool.cc:224] Handling call
0709 12:22:11.221782 (+919619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.222441 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.223206 (+   765us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001699d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.223329 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113987840}
I20260709 12:22:11.236666  8137 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:11.237005  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:11.241420  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.246047  8142 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:11.183975 10698 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:11.249150  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.249204  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.251297  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:11.251579  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92745.7us
I20260709 12:22:11.258955  8140 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:11.260572  8142 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:22:11.261492  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 90154.4us
W20260709 12:22:11.261607  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51939.4us
I20260709 12:22:11.208206  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:11.263567  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:11.260591  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 86152.4us
I20260709 12:22:11.226621  8759 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:11.270493  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.248378 10698 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.272702  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.258783 10621 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:11.275125  8142 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:11.279997  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.266361 10770 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.285049  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.269758 10765 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:11.280534  8142 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:11.223256 10626 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.292553 10626 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.277230 10698 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.278687 10621 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.187219 10714 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.264101 10757 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.274012  8758 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:11.301254  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.236694 10762 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.312882  8140 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:11.290196 10765 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.276786 10702 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:11.318466 10442 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.319025 10665 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.305338 10621 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:11.342142  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:11.330961  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.310354 10770 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.330673  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:11.320008  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.321586 10765 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.352981  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.394311  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:11.397079  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66538.8us
I20260709 12:22:11.396093  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.406036  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.347035 10770 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.402335  8218 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:11.350620 10475 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:11.424679  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74435.5us
I20260709 12:22:11.427141  8214 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:11.427917  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.430545  8215 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:11.444126  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.319648 10798 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 12:22:11.447235  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.224s (SENT) [suppressed 53 similar messages]
I20260709 12:22:11.353933 10792 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.401856 10742 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.430220 10770 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.429559 10475 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.445806 10695 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:11.487435  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.454921 10771 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.493793  8145 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:11.494477  8140 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
W20260709 12:22:11.493767  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46561.4us
I20260709 12:22:11.500344  8146 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:11.502553  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.468839 10475 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:11.507603  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57492.7us
I20260709 12:22:11.505663  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.495999  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:11.519663  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:11.527911 10799 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:11.544003  8764 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:11.547175  8762 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:22:11.522989 10796 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:22:11.545617  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.515408 10804 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:11.564052  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:11.570063 10739 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.786s	user 0.006s	sys 0.011s
I20260709 12:22:11.570734 10701 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.572098  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 367) took 4169 ms. Trace:
I20260709 12:22:11.572500  8765 rpcz_store.cc:276] 0709 12:22:07.402865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.403798 (+   933us) service_pool.cc:224] Handling call
0709 12:22:07.404167 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:07.414061 (+  9894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.414093 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:09.168466 (+1754373us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c00012668. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:09.169548 (+  1082us) log.cc:844] Serialized 52 byte log entry
0709 12:22:09.597239 (+427691us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:09.782160 (+184921us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.784564 (+  2404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.817539 (+ 32975us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.883573 (+1066034us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b18001c2160. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db
0709 12:22:11.569438 (+685865us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:11.571752 (+  2314us) raft_consensus.cc:1685] finished
0709 12:22:11.571773 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.571933 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218578,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2938,"raft.queue_time_us":9613,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":48625,"spinlock_wait_cycles":60290560,"thread_start_us":546797,"threads_started":2,"wal-append.queue_time_us":548531}
I20260709 12:22:11.589228  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:11.590142  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48998.8us
I20260709 12:22:11.593888  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.583024  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.594789  8145 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.599139  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.588272 10721 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:11.600759  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.601895  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 347) took 1217 ms. Trace:
I20260709 12:22:11.610576  8065 rpcz_store.cc:276] 0709 12:22:10.384162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.405093 (+ 20931us) service_pool.cc:224] Handling call
0709 12:22:11.601752 (+1196659us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54001f7f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:11.601843 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93925760}
W20260709 12:22:11.603807  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 344186us
I20260709 12:22:11.573192 10701 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:11.625031  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.529450 10769 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.626672  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:11.617388 10810 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:11.564240 10792 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.588642 10665 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.592761 10757 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.609229 10723 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:11.645533  8145 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:11.652011  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.652508  8139 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:22:11.632619 10798 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:11.659065  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:11.659917  8070 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.650977  8211 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:11.662199  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:11.656489  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 383236us
I20260709 12:22:11.634918 10721 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:11.664989 10812 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:22:11.666932 10723 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:11.666978  8220 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:11.668860  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:11.653277 10599 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
I20260709 12:22:11.684114 10804 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.687839  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:11.686932  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:11.696334  8070 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:11.695652  8211 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:11.698277 10812 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:11.698591  8220 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:11.698764 10812 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.699807 10812 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.702327 10722 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.703744 10813 raft_consensus.cc:2764] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:11.651436 10811 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:22:11.703975 10751 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:11.657778 10798 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.700312  8220 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:11.706272  8211 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:11.711170  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:11.690100 10766 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:11.730245  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44005.3us
I20260709 12:22:11.732605  8220 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:22:11.686677 10599 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:11.735018  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47291us
I20260709 12:22:11.734807 10721 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.736887 10599 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.736544 10723 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.737371 10818 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:11.737833 10818 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.738171 10818 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:11.738384 10781 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 12:22:11.738776 10781 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.743089 10751 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.743597 10751 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.731163 10771 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.770732 10781 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:11.734848 10804 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.772308  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:11.782625  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50412us
I20260709 12:22:11.710453 10722 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.793433  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.794121  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.796607  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:11.797446  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:11.731606 10766 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.798183 10766 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.799361 10818 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.801611 10818 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:11.792734  8217 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.803128  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.803889  8146 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:11.748637 10812 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:11.795171  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58812.4us
I20260709 12:22:11.805075  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.807108  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.812781  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:11.795603  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59651us
I20260709 12:22:11.809248  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:11.795570 10759 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.803s	user 0.002s	sys 0.010s
I20260709 12:22:11.814400  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:11.788401 10771 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:11.821290  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.814648 10669 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.816658 10701 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:11.817580  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.831935  8763 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:11.820420 10763 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.171s	user 0.005s	sys 0.000s
W20260709 12:22:11.842350  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.837865  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:11.843832 10599 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:11.853946 10599 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:11.855358  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1344) took 1006 ms. Trace:
I20260709 12:22:11.854977 10599 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.856021  8146 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:11.859337  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.859853 10544 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.862689 10647 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:11.863823 10647 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:11.864181 10647 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.864560 10647 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:11.864804  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.865531  8137 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:11.866550 10818 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:11.866962 10818 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.867807 10818 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.869153  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.870539  8141 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:11.853200  8764 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:11.807988 10813 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:11.808280 10742 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:11.866593  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:11.881589  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.873621  8145 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:11.855804  8139 rpcz_store.cc:276] 0709 12:22:10.848829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.959386 (+110557us) service_pool.cc:224] Handling call
0709 12:22:10.968327 (+  8941us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:11.653026 (+684699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.855053 (+202027us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54000519d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:11.855292 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572832640}
W20260709 12:22:11.874758  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62095.4us
I20260709 12:22:11.882958  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:11.883913  8145 pending_rounds.cc:85] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 1
I20260709 12:22:11.884280  8145 pending_rounds.cc:107] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:11.884649  8145 raft_consensus.cc:2889] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:11.882989  8109 leader_election.cc:400] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:11.886565  8109 leader_election.cc:403] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.882730  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:11.855291 10626 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
I20260709 12:22:11.889273  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.810640 10808 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:11.889986  8146 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:11.820572 10781 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:11.832849 10771 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.897861  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:11.899398  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:11.944245  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 92782.4us
W20260709 12:22:11.896323 10698 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.003s
I20260709 12:22:11.945487  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:11.903533 10806 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
W20260709 12:22:11.947764  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66686us
I20260709 12:22:11.941170 10669 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.941354 10769 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:11.883560 10813 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:11.822726 10475 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:11.895546 10695 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:11.966979  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:11.792701 10798 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.969714  8145 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:11.895668 10702 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:11.880911 10742 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:12.051343  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 153576us
I20260709 12:22:11.895411 10762 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:11.906414 10808 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:11.902144 10442 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:22:11.969312 10818 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:11.902590 10701 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:11.968948 10781 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:11.976132 10805 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:12.043665 10163 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:12.040970  8145 pending_rounds.cc:85] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 2
I20260709 12:22:12.066341  8145 pending_rounds.cc:107] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:12.066679  8145 raft_consensus.cc:2889] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:12.052758 10742 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:11.832470 10759 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:11.964802 10698 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.045603 10824 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.984411 10751 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:12.056567  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 160345us
W20260709 12:22:12.054823  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 109471us
I20260709 12:22:11.991714 10813 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:12.059049 10765 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.002s
I20260709 12:22:11.980412 10676 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:12.072563  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:12.063730 10621 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.002s
W20260709 12:22:12.054526  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.083487  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.075778  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.075915  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.062429 10701 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.084303 10701 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:12.084796 10829 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:22:12.085956  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.052418 10762 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.088047  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:12.088673  8140 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:12.089031 10762 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.089217  8140 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:12.079555 10769 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:22:12.090112  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:12.090636 10769 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:12.091051 10769 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.092115  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:12.091859 10769 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.092720  8138 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.083906  8070 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:12.095697  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:12.097425  8145 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:12.070567 10702 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:12.062983 10695 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:22:12.098811  8143 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:12.090801  8140 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:12.073835 10163 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:12.103081 10811 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:12.105579 10702 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.102751 10825 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:12.100099  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.099978  8759 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:12.082129 10722 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.082321 10676 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:12.113898  8763 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:12.117955 10695 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:12.128048 10831 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:12.127732 10781 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.129835 10759 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.131825 10475 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.132264 10721 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:12.141351 10769 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:12.135972  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50089.5us
I20260709 12:22:12.109714 10808 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.091055 10698 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.128419 10599 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.098801 10621 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.155787 10838 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:12.156072  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.168498  8217 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:12.162698  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:12.166890  8035 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.199s (SENT)
W20260709 12:22:12.156603 10830 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.086s	user 0.004s	sys 0.000s
I20260709 12:22:12.142814 10695 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.209816  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:12.156816 10819 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:22:12.214032  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.216492  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.269687  8213 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.161628 10702 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.169018 10805 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:12.084126 10765 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.298497  8215 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.300499  8137 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:12.303114 10832 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:22:12.303555 10621 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.160079 10163 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.156769 10834 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.194s
I20260709 12:22:12.142825 10701 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.178123 10824 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.314694  8138 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
W20260709 12:22:12.316305  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 149433us
I20260709 12:22:12.216255 10626 raft_consensus.cc:2764] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:22:12.322701  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.333166  8142 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:12.333040  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.334348  8070 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:12.214046 10698 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 12:22:12.336180  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 173532us
I20260709 12:22:12.339030  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.349983  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.351382  8212 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.358620  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49226 (request call id 83) took 1069 ms. Trace:
I20260709 12:22:12.368777  8213 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:12.362701  8064 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:12.376210  8064 pending_rounds.cc:85] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 3
I20260709 12:22:12.376557  8064 pending_rounds.cc:107] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:12.376891  8064 raft_consensus.cc:2889] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:12.359067  8219 rpcz_store.cc:276] 0709 12:22:11.288783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.357368 (+1068585us) service_pool.cc:224] Handling call
0709 12:22:12.358527 (+  1159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.379784  8061 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:12.382802  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43927.3us
I20260709 12:22:12.392253  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.392807  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.388849  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.352128 10813 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.398097  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.379611 10626 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:12.404965 10839 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:12.404839 10780 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:12.323963 10824 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.407056  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.409263  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.412941  8763 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:12.381680  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.409089  8064 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:22:12.412943  8063 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 3.
I20260709 12:22:12.422032  8064 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 2
I20260709 12:22:12.422367  8064 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:22:12.422650  8064 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:12.423231 10544 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.001s
W20260709 12:22:12.398097 10647 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.002s
I20260709 12:22:12.394061  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.425697  8763 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:12.407123 10813 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.426343 10825 raft_consensus.cc:2764] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:12.364897 10695 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:12.424646 10770 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.947s	user 0.008s	sys 0.004s
W20260709 12:22:12.431763 10766 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
I20260709 12:22:12.409611 10599 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:12.432040 10770 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.433595 10695 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:12.433667 10701 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:12.410952 10698 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:12.434827 10647 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.435638  8061 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:12.473186  8061 pending_rounds.cc:85] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 2
I20260709 12:22:12.432277  8759 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:12.473485  8061 pending_rounds.cc:107] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:12.474068  8061 raft_consensus.cc:2889] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:12.437183 10765 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.441628  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.442297 10780 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:12.479885  8145 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:12.444514 10824 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:12.466694  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52718.6us
I20260709 12:22:12.450114 10827 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:12.466970  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 73004us
I20260709 12:22:12.491772  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.459971 10769 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:12.449909 10813 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.444829 10669 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.489012  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:12.477855  8219 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.470147 10698 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:12.460017 10812 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.001s
I20260709 12:22:12.475800 10834 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:12.432286 10766 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:12.507443  8035 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.518s (SENT)
I20260709 12:22:12.498054 10694 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.495877 10765 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:12.511327  8035 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.564s (SENT)
I20260709 12:22:12.466578 10599 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.516222  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:12.518170  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.495829 10544 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:12.511649 10810 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:12.520968  8139 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:12.528896  8219 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:12.539759  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50861.7us
I20260709 12:22:12.540714  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.543462  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.544734  8212 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.494928 10827 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.505417 10813 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.509552 10769 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.550984  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.542909 10808 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.561806  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.560613  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:12.561199  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49891.5us
W20260709 12:22:12.566025  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65135.4us
I20260709 12:22:12.568485  8215 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.580051  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.580974  8763 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:12.540112 10810 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:12.569159  8035 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.624s (SENT)
I20260709 12:22:12.582957  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:12.581641 10742 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.005s
I20260709 12:22:12.599910  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.611580  8764 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:12.605868  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.604923  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:12.599442  8035 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.632s (SENT)
I20260709 12:22:12.520676 10765 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.612357  8212 raft_consensus.cc:2376] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:12.605319  8757 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:12.609846 10694 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:12.570510 10758 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.578680 10769 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.618969 10827 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.619727 10647 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.576097 10766 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.574754 10599 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.613529  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.576224 10780 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.578698 10812 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:12.576855 10698 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.621866  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.616008  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.622557  8213 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:12.622901  8215 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:12.616974 10770 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:12.607599 10771 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:22:12.570853 10822 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.615727  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.588888  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:12.628582  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.629474  8213 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.584714 10810 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:12.600397  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.604496 10714 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:12.632870  8763 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:12.637266  8212 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:12.644217  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:12.633467 10769 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:22:12.644897  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.645273  8758 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:12.645462  8215 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.645978 10769 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:12.637836 10774 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:12.649312  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 108702us
I20260709 12:22:12.650120  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.650383  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.650909 10825 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:12.651607  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.652817 10770 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:12.653208 10770 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:12.653607 10770 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:12.569131 10808 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.639472 10813 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.611387 10805 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:22:12.659930  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 531) took 1486 ms. Trace:
I20260709 12:22:12.656913 10769 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:12.665045 10769 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:12.665478 10769 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:12.666564 10823 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.701s	user 0.006s	sys 0.007s
I20260709 12:22:12.667297  8762 rpcz_store.cc:276] 0709 12:22:11.174846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.180969 (+  6123us) service_pool.cc:224] Handling call
0709 12:22:11.546844 (+365875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.547760 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.658926 (+1111166us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54006702d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:12.659668 (+   742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818296192}
I20260709 12:22:12.669241  8759 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:12.669094 10676 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.670287 10676 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:12.670482  8761 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:22:12.671636  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.674270  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.674857  8762 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:12.675782  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.675958 10834 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:12.677253 10852 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:12.678490  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:12.680341  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.636040 10822 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.641403  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.641907 10765 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.631299 10771 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.632694 10766 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:12.607016 10490 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:12.567984 10855 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:22:12.615226 10742 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.660548 10808 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.683735  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.687295  8757 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:12.688162  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.692600  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.692919  8217 raft_consensus.cc:2376] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:12.693240  8212 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:12.690001  8213 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:12.681748 10805 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.695202  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.696369  8214 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.697084 10813 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:12.688822 10766 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.697961 10766 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.699369  8064 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:12.700351  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.701043  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.701578  8063 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:12.702384  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.702589  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.703083  8061 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:12.703361  8063 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:12.704038  8061 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:12.705052  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.697389 10765 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:12.697371 10826 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.566s	user 0.004s	sys 0.004s
I20260709 12:22:12.704443  8063 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:12.708130  8070 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:12.718094  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.718139  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.721732  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.625242 10694 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.691545 10758 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:12.736099  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.736604  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.739044  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.741860  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:12.742054  8067 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:22:12.747141  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.715883  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.718453 10765 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.748605  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.748716  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.749191  8215 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 2.
I20260709 12:22:12.754503  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:12.754638  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.751680 10813 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.755357 10858 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.755887 10858 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.758175 10858 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.775720  8064 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:12.778636  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.779279  8213 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:12.776496  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.780995 10794 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.781476 10794 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:12.782424 10794 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.783936 10794 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.784795 10163 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:12.785670 10838 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:12.786031 10838 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:12.749209 10475 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:12.786861 10838 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.788125 10838 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.788651 10765 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.726409 10490 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:22:12.793231 10837 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:12.793869 10837 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.795011 10694 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.720322 10699 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:22:12.794874 10837 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.797135  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:12.748548 10534 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:12.798442 10534 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:12.798877 10769 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.800961 10599 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:12.801681 10771 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.716342 10774 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:22:12.807572  8064 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:12.808131 10742 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.744756 10851 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:22:12.811136 10851 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:12.811512 10851 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:12.811807  8757 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:12.762343  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:12.826512  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.827410  8213 raft_consensus.cc:2376] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
W20260709 12:22:12.828122  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65841.8us
I20260709 12:22:12.829876  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:12.842267  8035 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.863s (SENT)
I20260709 12:22:12.842764  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.800479 10534 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:12.738409 10827 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 12:22:12.851064 10861 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
I20260709 12:22:12.750785 10808 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:22:12.865912  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.871464  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.872259  8215 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:12.868552  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:12.873571  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:12.814220 10805 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:12.880921  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.881268  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1395) took 1096 ms. Trace:
I20260709 12:22:12.881767  8141 rpcz_store.cc:276] 0709 12:22:11.785138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.785328 (+   190us) service_pool.cc:224] Handling call
0709 12:22:11.870338 (+ 85010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.870997 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.881006 (+1010009us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b54000424d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:12.881193 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155907968}
I20260709 12:22:12.880223  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1357) took 1297 ms. Trace:
I20260709 12:22:12.885730  8142 rpcz_store.cc:276] 0709 12:22:11.582811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.583012 (+   201us) service_pool.cc:224] Handling call
0709 12:22:11.586631 (+  3619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.338606 (+751975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.879948 (+541342us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002f0654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:12.880144 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708316544}
I20260709 12:22:12.889340  8140 raft_consensus.cc:2410] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:12.846446 10490 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:12.892514  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.897681  8211 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.846637 10695 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.900115  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.894044  8142 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:12.905449  8220 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:12.905792  8143 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:12.897910 10805 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.912410  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.851995 10769 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:12.918171  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.920692  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.915333  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.922678  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:12.923415  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.895130  8069 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:12.900184  8144 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:12.849567 10855 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:12.896644  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.904654  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:12.927264  8145 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:12.929986  8760 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:12.933177  8062 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:12.933324  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.933889  8216 raft_consensus.cc:2376] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6. Re-sending same reply.
I20260709 12:22:12.934736  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.936172  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.896571 10490 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.812315 10851 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.848269 10770 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.937927  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.938539  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:12.947320  8213 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:12.947826  8035 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.032s (SENT)
I20260709 12:22:12.940150  8216 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:12.948307  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:12.922233 10695 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:12.976740  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:12.975951 10599 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 12:22:12.978605 10865 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:13.157958  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.188205  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:13.107581  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.163086 10851 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:13.159545  8142 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:13.095445 10766 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.156075  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.155293 10771 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.120929 10698 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:13.154814 10742 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.063719 10868 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:13.114929  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.121588  8141 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:22:13.089875 10774 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:13.170514  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:13.109828 10810 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.183395 10870 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:22:13.120491  8143 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:13.138118 10821 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.160s	user 0.000s	sys 0.007s
I20260709 12:22:13.168524 10770 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.126559 10811 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:22:13.095227 10695 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.127209 10676 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:22:13.039551  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1403) took 1175 ms. Trace:
I20260709 12:22:13.156188 10808 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:13.126273 10757 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 12:22:13.123981 10873 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:22:13.166543 10871 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:22:13.126399  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:13.066304  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1404) took 1202 ms. Trace:
I20260709 12:22:12.974241 10822 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.154917  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.155088 10769 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:12.975541 10765 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.127624 10780 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:22:13.114351  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.122027 10749 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.957197 10490 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:13.161618  8758 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:13.115309  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:12.982393  8213 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:13.136243 10867 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:22:13.133737  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.191119  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:13.030830  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.069919  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.210213  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.249656  8146 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 5: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.250777  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.211239  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.212172 10858 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:13.253849 10858 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.254115 10244 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:13.254590 10244 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:13.254981 10858 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.255473 10244 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.212251  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56328.2us
I20260709 12:22:13.259305 10842 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:13.214249  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.242136  8761 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:13.242864 10834 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:13.236426  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.213019 10771 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:13.208753  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 260946us
I20260709 12:22:13.030037 10805 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:12.969729 10817 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.277s
I20260709 12:22:13.042994 10859 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.062669  8145 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:13.261622  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.263164 10855 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:13.263877 10544 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:13.264825 10842 consensus_queue.cc:1243] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:13.262235 10244 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.214679  8141 pending_rounds.cc:85] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:13.339231  8141 pending_rounds.cc:107] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:13.339531  8141 raft_consensus.cc:2889] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:13.232532  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:13.215157 10774 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.003118 10813 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.266113  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:13.267504  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.341776  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 75787.1us
I20260709 12:22:13.342881 10442 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:13.343822 10836 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:13.138458  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.213819 10766 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.252229  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.269351  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.345981  8146 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.346784  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.222534  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.234020  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:13.238425  8757 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:13.218364  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.237634  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:13.222183  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 95857.7us
I20260709 12:22:13.275942 10834 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.213485 10742 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.220618 10534 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:13.348265  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.353632 10534 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.354602 10534 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.354614  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.355484  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.355820 10534 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:13.222206  8137 rpcz_store.cc:276] 0709 12:22:11.864376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.866346 (+  1970us) service_pool.cc:224] Handling call
0709 12:22:13.066110 (+1199764us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54001c2fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:13.066241 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962757504}
I20260709 12:22:13.356419 10699 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.356261  8219 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.225780  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.277959  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.226055  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:13.215843  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45548.2us
I20260709 12:22:13.216490  8756 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:13.219882  8139 rpcz_store.cc:276] 0709 12:22:11.864080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.882694 (+ 18614us) service_pool.cc:224] Handling call
0709 12:22:13.029995 (+1147301us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54001c2ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:13.039477 (+  9482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464965504}
I20260709 12:22:13.358577  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.359131  8217 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:13.220820  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.359844  8215 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:13.360706  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.361830  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.215276  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.227130  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:13.284346  8035 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.034s (SENT)
I20260709 12:22:13.223001  8144 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:13.219535 10665 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:22:13.313345  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.366060  8145 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 4: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.222859 10822 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:13.218827 10811 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:13.369086 10822 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.383041 10822 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.223308 10769 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.376724  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.330853  8213 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:13.001332 10758 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.217660 10810 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.225908 10749 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.224203 10676 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:13.306846 10782 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.561s	user 0.008s	sys 0.016s
I20260709 12:22:13.344110 10442 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:13.267598  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.368592 10742 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.352322  8143 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:13.362720  8137 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.363648  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.366258  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.419238  8215 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:13.340988 10475 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.367938  8144 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:13.368489  7965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 252) took 10859 ms. Trace:
I20260709 12:22:13.365854 10544 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:13.372516  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 94672us
I20260709 12:22:13.423058  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.327719  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.380301  8145 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:13.370795 10669 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:13.223438 10765 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.438452  8140 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.396832 10813 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:13.335402  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.395828  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:13.444103  8067 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.397763  8069 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:13.220163 10808 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.352180  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.371100 10811 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:13.424685  8219 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:13.373440  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.445185  8216 raft_consensus.cc:2376] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:13.373198 10699 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.366310  8758 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:13.373420 10287 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:13.370682 10827 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.374051 10834 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.379412 10798 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:13.427904  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.372170 10774 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.430505  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.430787  8217 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:13.465481  8217 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:13.325260  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:13.394027 10859 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:13.469128 10859 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.469336  8216 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:22:13.468968  7964 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.470606  8216 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:13.470093 10859 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.471308 10859 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:13.463907 10287 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.459084 10827 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.474272 10287 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.475005 10827 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.475816 10889 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.476658 10817 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:13.461898 10813 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:13.478204 10813 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.481395  8220 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:22:13.481536 10774 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.482683  8220 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:13.483408  8067 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 4.
I20260709 12:22:13.372355 10766 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:13.378057 10842 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:22:13.436846  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152563us
I20260709 12:22:13.485208  8143 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:13.486742  8035 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.105s (SENT)
I20260709 12:22:13.453685  8219 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:13.458139  8142 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:13.417411 10442 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:13.460779  8215 raft_consensus.cc:2376] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6. Re-sending same reply.
I20260709 12:22:13.415546 10676 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:13.420868  7965 rpcz_store.cc:276] 0709 12:22:02.509532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.511559 (+  2027us) service_pool.cc:224] Handling call
0709 12:22:13.368389 (+10856830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:10.764158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:10.764920 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:10.765056 (+   136us) write_op.cc:435] Acquired schema lock
0709 12:22:10.765076 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:10.766551 (+  1475us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:10.766640 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:10.766669 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:22:10.768051 (+  1382us) tablet.cc:701] Row locks acquired
0709 12:22:10.768102 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:22:10.768275 (+   173us) write_op.cc:270] Start()
0709 12:22:10.768430 (+   155us) write_op.cc:276] Timestamp: P: 1783599730768204 usec, L: 0
0709 12:22:10.768454 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:10.792849 (+ 24395us) log.cc:844] Serialized 6333 byte log entry
0709 12:22:11.217582 (+424733us) op_driver.cc:464] REPLICATION: finished
0709 12:22:11.317587 (+100005us) write_op.cc:301] APPLY: starting
0709 12:22:11.325540 (+  7953us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:11.450843 (+125303us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:11.452982 (+  2139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:11.698598 (+245616us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:11.699002 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:22:11.699062 (+    60us) write_op.cc:312] APPLY: finished
0709 12:22:11.699513 (+   451us) log.cc:844] Serialized 113 byte log entry
0709 12:22:11.699712 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:11.699876 (+   164us) write_op.cc:454] Released schema lock
0709 12:22:11.699946 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:11.700413 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:11.700442 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1841,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":61637,"apply.run_cpu_time_us":6602,"apply.run_wall_time_us":400678,"num_ops":16,"prepare.queue_time_us":148276,"prepare.run_cpu_time_us":52447,"prepare.run_wall_time_us":160294,"raft.queue_time_us":129905,"raft.run_cpu_time_us":7467,"raft.run_wall_time_us":25244,"replication_time_us":448953,"thread_start_us":251716,"threads_started":4,"wal-append.queue_time_us":162828,"wal-append.run_cpu_time_us":24737,"wal-append.run_wall_time_us":1742462}]]}
I20260709 12:22:13.388767 10836 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:22:13.466481  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 141313us
I20260709 12:22:13.427289 10855 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:13.461599 10699 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:13.415010 10782 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.681s	user 0.009s	sys 0.016s
I20260709 12:22:13.386843  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.448928  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.394556 10758 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.427289 10816 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.529769  7964 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 3, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 3 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.494530  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.450820 10742 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.458874 10759 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:22:13.446070 10780 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.501242  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.445180 10669 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.544986  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 43833.8us
W20260709 12:22:13.502297  8035 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.193s (SENT)
I20260709 12:22:13.545724  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:13.546167  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.546838  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:13.503502  8756 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:13.427122 10475 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.484333 10749 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.492369  8761 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:13.447711 10599 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:22:13.528127  8145 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:13.493147 10817 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:13.534318  8215 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:13.534953  8213 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:13.531666  7964 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 4 to 5, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.558000  8211 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
W20260709 12:22:13.559231  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 136292us
W20260709 12:22:13.559507  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 176294us
I20260709 12:22:13.492020 10244 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:13.562130  8219 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:13.571794  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69522us
I20260709 12:22:13.506412 10858 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:22:13.664765  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.662791  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:13.684067  8067 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:22:13.684273  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 137479us
I20260709 12:22:13.682045  8145 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:13.600281 10762 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:13.686456  8215 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:13.681672  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.574338 10702 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:13.572301 10889 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.691416  7964 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 4, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.549093 10742 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.694202  8145 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:13.653801 10771 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.652804 10694 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:13.674671 10749 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:13.563011 10780 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.666421 10893 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:13.693506  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 199064us
I20260709 12:22:13.698215 10769 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.703642  8214 raft_consensus.cc:2410] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:13.695451  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.716954  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.718672  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:13.720837 10695 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:13.721375 10695 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:13.722277 10695 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.724982 10771 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:13.725471 10771 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.725857 10771 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.729053 10769 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.685932  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.709718  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.705667  7964 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.678153 10890 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.712237  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.734182  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.735055 10891 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:13.735767 10891 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:13.736209 10891 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:13.737136 10891 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.738237 10890 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:13.738785 10890 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.740072  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:13.731673  7964 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 3, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:13.740818  8758 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:22:13.737149  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:13.741606  7964 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.742660  8756 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:13.743431  7964 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 7 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:13.745012 10762 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:13.745185  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59341us
I20260709 12:22:13.747262  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.748111 10762 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.749614 10890 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.750240 10890 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.750756 10890 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.754056 10890 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.765427  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.766857 10837 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:13.769486  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:13.769452  7964 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.771351  7964 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 3, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:13.773384  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:13.707803 10702 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:13.676702 10676 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.695011 10898 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.776248 10742 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.778592  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:13.535301 10816 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.713310 10699 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.698822 10842 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 12:22:13.792840 10880 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 12:22:13.786259 10897 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:22:13.711434 10698 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:13.794952  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 85316.8us
I20260709 12:22:13.835417  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.836861 10698 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.836958  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.808580 10782 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:13.838174 10782 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.838301  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.839107 10782 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.711342 10774 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:13.843695 10698 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:13.843993  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.798556 10676 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.812724 10816 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.778501 10749 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.845985  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.846728  8145 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:13.847587 10749 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.807930 10780 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:13.778101 10694 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.848515 10898 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:13.848950 10699 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:13.849997 10694 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.700762 10490 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.850448 10898 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:13.851143 10898 consensus_queue.cc:1243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:13.852186 10490 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.794296 10895 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:13.809150  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.598420 10811 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.810726 10886 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:22:13.853592  8138 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:13.811878 10808 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.854004  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.809150 10702 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.855463  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.855903  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.712531 10817 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:13.811372 10884 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:22:13.812942 10758 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:13.867892  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.822320 10669 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.843853 10774 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:13.850893 10699 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:13.873694 10698 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:13.666023 10442 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.874940 10442 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:13.853179 10811 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:13.810325 10888 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:22:13.809744 10887 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:22:13.877564 10774 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.885721  8144 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:13.886808  8217 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:13.887295  8217 pending_rounds.cc:85] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 3
I20260709 12:22:13.887564  8217 pending_rounds.cc:107] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:13.887811  8217 raft_consensus.cc:2889] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:13.888743  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1344) took 1163 ms (client timeout 1543 ms). Trace:
W20260709 12:22:13.889142  8214 rpcz_store.cc:269] 0709 12:22:12.725351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.725507 (+   156us) service_pool.cc:224] Handling call
0709 12:22:13.886206 (+1160699us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54002a62d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:13.888670 (+  2464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183614336}
W20260709 12:22:13.892587 10822 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.504s	user 0.002s	sys 0.007s
I20260709 12:22:13.891345  8144 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:13.893079 10822 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.888123 10757 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:13.894850  8144 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:22:13.895875 10757 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.866564 10701 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.787180 10890 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.921759  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:13.864588  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.870239  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:13.870043 10694 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:13.899155  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 236452us
I20260709 12:22:13.900830  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.885687  7964 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.896799  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:13.925064  8144 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.925805  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.902923  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.909493  8142 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:13.910178  8146 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:13.913693 10855 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:13.935446  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.936220  8140 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.895288 10822 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.914340  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2577) took 2338 ms. Trace:
I20260709 12:22:13.916868 10699 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:13.916996 10842 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:13.919093  8211 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:13.944137  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:13.923319  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53307.8us
I20260709 12:22:13.929325 10859 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:13.948905 10859 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:13.949311 10859 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:13.949759 10694 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.950598 10699 consensus_queue.cc:1243] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:13.950909 10765 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:13.951113 10699 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:13.951552 10699 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:13.921239 10757 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.952356 10699 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:13.953056 10757 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:13.953645 10699 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.930819 10759 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:13.931538 10858 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:13.931802  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:13.958988  8139 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:13.959987  8139 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:13.937263  8218 rpcz_store.cc:276] 0709 12:22:11.576323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.576485 (+   162us) service_pool.cc:224] Handling call
0709 12:22:11.576912 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.612684 (+1035772us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:13.110390 (+497706us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180042ebc0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:13.432877 (+322487us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.561903 (+129026us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:13.562445 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.562586 (+   141us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:13.562627 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.914017 (+351390us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540017ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:13.914067 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.914122 (+    55us) raft_consensus.cc:1685] finished
0709 12:22:13.914138 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.914279 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45457,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":2287,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":2391610880,"thread_start_us":386526,"threads_started":2,"wal-append.queue_time_us":211985}
I20260709 12:22:13.932264 10850 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:13.932617 10810 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.933221 10834 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:13.934252 10722 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:13.972065  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.936764  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.970738  8144 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:13.973847  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:13.975253  8211 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:22:13.975622  8211 pending_rounds.cc:85] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:22:13.975852  8211 pending_rounds.cc:107] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:22:13.976116  8211 raft_consensus.cc:2889] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:13.977015  8144 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:13.942700  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:13.944193  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 170884us
I20260709 12:22:13.978945  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.979867  8217 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:13.901666  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:13.947799 10855 consensus_queue.cc:1243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:13.948132  8140 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:13.945485  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:13.985199  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:13.945013 10490 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:13.963292  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.992125  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:13.992477  8219 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:13.985973  8068 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:13.993270  8061 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:13.993949  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:13.985199  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:13.995580  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50179.3us
I20260709 12:22:13.994549  8219 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:13.997920  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:13.998091  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:14.000123  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:14.000943  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:14.002178  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:14.003168  8214 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:14.004053  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:14.004372  8756 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:14.004856  8759 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:14.005589 10816 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:14.007778 10695 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.008777 10889 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:13.945741 10798 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.011054  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.014145  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:13.995150  8062 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:14.014703  8219 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:13.935060 10534 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:13.988870  8035 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.957s (SENT)
I20260709 12:22:14.016127  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:14.027376  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:14.028069  8068 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:13.970005 10850 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:14.048811  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:13.940506 10762 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:22:14.051156  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:13.991963 10749 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:14.054386  8219 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:13.985239 10722 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:13.985845 10765 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:14.132906  8035 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.522s (SENT)
I20260709 12:22:14.133716  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:14.023089 10889 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:14.024652 10534 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:14.104904  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:14.014828 10855 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:14.050948 10850 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:14.057191 10490 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:14.013799 10759 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:14.107110  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45404.3us
I20260709 12:22:14.013429 10669 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.940284 10890 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.112722  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:14.113848  8763 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:22:14.146188  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 215802us
I20260709 12:22:14.008699  8758 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:14.154677  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:14.034759  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:14.202714  8061 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
W20260709 12:22:14.202798  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 168155us
W20260709 12:22:14.177186  8034 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.6.182.190:33539, user_credentials={real_user=slave}} blocked reactor thread for 64274.4us
I20260709 12:22:14.028934 10798 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:14.180128  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47295.4us
I20260709 12:22:14.180874  8143 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:14.008363 10695 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:13.985307 10810 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.108300 10766 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:14.194029  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 292445us
W20260709 12:22:14.111953 10665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.010s	sys 0.018s
I20260709 12:22:14.055006 10891 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:22:14.207419  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:14.211488  8756 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:14.056910 10837 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:22:14.184015 10534 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:14.207446  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:14.058332 10244 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:22:14.213968  8186 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:14.204846  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:14.181921 10855 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:14.191039 10898 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:14.219094  8761 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:14.194128 10858 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:14.190841 10490 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.216207  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:14.191358 10759 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:14.176057 10816 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:22:14.242302  8216 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:14.212505 10665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.011s	sys 0.018s
I20260709 12:22:14.212831 10766 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.206028 10669 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.261031 10669 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:14.265059  8035 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.543s (SENT)
I20260709 12:22:14.244123 10842 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:14.242108 10490 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:14.203883 10771 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.246327 10759 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.263212 10766 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:14.290087 10669 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:14.322757 10905 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:22:14.298588 10851 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:22:14.340823 10910 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.432155  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 228678us
I20260709 12:22:14.509342 10851 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:14.509794  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:14.509869 10851 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:14.509541 10910 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.510963 10851 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:14.512274 10851 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.513023 10929 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:14.513475 10929 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:14.513880 10929 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:14.514295  8219 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:14.262990 10889 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:14.291677 10811 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:14.287284 10898 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:14.230458 10722 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.270955 10774 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.263193 10900 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:22:14.465318  8035 leader_election.cc:336] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 3.269s (SENT)
I20260709 12:22:14.468969 10813 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.469707 10702 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.564043 10774 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.565224 10702 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:14.470069 10442 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.595s	user 0.017s	sys 0.001s
W20260709 12:22:14.471567 10908 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.180s	user 0.008s	sys 0.000s
I20260709 12:22:14.472981  8139 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:14.474735 10771 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:14.478031 10883 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.100s	user 0.001s	sys 0.004s
I20260709 12:22:14.478813 10694 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:14.479506  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.479877 10534 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:14.482770 10475 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:14.483889  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:14.497303  8756 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:14.519672  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:14.520440  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:14.515888  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 218579us
I20260709 12:22:14.521929  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:14.510010 10859 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.003s
I20260709 12:22:14.467464 10695 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:14.926855  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 405001us
W20260709 12:22:14.719827  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 505900us
I20260709 12:22:14.563709 10722 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:14.688725  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 484059us
I20260709 12:22:14.933741  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:14.926509  8145 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:14.934985  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:14.936268  8214 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:14.513417 10921 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.640483  8217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.008s	sys 0.011s
I20260709 12:22:14.943066  8212 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:22:14.943298  8217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.011s	sys 0.025s
W20260709 12:22:14.612910  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 120570us
I20260709 12:22:14.467558 10798 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:14.946779  8757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.010s	sys 0.027s
I20260709 12:22:14.564368  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:14.947427  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 427061us
I20260709 12:22:14.948065 10913 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:14.949347  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 484042us
I20260709 12:22:14.950450 10922 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:14.950868  8214 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:14.951594 10922 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:14.925595 10759 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.616s	user 0.003s	sys 0.007s
I20260709 12:22:14.947525 10669 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:14.952044  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.564113 10898 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:14.946043  8067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.011s	sys 0.025s
W20260709 12:22:14.973230  8067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.011s	sys 0.025s
I20260709 12:22:14.956290  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:14.956769  8137 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:14.821844 10912 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:22:14.926568 10757 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.005s
W20260709 12:22:14.777812 10836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.008s	sys 0.017s
W20260709 12:22:14.958271  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.016s	sys 0.016s
W20260709 12:22:14.672959 10699 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.002s
I20260709 12:22:14.959352  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:14.742523 10817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.027s
W20260709 12:22:14.851471 10766 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
W20260709 12:22:14.832295 10897 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:22:14.961119  8728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.023s	sys 0.021s
I20260709 12:22:14.927033  8211 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:14.964339  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:14.965739  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:14.962406  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:14.943101 10698 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.019s	sys 0.014s
W20260709 12:22:14.935967  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.001s	sys 0.029s
I20260709 12:22:14.563225 10842 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:14.945847 10599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.006s	sys 0.029s
I20260709 12:22:14.835959 10890 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:14.971065  8064 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:14.968120  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.017s	sys 0.036s
W20260709 12:22:15.067309  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.018s	sys 0.036s
W20260709 12:22:15.068157  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 851999us
I20260709 12:22:14.977216 10898 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:14.975446  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:14.936511 10694 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:14.943840 10765 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:14.979256  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:14.989370  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1509) took 1025 ms. Trace:
W20260709 12:22:15.000368  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.017s	sys 0.016s
I20260709 12:22:15.003077  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:15.010156  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.015528  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.029s
W20260709 12:22:15.012516  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46902.6us
I20260709 12:22:14.721675 10850 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:14.564720 10813 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.026906  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:22:15.015592 10895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.016s	sys 0.031s
W20260709 12:22:15.010596  8758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.029s	sys 0.023s
I20260709 12:22:14.932826 10859 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:14.969172 10922 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:14.513469 10910 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:14.955404  8757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.010s	sys 0.027s
I20260709 12:22:14.828382 10929 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:15.011998 10817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.020s	sys 0.032s
W20260709 12:22:15.000240 10836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.009s	sys 0.017s
I20260709 12:22:14.967442 10442 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:15.122931  8137 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:15.123073  8214 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:15.123569  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1513) took 1109 ms. Trace:
W20260709 12:22:15.124903  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.091213 10858 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:15.106429  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 389) took 1952 ms. Trace:
I20260709 12:22:14.969072 10669 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:15.130268  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1371) took 1952 ms. Trace:
I20260709 12:22:15.126559  8067 rpcz_store.cc:276] 0709 12:22:13.963659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.963808 (+   149us) service_pool.cc:224] Handling call
0709 12:22:13.964071 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.964253 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:14.258645 (+294392us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.988798 (+730153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.988886 (+    88us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:14.988972 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.989095 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.989274 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":996087,"prepare.run_wall_time_us":54,"raft.queue_time_us":22417,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14844,"spinlock_wait_cycles":30845568,"thread_start_us":981533,"threads_started":2,"wal-append.queue_time_us":833071}
I20260709 12:22:15.131978  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1363) took 1970 ms. Trace:
I20260709 12:22:15.071318  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:15.133949  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.134172  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 402) took 1215 ms. Trace:
I20260709 12:22:15.136256  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:15.135368  8215 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:22:14.973233 10759 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.065816 10798 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:15.142462  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:15.015997 10698 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.020s	sys 0.014s
I20260709 12:22:15.017652 10475 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:15.106598 10490 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.799s	user 0.010s	sys 0.000s
I20260709 12:22:15.131528  8145 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:15.029138 10599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.006s	sys 0.030s
I20260709 12:22:14.970944 10771 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.233s
W20260709 12:22:15.139294  8758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.029s	sys 0.026s
I20260709 12:22:15.204991  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1385) took 1329 ms. Trace:
W20260709 12:22:15.139683 10895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.017s	sys 0.031s
I20260709 12:22:14.977011 10913 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:22:15.273984 10891 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.374799 10759 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.236310 10694 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:15.203567 10699 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.375332 10475 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.375980  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:15.237485 10922 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.376499  8143 rpcz_store.cc:276] 0709 12:22:13.177954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.498501 (+320547us) service_pool.cc:224] Handling call
0709 12:22:13.498798 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.210140 (+711342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.129931 (+919791us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400254754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.130185 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568185216}
I20260709 12:22:15.377308  8765 rpcz_store.cc:276] 0709 12:22:13.154143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.226987 (+ 72844us) service_pool.cc:224] Handling call
0709 12:22:13.227363 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:13.227763 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:13.227790 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:13.228378 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.291029 (+ 62651us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:13.291069 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.291233 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:14.477349 (+1186116us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:15.090461 (+613112us) raft_consensus.cc:1685] finished
0709 12:22:15.090485 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.106330 (+ 15845us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4148,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":13564672,"thread_start_us":62191,"threads_started":1,"wal-append.queue_time_us":110516}
I20260709 12:22:15.378871 10490 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:15.019132 10766 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:14.957283 10921 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.402465  8062 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:15.413763  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1512) took 1404 ms. Trace:
W20260709 12:22:15.418015 10918 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.937s	user 0.001s	sys 0.008s
W20260709 12:22:15.419829 10917 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.944s	user 0.004s	sys 0.004s
I20260709 12:22:15.264788  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:15.594245  8214 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:15.272545 10929 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:15.215329  8063 rpcz_store.cc:276] 0709 12:22:14.014650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.022763 (+  8113us) service_pool.cc:224] Handling call
0709 12:22:14.023111 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.023344 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:14.210491 (+187147us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.123100 (+912609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.123172 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:15.123234 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.123325 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.123493 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6356,"prepare.queue_time_us":989746,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":82785,"thread_start_us":1013293,"threads_started":2}
I20260709 12:22:15.243224 10836 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.441603 10798 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.230172  8069 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:15.426568  8139 rpcz_store.cc:276] 0709 12:22:13.875252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.969514 (+ 94262us) service_pool.cc:224] Handling call
0709 12:22:13.969786 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.931131 (+961345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.204672 (+273541us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.204910 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156846336}
I20260709 12:22:15.427668  8215 pending_rounds.cc:85] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:22:15.604327  8215 pending_rounds.cc:107] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:22:15.604722  8215 raft_consensus.cc:2889] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:15.427981  8212 rpcz_store.cc:276] 0709 12:22:13.918631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.921411 (+  2780us) service_pool.cc:224] Handling call
0709 12:22:15.133876 (+1212465us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:15.134087 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332797184}
I20260709 12:22:15.606485  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:15.421615 10920 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.942s	user 0.008s	sys 0.000s
I20260709 12:22:15.429154  8756 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:15.438534  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:15.610430  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:15.610569  8219 raft_consensus.cc:2376] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5. Re-sending same reply.
I20260709 12:22:15.611582  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:15.611781  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:15.280725  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 446) took 2397 ms. Trace:
W20260709 12:22:15.279369  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.30413e+06us
W20260709 12:22:15.425374 10933 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 12:22:15.275413 10927 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.795s	user 0.000s	sys 0.007s
I20260709 12:22:15.393646 10855 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:15.400179  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2611) took 1424 ms. Trace:
I20260709 12:22:15.633996  8216 rpcz_store.cc:276] 0709 12:22:13.975633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.978616 (+  2983us) service_pool.cc:224] Handling call
0709 12:22:14.023326 (+ 44710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.245696 (+222370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.399775 (+1154079us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.400081 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503025408}
W20260709 12:22:15.267158 10911 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.786s	user 0.003s	sys 0.007s
W20260709 12:22:15.472836  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 401618us
I20260709 12:22:15.471398  8146 rpcz_store.cc:276] 0709 12:22:13.161429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.347513 (+186084us) service_pool.cc:224] Handling call
0709 12:22:13.909951 (+562438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.927720 (+ 17769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.131714 (+1203994us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400043650. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:15.131897 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292855552}
I20260709 12:22:15.536093  8064 rpcz_store.cc:276] 0709 12:22:14.009329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.022514 (+ 13185us) service_pool.cc:224] Handling call
0709 12:22:14.111416 (+ 88902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.067189 (+955773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.413387 (+346198us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001f7554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.413672 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976441088}
I20260709 12:22:15.283529 10810 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:15.254434 10794 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:15.643580 10794 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:15.474056  8145 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:15.601248 10759 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.646631 10759 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.652019  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 549) took 1678 ms. Trace:
I20260709 12:22:15.615816 10798 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.472273 10475 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.245258 10842 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.632611 10694 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:15.601009 10836 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.590404 10780 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.423630 10924 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.909s	user 0.007s	sys 0.000s
I20260709 12:22:15.313756 10858 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:15.597687  8137 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:15.423729 10757 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.473623 10851 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.952s	user 0.012s	sys 0.000s
I20260709 12:22:15.598712  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:15.621011 10599 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.467636 10676 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.662220 10702 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:15.678336 10937 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.678571 10676 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.678956 10937 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:15.599305  8068 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.022s	sys 0.044s
W20260709 12:22:15.680729 10930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.013s	sys 0.024s
W20260709 12:22:15.680896  8068 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.022s	sys 0.044s
I20260709 12:22:15.439314 10669 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:15.253727 10742 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.313s
I20260709 12:22:15.602178  8211 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 3: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:15.602782  8143 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:22:15.608765 10916 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.976s	user 0.001s	sys 0.009s
I20260709 12:22:15.468326 10891 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:15.592098  8759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.044s	sys 0.095s
I20260709 12:22:15.612316  8212 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:15.613772  8219 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.681022 10702 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 12:22:15.613619  8138 rpcz_store.cc:276] 0709 12:22:12.882886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.882988 (+   102us) service_pool.cc:224] Handling call
0709 12:22:12.883255 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.853980 (+970725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.280324 (+1426344us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540008f7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.280611 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231203072}
I20260709 12:22:15.220434  8070 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:15.473875 10722 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:15.630842  8139 pending_rounds.cc:85] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
W20260709 12:22:15.599121 10701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.021s	sys 0.045s
I20260709 12:22:15.642920  8216 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.536338 10699 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.657773  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2557) took 1660 ms. Trace:
I20260709 12:22:15.672380 10858 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:15.676661  8214 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:15.652789 10774 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:15.681233 10930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.013s	sys 0.024s
I20260709 12:22:15.850651 10922 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:15.850478  8065 rpcz_store.cc:276] 0709 12:22:13.996968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.997122 (+   154us) service_pool.cc:224] Handling call
0709 12:22:13.997567 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.014012 (+ 16445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.014043 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.014512 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.260464 (+245952us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:14.261772 (+  1308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.276784 (+ 15012us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.274640 (+997856us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:15.657424 (+382784us) raft_consensus.cc:1685] finished
0709 12:22:15.657453 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.657711 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6852,"spinlock_wait_cycles":161216384,"thread_start_us":145434,"threads_started":1,"wal-append.queue_time_us":429976}
W20260709 12:22:15.733217  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.853796  8139 pending_rounds.cc:107] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:15.854125  8139 raft_consensus.cc:2889] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:15.671752  8218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.029s	sys 0.045s
W20260709 12:22:15.861994  8218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.040s	sys 0.051s
I20260709 12:22:15.862663  8214 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:15.794672  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 547) took 1822 ms. Trace:
I20260709 12:22:15.653271 10534 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:15.853477 10701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.022s	sys 0.045s
I20260709 12:22:15.654732 10759 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.659802 10794 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:15.849663 10931 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.643s	user 0.002s	sys 0.000s
W20260709 12:22:15.826401 10911 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:15.887647  8216 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:22:15.801539  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.879067 10794 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:15.889550  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.640225 10890 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:15.869812  8759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.048s	sys 0.100s
I20260709 12:22:15.867789  8760 rpcz_store.cc:276] 0709 12:22:13.972785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.976054 (+  3269us) service_pool.cc:224] Handling call
0709 12:22:13.976495 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:13.976958 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:13.976997 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:13.977547 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.204748 (+227201us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:14.205130 (+   382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.205205 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.422744 (+1217539us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:15.794249 (+371505us) raft_consensus.cc:1685] finished
0709 12:22:15.794286 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.794586 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11012,"raft.queue_time_us":126,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14417,"spinlock_wait_cycles":6309120,"thread_start_us":153479,"threads_started":1,"wal-append.queue_time_us":498134}
I20260709 12:22:15.655098 10900 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:15.674759 10780 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.901575 10780 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:15.897533 10937 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.879127 10699 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.914373 10780 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.915005 10780 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.917785 10780 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:15.866421 10850 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:15.923738 10836 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:15.927923 10915 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.446s	user 0.005s	sys 0.003s
W20260709 12:22:15.665326 10889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.017s	sys 0.060s
I20260709 12:22:15.879637 10813 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.949003  8138 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:15.652706  8758 rpcz_store.cc:276] 0709 12:22:13.973407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.986460 (+ 13053us) service_pool.cc:224] Handling call
0709 12:22:14.008041 (+ 21581us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:14.008540 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:14.478274 (+469734us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.472065 (+993791us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:15.650012 (+177947us) log.cc:844] Serialized 52 byte log entry
0709 12:22:15.651576 (+  1564us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:15.651626 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.651717 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.651768 (+    51us) raft_consensus.cc:1685] finished
0709 12:22:15.651788 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.651936 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47092,"raft.queue_time_us":51580,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":10037120,"thread_start_us":942175,"threads_started":1,"wal-append.queue_time_us":990309}
W20260709 12:22:15.951912 10889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.018s	sys 0.061s
I20260709 12:22:15.893270 10859 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.888008 10676 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:15.897866 10910 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.959931 10910 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.966982  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1510) took 1981 ms. Trace:
I20260709 12:22:15.969945  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2614) took 1987 ms. Trace:
I20260709 12:22:15.970400  8215 rpcz_store.cc:276] 0709 12:22:13.982814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.983374 (+   560us) service_pool.cc:224] Handling call
0709 12:22:15.134868 (+1151494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.618694 (+483826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.969636 (+350942us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540014e950. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:15.969828 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577133184}
I20260709 12:22:15.880167 10722 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:15.974298 10722 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:15.975055 10931 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:22:15.978617 10942 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 12:22:15.896811 10921 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:15.976419  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2605) took 2634 ms. Trace:
W20260709 12:22:15.988099  8062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 368) took 1962 ms (client timeout 1920 ms). Trace:
I20260709 12:22:15.986145  8213 rpcz_store.cc:276] 0709 12:22:13.341822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.664516 (+322694us) service_pool.cc:224] Handling call
0709 12:22:13.680824 (+ 16308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:13.681204 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:13.933269 (+252065us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18002bf720. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:14.182666 (+249397us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.494771 (+312105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.522428 (+ 27657us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.522715 (+   287us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:14.522822 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.522968 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.847663 (+1324695us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:15.976232 (+128569us) raft_consensus.cc:1685] finished
0709 12:22:15.976257 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.976364 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29471,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3618,"raft.queue_time_us":14077,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":7026,"spinlock_wait_cycles":14707200,"thread_start_us":501777,"threads_started":2,"wal-append.queue_time_us":921247}
W20260709 12:22:15.988564  8062 rpcz_store.cc:269] 0709 12:22:14.026016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.050362 (+ 24346us) service_pool.cc:224] Handling call
0709 12:22:15.987898 (+1937536us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400347e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:15.988021 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2773496704}
I20260709 12:22:15.967585  8069 rpcz_store.cc:276] 0709 12:22:13.985723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.986064 (+   341us) service_pool.cc:224] Handling call
0709 12:22:14.000370 (+ 14306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.603545 (+1603175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.966588 (+363043us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540011cbd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:15.966888 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2827695872}
I20260709 12:22:15.891228 10702 consensus_queue.cc:1243] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:15.984579 10766 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:15.682266 10757 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.701205 10810 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.014418  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1392) took 1001 ms. Trace:
I20260709 12:22:16.016448  8143 rpcz_store.cc:276] 0709 12:22:15.011595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.470905 (+459310us) service_pool.cc:224] Handling call
0709 12:22:15.570429 (+ 99524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.892260 (+321831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.004992 (+112732us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400314554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:16.013325 (+  8333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73633536}
I20260709 12:22:16.025063  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.026108  8220 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:16.026803  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2625) took 1507 ms. Trace:
I20260709 12:22:16.027215  8220 rpcz_store.cc:276] 0709 12:22:14.519576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.519694 (+   118us) service_pool.cc:224] Handling call
0709 12:22:16.024840 (+1505146us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:16.026720 (+  1880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14743424}
W20260709 12:22:16.033716  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.765887 10599 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:15.996434 10910 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.039019  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1387) took 1056 ms. Trace:
I20260709 12:22:16.049670  8211 rpcz_store.cc:276] 0709 12:22:14.982468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.142113 (+159645us) service_pool.cc:224] Handling call
0709 12:22:16.038728 (+896615us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540014ee54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:16.038934 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368140544}
I20260709 12:22:15.944531 10890 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.063164 10771 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:16.065419 10944 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.476s	user 0.003s	sys 0.000s
I20260709 12:22:16.063176 10757 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.074980  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1514) took 2017 ms. Trace:
W20260709 12:22:16.076536  8142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.040s	sys 0.038s
I20260709 12:22:16.076915  8070 rpcz_store.cc:276] 0709 12:22:14.058076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.224665 (+166589us) service_pool.cc:224] Handling call
0709 12:22:14.247117 (+ 22452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.897905 (+1650788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.071621 (+173716us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400345b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:16.074891 (+  3270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237769472}
W20260709 12:22:16.078567  8142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.040s	sys 0.039s
I20260709 12:22:16.012873 10810 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.118013  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.019s	sys 0.048s
W20260709 12:22:16.121656  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.020s	sys 0.048s
I20260709 12:22:16.069101 10771 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:16.122781  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:16.125224  8217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.016s	sys 0.002s
W20260709 12:22:16.127578  8217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.016s	sys 0.002s
I20260709 12:22:16.128943  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2613) took 2147 ms. Trace:
I20260709 12:22:16.029706 10475 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:16.131047  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.013s	sys 0.005s
W20260709 12:22:16.131461  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.013s	sys 0.005s
W20260709 12:22:16.131798  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.12446e+06us
W20260709 12:22:16.133639  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.010s	sys 0.008s
W20260709 12:22:16.134004  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.011s	sys 0.008s
I20260709 12:22:16.137238  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.005259 10900 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.123142  8034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.008s	sys 0.009s
W20260709 12:22:16.138127  8034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.008s	sys 0.010s
W20260709 12:22:16.138494  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 1.19334e+06us
I20260709 12:22:16.140844  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:16.111835 10910 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.126173 10898 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.923s	user 0.016s	sys 0.003s
W20260709 12:22:16.130906 10765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.026s	sys 0.055s
W20260709 12:22:15.262010 10822 consensus_queue.cc:1175] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1659f359000d40bda3fc864911b1c75c" responder_term: 7 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:16.170593  8220 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:16.169425  8212 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:22:16.165212 10805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.005s	sys 0.014s
I20260709 12:22:16.192276  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.127846 10946 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:16.196336  8143 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:16.193365  8138 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:22:16.165782 10798 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 12:22:16.198879 10798 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.200048  8186 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.011s	sys 0.008s
I20260709 12:22:16.200114  8760 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:22:16.200451  8186 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.011s	sys 0.008s
W20260709 12:22:16.200791  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 910864us
I20260709 12:22:16.200949  8760 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:16.201360 10798 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:16.201702  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:16.202961  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.132994 10904 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.133244 10817 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:16.208690  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:16.211138  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.007s	sys 0.011s
W20260709 12:22:16.211521  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.012s
I20260709 12:22:16.211714  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:16.164893  8757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.013s	sys 0.005s
I20260709 12:22:16.203797  8215 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
W20260709 12:22:16.213075  8757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.014s	sys 0.005s
W20260709 12:22:16.177646 10765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.028s	sys 0.057s
I20260709 12:22:16.209992  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 550) took 2236 ms. Trace:
I20260709 12:22:16.165010 10922 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:16.210829  8220 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:16.212455  8212 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:22:16.195919 10805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.005s	sys 0.015s
I20260709 12:22:16.220386  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.222571  8219 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:16.214282  8762 rpcz_store.cc:276] 0709 12:22:13.973682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.978439 (+  4757us) service_pool.cc:224] Handling call
0709 12:22:14.013467 (+ 35028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.029950 (+ 16483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.029981 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.057665 (+ 27684us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.672329 (+614664us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:14.672369 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.672443 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.064905 (+1392462us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:16.166095 (+101190us) raft_consensus.cc:1685] finished
0709 12:22:16.166123 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.209935 (+ 43812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16013,"raft.queue_time_us":16177,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":56424,"spinlock_wait_cycles":6042368,"thread_start_us":461063,"threads_started":1,"wal-append.queue_time_us":1399527}
I20260709 12:22:16.229547  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.231002  8141 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:16.231523  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.231796  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.232270  8143 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:16.232609  8219 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
W20260709 12:22:16.235736  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.005s	sys 0.010s
W20260709 12:22:16.236250  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.005s	sys 0.011s
I20260709 12:22:16.214002 10699 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.170568 10898 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.209815 10946 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.280061  8144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.019s	sys 0.026s
I20260709 12:22:16.275519  8765 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
W20260709 12:22:16.236704  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 622249us
I20260709 12:22:16.222828  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:16.283159  8144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.019s	sys 0.026s
I20260709 12:22:16.284443  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.170261 10910 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.293284  8143 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:16.218436 10765 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:16.296097  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.296891  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.230765 10913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.005s	sys 0.010s
I20260709 12:22:16.228775 10891 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:16.352923  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.002s	sys 0.032s
I20260709 12:22:16.358841  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.268453 10921 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.297551 10698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.045s	sys 0.056s
W20260709 12:22:16.358731  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.268217 10836 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.353545 10913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.006s	sys 0.010s
I20260709 12:22:16.230592 10490 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.350610 10954 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.360575  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.002s	sys 0.032s
W20260709 12:22:16.359869  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.333771  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.351235  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 397) took 2300 ms. Trace:
W20260709 12:22:16.299201  8035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.004s	sys 0.012s
I20260709 12:22:16.361502  8143 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:16.367926  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1382) took 2982 ms. Trace:
I20260709 12:22:16.129355  8217 rpcz_store.cc:276] 0709 12:22:13.981419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.981715 (+   296us) service_pool.cc:224] Handling call
0709 12:22:13.982098 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.982389 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:14.944257 (+961868us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.128420 (+1184163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:16.128484 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:16.128530 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.128766 (+   236us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.128888 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30950,"prepare.queue_time_us":235235,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":285,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":29054,"thread_start_us":2117590,"threads_started":2}
I20260709 12:22:16.358615  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:16.359171 10939 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.218994 10771 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.294739 10834 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:16.349850 10701 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.297878 10766 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.226764 10922 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:16.372653 10698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.047s	sys 0.056s
I20260709 12:22:16.353606  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:16.446949  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:16.447603  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 151001us
I20260709 12:22:16.294524 10757 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:16.393924  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:16.356720 10842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.000s	sys 0.022s
I20260709 12:22:16.298489 10287 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.294739 10244 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:16.413410  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 114064us
I20260709 12:22:16.481688  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:16.219455 10904 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.350544 10934 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:16.296857 10798 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:22:16.349926  8758 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:16.360059 10544 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:16.359503 10758 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.272186 10858 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.295449 10699 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.294976 10794 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:22:16.366271 10851 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.378430 10935 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.423393  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64932.2us
I20260709 12:22:16.430580 10850 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 12:22:16.376396  8140 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.007s	sys 0.015s
I20260709 12:22:16.419435 10954 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.420390  8141 rpcz_store.cc:276] 0709 12:22:13.385428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.897161 (+511733us) service_pool.cc:224] Handling call
0709 12:22:13.897472 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.231406 (+2333934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.367592 (+136186us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54002f0654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:16.367843 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5366273280}
I20260709 12:22:16.419867 10889 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.434654  8146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.002s	sys 0.019s
W20260709 12:22:16.434921  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.016s
W20260709 12:22:16.435220  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.001s	sys 0.019s
I20260709 12:22:16.446096 10701 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.448495  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:16.435429 10749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.189s	user 0.013s	sys 0.025s
W20260709 12:22:16.435892  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 84269.8us
W20260709 12:22:16.541203  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92802.5us
I20260709 12:22:16.392020 10599 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:16.476765  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.480168 10771 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:16.468096  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.426900 10442 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:16.445840 10893 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.449123 10952 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:22:16.424887 10742 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.448589 10475 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.488101  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:16.567672  8138 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.449358 10810 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.449366 10774 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:16.550151 10794 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:16.514480 10780 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:22:16.501596  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.418537  8035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.004s	sys 0.016s
W20260709 12:22:16.576812  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.60732e+06us
W20260709 12:22:16.577427  8035 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.641s (SENT)
I20260709 12:22:16.466971 10955 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:16.475142 10890 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:16.475080 10842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.000s	sys 0.022s
W20260709 12:22:16.507473  8140 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.015s
W20260709 12:22:16.424667  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.017s	sys 0.036s
W20260709 12:22:16.585302  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.017s	sys 0.037s
I20260709 12:22:16.512012 10935 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.420337  8759 rpcz_store.cc:276] 0709 12:22:14.051156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.051297 (+   141us) service_pool.cc:224] Handling call
0709 12:22:14.189670 (+138373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.231967 (+ 42297us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:14.313075 (+ 81108us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.949765 (+1636690us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.075845 (+126080us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.112519 (+ 36674us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:16.119347 (+  6828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.128881 (+  9534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.273919 (+145038us) raft_consensus.cc:1685] finished
0709 12:22:16.283724 (+  9805us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.298642 (+ 14918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3178,"prepare.queue_time_us":56787,"prepare.run_cpu_time_us":8822,"prepare.run_wall_time_us":200033,"raft.queue_time_us":40976,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":10156,"thread_start_us":1153229,"threads_started":1,"wal-append.queue_time_us":1503048}
I20260709 12:22:16.377761 10921 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.417965 10913 consensus_queue.cc:1243] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:16.427089 10939 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.514003  8146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.002s	sys 0.019s
W20260709 12:22:16.514153  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.003s	sys 0.016s
I20260709 12:22:16.449663 10766 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.514281  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.001s	sys 0.019s
I20260709 12:22:16.475688 10859 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 12:22:16.503598 10953 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:22:16.476015 10722 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:22:16.475596 10822 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:16.489032 10817 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:16.542243  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:16.641995  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99850.8us
I20260709 12:22:16.642944  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:16.512514 10949 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:22:16.485720 10287 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.503118 10962 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.514371  8145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.010s	sys 0.019s
W20260709 12:22:16.520951  8139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.002s	sys 0.031s
W20260709 12:22:16.540941 10749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.309s	user 0.013s	sys 0.028s
I20260709 12:22:16.650925  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:16.667833  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 165109us
I20260709 12:22:16.492877 10758 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.492949 10544 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.626997 10898 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.484651 10757 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.489010 10244 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.513854 10961 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.554276 10442 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.702576 10442 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:16.703717 10939 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:16.689841 10963 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:22:16.705783 10699 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.706604 10699 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.706991 10244 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.707089 10699 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.412978 10836 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.710088 10836 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.506258 10851 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.711328 10913 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.711968 10913 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.712924  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.713086 10851 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.713810 10851 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.714262 10913 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.714370 10851 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.478229 10698 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.718168 10701 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.718775 10698 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.719667 10782 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:16.721554 10698 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.567229 10893 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.587440  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.920s (SENT) [suppressed 16 similar messages]
I20260709 12:22:16.431931 10834 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.544930 10889 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.591693  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:16.551110 10968 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:22:16.576738 10774 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.495213 10765 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.554682 10599 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:16.574343 10794 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.579047 10475 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.622581  8138 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:16.590760 10956 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:22:16.570223 10742 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.585942 10910 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.648108  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.748826  8143 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:22:16.669315  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 201764us
I20260709 12:22:16.749439 10742 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.652168  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.750272  8761 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:16.753721 10893 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.657891  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:16.658797  8145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.013s	sys 0.026s
W20260709 12:22:16.658949  8139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.003s	sys 0.039s
W20260709 12:22:16.671906  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 131399us
I20260709 12:22:16.759044  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:16.685595  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 456) took 2759 ms. Trace:
I20260709 12:22:16.759958  8144 rpcz_store.cc:276] 0709 12:22:13.926066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.986458 (+ 60392us) service_pool.cc:224] Handling call
0709 12:22:13.986771 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:13.987211 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:13.987263 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:13.987848 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:22:15.425293 (+1437445us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b180019e220. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:16.294147 (+868854us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:16.294189 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.294254 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.670349 (+376095us) raft_consensus.cc:1685] finished
0709 12:22:16.670370 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.685498 (+ 15128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19881,"raft.queue_time_us":107,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":36371,"spinlock_wait_cycles":9625344,"thread_start_us":868642,"threads_started":1,"wal-append.queue_time_us":2506318}
I20260709 12:22:16.762465  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.763267  8144 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:16.763983  8144 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:16.685581  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.561437  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:16.697552 10974 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:16.648862 10890 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:16.686652 10922 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.790223  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:16.545920 10965 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.552708 10850 consensus_queue.cc:1243] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:16.715195 10913 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:16.804570  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.805506  8144 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:16.806581  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.807284  8144 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
W20260709 12:22:16.715803 10976 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:16.711326 10442 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:16.716660 10977 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:22:16.717981 10694 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.000s
W20260709 12:22:16.672405 10959 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:22:16.657554 10810 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:16.649593 10978 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.738830  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2622) took 2221 ms. Trace:
I20260709 12:22:16.851493  8218 rpcz_store.cc:276] 0709 12:22:14.517396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.550230 (+ 32834us) service_pool.cc:224] Handling call
0709 12:22:14.550624 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.936479 (+385855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.936508 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.945774 (+  9266us) log.cc:844] Serialized 26 byte log entry
0709 12:22:15.862578 (+916804us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:15.862637 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.862736 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.738580 (+875844us) raft_consensus.cc:1685] finished
0709 12:22:16.738608 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.738761 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":387016,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":859911,"threads_started":1,"wal-append.queue_time_us":1147652}
W20260709 12:22:16.715195 10967 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:16.745957 10699 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.698865 10757 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.764827  8141 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:16.591851 10955 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.766150  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:16.773113  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.773334  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.778133  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:16.891193  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125146us
I20260709 12:22:16.780893  8759 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:16.741839 10794 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:16.797641  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.795035  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:16.898468  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 103552us
I20260709 12:22:16.743059 10858 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.758189 10904 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.824062  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.903406  8217 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 3.
I20260709 12:22:16.826221  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.828008  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:16.904326  8065 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.896229  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:16.828704  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 274738us
I20260709 12:22:16.789119 10890 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.790699 10742 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:16.838488  8035 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.685s (SENT)
W20260709 12:22:16.914381  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 75931.9us
I20260709 12:22:16.850301  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.915848  8762 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:16.872418  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.917006  8067 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:16.917790  8067 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:16.872599  8062 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:16.873694  8763 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:16.800424 10834 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.731840 10961 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.874812 10978 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:16.872787  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:16.765946 10475 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.681268 10962 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:16.889830  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 220895us
I20260709 12:22:16.891145  8069 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:16.791389  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.942289  8138 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:16.942410  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:16.902244  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.943202  8765 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:22:16.902729  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.808259  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.889710  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:16.827539 10913 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.954298  8765 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:16.867828 10810 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.907697  8212 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:16.911228  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.926340  8220 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:16.866817 10954 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:16.926236  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:16.945161  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.905272  8064 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:16.946679  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.950917  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:16.953290  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:16.970752  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.958207  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.973326  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:16.974306  8762 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:16.975378  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:16.963295  8065 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:16.912707 10742 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:16.912263 10890 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:16.931262 10774 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:16.979211  8138 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:16.973800  8763 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:16.963909  8141 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:16.938226 10699 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.923300 10992 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:16.984326  8069 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:16.988054  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.965507  8758 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:16.959159 10921 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.011305  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:16.967244 10810 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:17.010366  8067 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:16.957297 10922 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:16.932221 10904 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:22:17.022843  8064 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.977346 10990 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:16.978263 10858 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.023339  8064 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:17.014115  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.985173 10742 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:16.996181  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:16.983458 10766 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:16.960554 10749 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.014096  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 371) took 2896 ms. Trace:
I20260709 12:22:16.983014 10798 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:17.019734 10859 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:17.007908 10935 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.000068 10834 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.027078  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.027549  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:17.052438  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126314us
I20260709 12:22:17.075968  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.077965  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:17.020880 10922 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.079728  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.081149  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:16.997572 10996 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:17.056571  8035 connection.cc:256] RPC call timeout handler was delayed by -1.3725305140001183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2939s for a response
W20260709 12:22:17.085736  8035 connection.cc:256] RPC call timeout handler was delayed by -1.3294135679998362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 12:22:17.086261  8035 connection.cc:256] RPC call timeout handler was delayed by -1.3205635300000722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29350000000000004s for a response
W20260709 12:22:17.086666  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2176820170002429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:22:17.087215  8035 connection.cc:256] RPC call timeout handler was delayed by -1.0478339950004738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:22:17.087658  8035 connection.cc:256] RPC call timeout handler was delayed by -1.0241820170003848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 12:22:17.022433 10287 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.059906 10989 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:17.061086 10475 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.061420 10442 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.061954 10960 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:17.065244 10961 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.051188  8064 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:16.987280 10599 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 12:22:17.067445  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 95842.1us
I20260709 12:22:17.061970 10851 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.122494  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.091996  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:17.048689 10990 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:17.067147 10858 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.066665  8068 rpcz_store.cc:276] 0709 12:22:14.110093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.474184 (+364091us) service_pool.cc:224] Handling call
0709 12:22:14.474569 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.550102 (+ 75533us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:15.259614 (+709512us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4800080058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:15.681408 (+421794us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.618719 (+937311us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.642621 (+ 23902us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.642816 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:16.642873 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.642964 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:16.985705 (+342741us) raft_consensus.cc:1685] finished
0709 12:22:17.005772 (+ 20067us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.005991 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41050,"prepare.queue_time_us":530710,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":12340,"raft.queue_time_us":184354,"raft.run_cpu_time_us":11735,"raft.run_wall_time_us":650314,"spinlock_wait_cycles":73007488,"thread_start_us":1512384,"threads_started":2,"wal-append.queue_time_us":778183}
I20260709 12:22:17.055986 10544 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.133885  8064 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:17.118156  8109 connection.cc:256] RPC call timeout handler was delayed by -1.3582975360000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 12:22:17.092844 10922 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:17.092600 10798 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.100592 10834 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:17.129247 10983 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:22:17.129762 10991 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:17.026099 10699 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.103008 10889 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.052443 10986 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.358s
I20260709 12:22:17.073966 10749 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.174278  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1429) took 1930 ms. Trace:
I20260709 12:22:17.173090  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.183634  8759 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:17.179183  8068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:22:17.180209 10990 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.187765 10973 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:22:17.187775  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:17.188746 10774 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.189209 10774 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.189868  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:17.145754  8141 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:17.184932  8068 raft_consensus.cc:606] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:17.191609  8141 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:17.181082  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.192574  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.192907  8762 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:17.181820  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.192791 10995 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 12:22:17.193533  8765 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:17.193699 10993 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.186734  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.202047  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:17.188118 10990 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:17.166360 10599 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:17.183176  8145 rpcz_store.cc:276] 0709 12:22:15.244213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.645075 (+400862us) service_pool.cc:224] Handling call
0709 12:22:15.645506 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.660711 (+ 15205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:16.756552 (+1095841us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.120773 (+364221us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.146640 (+ 25867us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.173883 (+ 27243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:17.173970 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:17.174023 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.174097 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.174214 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69085,"prepare.queue_time_us":958159,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":146,"raft.queue_time_us":91170,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":4577,"thread_start_us":1457317,"threads_started":2}
I20260709 12:22:17.195915  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:17.196381  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 604867us
I20260709 12:22:17.206651  8765 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.198022  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:17.207621  8220 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:17.119601 10287 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.203315  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.143958  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.205713  8064 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.208877 11004 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:17.214604  8069 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
W20260709 12:22:17.200338  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 612890us
I20260709 12:22:17.211177  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:17.215812  8145 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.217444  8144 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:17.111642 11002 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:17.136155 10798 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.220378  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:17.222662  8216 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:17.225277  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.226830  8218 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:17.102155 10996 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.228922 10913 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.229624  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 554) took 1092 ms. Trace:
I20260709 12:22:17.230093  8760 rpcz_store.cc:276] 0709 12:22:16.136768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.136925 (+   157us) service_pool.cc:224] Handling call
0709 12:22:17.229383 (+1092458us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b5400716454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:17.229524 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142431488}
I20260709 12:22:17.226276  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.133893 10851 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:17.205922 10889 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.237308 11001 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:17.237411 10962 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.237890 11000 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:17.238376 10979 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:22:17.209617 10910 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:17.236433  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:17.217878 11007 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:17.229035 10984 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260709 12:22:17.255028  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:17.256771  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 462) took 1095 ms. Trace:
I20260709 12:22:17.257057  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.210537 10961 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:22:17.201265 10701 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:22:17.241294 10851 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:17.239123 10978 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.218930 10991 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.175173 10935 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:22:17.244472  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:17.249467  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 173618us
I20260709 12:22:17.286262  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.257304  8137 rpcz_store.cc:276] 0709 12:22:16.161696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.161807 (+   111us) service_pool.cc:224] Handling call
0709 12:22:16.192461 (+ 30654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.195454 (+  2993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.195480 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.219290 (+ 23810us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.617776 (+398486us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:16.617818 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.617889 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.256479 (+638590us) raft_consensus.cc:1685] finished
0709 12:22:17.256507 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.256696 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":334579,"threads_started":1,"wal-append.queue_time_us":468670}
I20260709 12:22:17.245198  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.287680  8759 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:17.133615 10960 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.219247 10287 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.263278  8762 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:17.291431  8765 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:17.253249 10955 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.298277  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.249101 11005 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:17.258361 11007 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.297217  8145 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:17.256709 10822 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.261659 11000 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:17.308280  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:17.317989  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.318756  8759 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:17.255545 11001 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.263621 10859 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:17.358508  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.289952 10935 consensus_queue.cc:1243] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:17.210109 10993 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.234954 11002 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.287057 10991 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.247210 11009 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:22:17.255330 10910 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:17.378126 11010 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:17.378789 10999 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:22:17.308786 11013 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:17.321111 11005 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.310237 11014 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:17.348531 10669 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.457s	user 0.016s	sys 0.000s
I20260709 12:22:17.392973 10934 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:17.326290 11007 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:17.417851  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.396171  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1427) took 2194 ms. Trace:
I20260709 12:22:17.396847  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 405) took 1255 ms. Trace:
I20260709 12:22:17.329382 10834 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.394277 10913 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:17.359090 11001 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.420411  8211 rpcz_store.cc:276] 0709 12:22:16.141104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.165273 (+ 24169us) service_pool.cc:224] Handling call
0709 12:22:16.165721 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.195777 (+ 30056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.195824 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.208805 (+ 12981us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.562473 (+353668us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:16.562526 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.562615 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.396594 (+833979us) raft_consensus.cc:1685] finished
0709 12:22:17.396610 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.396779 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27157,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12467,"thread_start_us":279720,"threads_started":1,"wal-append.queue_time_us":483075}
I20260709 12:22:17.390471 10244 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.418331  8139 rpcz_store.cc:276] 0709 12:22:15.201827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.604113 (+402286us) service_pool.cc:224] Handling call
0709 12:22:15.630528 (+ 26415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:15.867374 (+236846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.867423 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:15.868820 (+  1397us) log.cc:844] Serialized 52 byte log entry
0709 12:22:16.757213 (+888393us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:16.794579 (+ 37366us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.866300 (+ 71721us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.984349 (+118049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.984441 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.395888 (+411447us) raft_consensus.cc:1685] finished
0709 12:22:17.395926 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.396109 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77023,"prepare.queue_time_us":19824,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":315578,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":31225,"thread_start_us":976578,"threads_started":2,"wal-append.queue_time_us":801353}
I20260709 12:22:17.430621 11002 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.430678 11015 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.433211 10913 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:17.433532 11006 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:17.434118 10913 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.435698 10900 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.406049 11005 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:17.416333 10934 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.443748  8216 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:17.412485 11013 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.456302 10960 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.436432  8758 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:17.427803 11014 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:17.379837 10851 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.424933 10996 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.432979 10834 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:17.416182 10669 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:17.472517  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.426040 11000 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.431394 11015 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.446895 10699 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.442848 10749 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.461515 10855 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:17.465723  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 117592us
I20260709 12:22:17.483728  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.437242 10244 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.463749 11013 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:17.478700 10996 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:17.480357  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.488884  8218 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:17.491942  8215 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:17.465673 11002 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:22:17.479555 10794 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260709 12:22:17.498283 11020 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:17.499354 10244 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:17.489976 10782 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.768s	user 0.007s	sys 0.007s
I20260709 12:22:17.501030  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.454845 10859 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:17.490207 10851 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:17.506989  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.508679  8067 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:17.509544  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:17.481312 10834 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:17.512948 10771 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.957s	user 0.014s	sys 0.000s
I20260709 12:22:17.515406  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.495661 10993 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.513252 10287 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.528385  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.512696 10968 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.503785 10794 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.530718  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.516850 11015 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.552384  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.531392 11020 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.528930 10822 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:17.561065  8061 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:17.568285  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:17.552379 10287 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:17.570967  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:17.572115  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:17.558665 10999 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:22:17.575626 10758 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.569015  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:17.577519 10890 consensus_meta.cc:287] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260709 12:22:17.582816 10834 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.569651  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.590137  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.603637  8756 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:22:17.593137 10742 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.004s
I20260709 12:22:17.594182  8141 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:17.607467  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.531327 11021 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.594237  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.545665 10968 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.599241  8137 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:17.601037  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.624648  8765 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:17.601903  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.554291 11015 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:22:17.564612 10910 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.633252 10910 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:17.633673 10910 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.634097 10910 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:17.608845 10742 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.622411 10900 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:17.558760 10993 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:22:17.627677  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.628871  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:17.627179  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:17.645143  8139 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:17.650652  8061 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:17.652586  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.624279 10669 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.640534 10900 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.657013 10900 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:17.661322 10794 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:17.665028  8067 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:22:17.667443  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.669014  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:17.545485 11014 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.637672 11015 consensus_queue.cc:1243] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:17.608083 10890 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.656057 10922 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.675899  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:17.698150  8067 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:17.683873 10834 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:17.659364 11007 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.721823 10834 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.722471 10834 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:17.673800 11005 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.774860  8070 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:17.677636 11022 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:17.778970  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.678135 11029 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.803941  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:17.804812  8765 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:17.724436 11007 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:17.843016 10822 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.802796 11022 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:17.857354 11022 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:17.818562 11029 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.727756 10934 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:17.865836  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:17.880856  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.892855  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 285447us
I20260709 12:22:17.894682  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:17.933132  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.933947  8064 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:17.934578  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.935316  8065 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:17.940887  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:17.945474  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:17.947710  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.862180 10810 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.836s	user 0.014s	sys 0.000s
I20260709 12:22:17.956090  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.958212  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:17.866565 10859 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.861908 10742 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:17.946972 10990 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260709 12:22:17.977339  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:17.968681  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:17.962497  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:17.867656 10904 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:17.995498  8064 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:18.012051  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.015874  8068 raft_consensus.cc:2410] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:17.961766 10490 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:18.058550  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.063066  8067 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:17.967213 10794 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.971225 10993 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.980731 10769 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:17.971275 10805 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:17.980417 10893 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:22:17.961782 11013 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:18.101298  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 132741us
I20260709 12:22:18.010144 10946 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:17.969311 10810 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.143649  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:17.979198 10859 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:18.137616 10991 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.003s
I20260709 12:22:18.114588 10702 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:18.188560  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.121364 10805 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.053014 10904 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:18.150131 10244 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.018s
I20260709 12:22:18.072995 10490 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:18.170207 11001 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.001s
I20260709 12:22:18.136602 10769 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:18.230262  8760 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 5: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:18.181769 10695 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:18.224529 10798 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.983s	user 0.015s	sys 0.000s
W20260709 12:22:18.251060 11035 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:22:18.122808 10993 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:18.265859  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 122308us
I20260709 12:22:18.315402  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:18.064486  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:18.290302 10244 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.000s	sys 0.019s
W20260709 12:22:18.302386  8138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1405) took 1401 ms (client timeout 1849 ms). Trace:
W20260709 12:22:18.320935  8138 rpcz_store.cc:269] 0709 12:22:16.901272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.942909 (+ 41637us) service_pool.cc:224] Handling call
0709 12:22:18.302169 (+1359260us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5400352854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:18.302315 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17929088}
I20260709 12:22:18.284400 10922 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:18.304646  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.288137 10805 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:18.312107  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 273331us
I20260709 12:22:18.318413  8067 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 2.
I20260709 12:22:18.285439 10991 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.330168  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1534) took 1099 ms. Trace:
I20260709 12:22:18.332666  8067 rpcz_store.cc:276] 0709 12:22:17.230909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.064127 (+833218us) service_pool.cc:224] Handling call
0709 12:22:18.330082 (+265955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.330747  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1522) took 1475 ms. Trace:
I20260709 12:22:18.321720 10695 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:18.337179  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.313745 10934 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:18.334349  8063 rpcz_store.cc:276] 0709 12:22:16.855856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.856133 (+   277us) service_pool.cc:224] Handling call
0709 12:22:18.304444 (+1448311us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800010598. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:18.330668 (+ 26224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27236608}
I20260709 12:22:18.338744  8067 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:18.339434  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 376) took 1167 ms. Trace:
I20260709 12:22:18.339845  8067 rpcz_store.cc:276] 0709 12:22:17.172022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.336584 (+1164562us) service_pool.cc:224] Handling call
0709 12:22:18.339364 (+  2780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.341012  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.296415 11001 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.347074  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.348263  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 384) took 1024 ms. Trace:
I20260709 12:22:18.348779  8063 rpcz_store.cc:276] 0709 12:22:17.323619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.346694 (+1023075us) service_pool.cc:224] Handling call
0709 12:22:18.348178 (+  1484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.350909  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.351749  8063 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:18.313951 10798 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.352447  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2578) took 1130 ms. Trace:
I20260709 12:22:18.357282  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2580) took 1122 ms. Trace:
I20260709 12:22:18.324124 10702 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:22:18.359910  8063 rpcz_store.cc:276] 0709 12:22:17.222208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.350535 (+1128327us) service_pool.cc:224] Handling call
0709 12:22:18.352377 (+  1842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.362516  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.363606  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1532) took 1152 ms. Trace:
I20260709 12:22:18.364743  8063 rpcz_store.cc:276] 0709 12:22:17.211494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.362131 (+1150637us) service_pool.cc:224] Handling call
0709 12:22:18.363532 (+  1401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.366053  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:18.356120 10900 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.001s
I20260709 12:22:18.359381 10695 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:18.366336 10780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.007s
I20260709 12:22:18.359027 10742 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:22:18.360188  8067 rpcz_store.cc:276] 0709 12:22:17.235005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.340699 (+1105694us) service_pool.cc:224] Handling call
0709 12:22:18.357226 (+ 16527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.391369  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.385797  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.405356  8063 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
W20260709 12:22:18.391222 10780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.015s	sys 0.007s
I20260709 12:22:18.408124  8067 raft_consensus.cc:2410] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:18.379402 10893 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:18.412247 10599 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:18.414963 10599 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:18.415297 10490 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.416086 10599 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.421404 10859 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:18.402623 11031 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:22:18.411278 10981 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.534s	user 0.014s	sys 0.025s
I20260709 12:22:18.422351 10805 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:18.427148  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 414085us
I20260709 12:22:18.435389  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:18.409795  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:18.437197  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.413908  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1535) took 1178 ms. Trace:
I20260709 12:22:18.434301 10817 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.438601  8067 rpcz_store.cc:276] 0709 12:22:17.235398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.390999 (+1155601us) service_pool.cc:224] Handling call
0709 12:22:18.413814 (+ 22815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.440083  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.438030  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:18.442359  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.413408 10810 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.391747 10695 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.459012  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.460951  8063 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:18.461149  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.461685  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2584) took 1168 ms. Trace:
I20260709 12:22:18.462296  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2583) took 1201 ms. Trace:
I20260709 12:22:18.462225  8063 rpcz_store.cc:276] 0709 12:22:17.293668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.458617 (+1164949us) service_pool.cc:224] Handling call
0709 12:22:18.461604 (+  2987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.462982  8067 rpcz_store.cc:276] 0709 12:22:17.293280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.460793 (+1167513us) service_pool.cc:224] Handling call
0709 12:22:18.462221 (+  1428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.463742  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.441787 10817 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:18.389465 10900 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.464597  8063 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:18.467674  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.459408  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:18.468425  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 394) took 4972 ms. Trace:
I20260709 12:22:18.416123 10490 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:18.472285  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.458359 10599 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:18.471243  8757 rpcz_store.cc:276] 0709 12:22:13.494179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.494290 (+   111us) service_pool.cc:224] Handling call
0709 12:22:13.498798 (+  4508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.790548 (+291750us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:14.031741 (+241193us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.217984 (+2186243us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.284168 (+ 66184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:16.296049 (+ 11881us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:16.296123 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.465960 (+2169837us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400447354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:18.466013 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.466148 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15690,"prepare.queue_time_us":1689000,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":1166,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":69496,"spinlock_wait_cycles":670393088,"thread_start_us":2398524,"threads_started":3,"wal-append.queue_time_us":1204091,"wal-append.run_cpu_time_us":2135,"wal-append.run_wall_time_us":2051620}
I20260709 12:22:18.477489  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:18.367182 10769 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.432299 10893 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.482406  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:18.483559  8144 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:18.467294 10244 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:18.488562  8138 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:18.490262  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:18.491106  8139 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:18.467280 10904 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:18.466331 10858 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.477018 10810 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:18.474512 10999 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.499506  8144 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:18.500871  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1389) took 3498 ms. Trace:
I20260709 12:22:18.510483  8142 rpcz_store.cc:276] 0709 12:22:15.002653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.106326 (+103673us) service_pool.cc:224] Handling call
0709 12:22:15.106745 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.099610 (+992865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.099649 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.121305 (+ 21656us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.559018 (+437713us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:16.559060 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.559147 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.410532 (+1851385us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:18.493239 (+ 82707us) raft_consensus.cc:1685] finished
0709 12:22:18.493268 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.500770 (+  7502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":559701,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8685,"spinlock_wait_cycles":573747456,"thread_start_us":1337421,"threads_started":2,"wal-append.queue_time_us":629903}
I20260709 12:22:18.503005 10695 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.510535  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:18.517138  8137 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:18.518221  8144 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:18.519616  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 170408us
W20260709 12:22:18.520730  8035 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.538s (SENT)
I20260709 12:22:18.524055  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:18.525035  8144 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:18.507202  8063 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:18.533995  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:18.477684 10490 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.534725  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:18.541592  8144 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:18.508849 10993 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.498071 10244 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:18.538708  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1537) took 1291 ms. Trace:
W20260709 12:22:18.532416 10851 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.017s	user 0.013s	sys 0.001s
W20260709 12:22:18.524271 10910 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.874s	user 0.002s	sys 0.011s
I20260709 12:22:18.518607 10991 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:18.546288  8063 rpcz_store.cc:276] 0709 12:22:17.247504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.534354 (+1286850us) service_pool.cc:224] Handling call
0709 12:22:18.538606 (+  4252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.550516  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:18.547711  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 500772us
I20260709 12:22:18.548218  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:18.552330 11044 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:18.552841  8138 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:18.553326  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:18.554780  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:18.555603  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2575) took 1348 ms. Trace:
I20260709 12:22:18.555930  8063 rpcz_store.cc:276] 0709 12:22:17.206755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.554458 (+1347703us) service_pool.cc:224] Handling call
0709 12:22:18.555547 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.556855  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.558251  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:18.559087  8063 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:18.552407 10759 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:18.560999  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:18.550123 11036 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:22:18.522125 10999 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.564743  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:18.551601 10910 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.566831  8138 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:18.544925 11001 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:18.575191  8063 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:18.576797  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.577824  8063 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:18.578738  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.579731  8063 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:18.551240 10900 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:18.619451  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54811.1us
I20260709 12:22:18.620458  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:18.621399  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2586) took 1327 ms. Trace:
I20260709 12:22:18.622125  8063 rpcz_store.cc:276] 0709 12:22:17.294195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.578460 (+1284265us) service_pool.cc:224] Handling call
0709 12:22:18.621322 (+ 42862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.623121  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:18.623981  8063 raft_consensus.cc:2410] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:18.624493  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1536) took 1384 ms. Trace:
I20260709 12:22:18.562337 10798 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.624873  8063 rpcz_store.cc:276] 0709 12:22:17.240218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.622840 (+1382622us) service_pool.cc:224] Handling call
0709 12:22:18.624422 (+  1582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.626066  8063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:22:18.626621  8063 raft_consensus.cc:606] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:18.571082 11047 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:18.627161  8139 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:18.580113 10970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.024s	sys 0.042s
W20260709 12:22:18.630373 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.699s	user 0.009s	sys 0.041s
W20260709 12:22:18.636333 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.714s	user 0.009s	sys 0.041s
I20260709 12:22:18.635857 10244 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:18.633342 10970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.835s	user 0.024s	sys 0.042s
I20260709 12:22:18.640911 11039 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:18.659543  8063 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:18.660702  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 372) took 1542 ms. Trace:
I20260709 12:22:18.661175  8063 rpcz_store.cc:276] 0709 12:22:17.118114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.658665 (+1540551us) service_pool.cc:224] Handling call
0709 12:22:18.659114 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.660334 (+  1220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.660611 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.663034  8063 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:18.663805  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2573) took 1543 ms. Trace:
I20260709 12:22:18.664258  8063 rpcz_store.cc:276] 0709 12:22:17.120112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.662440 (+1542328us) service_pool.cc:224] Handling call
0709 12:22:18.662809 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.663532 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.663743 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.646234 10780 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:18.672987  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:18.681849  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 61516.7us
I20260709 12:22:18.682375  8220 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:18.673554 10490 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.674525 10922 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.675482  8217 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:18.676052  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:18.640388 10965 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:18.683372  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:18.737962  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 373) took 1610 ms. Trace:
I20260709 12:22:18.687045  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:18.690773  8035 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.696s (SENT)
I20260709 12:22:18.738867  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:18.656213 11022 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.796s	user 0.013s	sys 0.000s
W20260709 12:22:18.742403  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51662.3us
W20260709 12:22:18.744030  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60916.7us
I20260709 12:22:18.681581 10780 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.745955  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:18.773711  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:18.753614 10900 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:22:18.687431 10798 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:22:18.774133  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:18.775153  8063 rpcz_store.cc:276] 0709 12:22:17.128003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.665257 (+1537254us) service_pool.cc:224] Handling call
0709 12:22:18.665772 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.737373 (+ 71601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.737435 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.737511 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:18.737568 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.737682 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.737874 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5016}
I20260709 12:22:18.774546  8214 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:18.752421 11039 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:18.743661 10759 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:18.759384 11042 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 12:22:18.779219 11050 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:22:18.829366  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55316us
I20260709 12:22:18.829993  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 374) took 1691 ms. Trace:
I20260709 12:22:18.775272 10780 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:18.778862 10893 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.778496 11047 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:18.855844  8063 rpcz_store.cc:276] 0709 12:22:17.138609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.829033 (+1690424us) service_pool.cc:224] Handling call
0709 12:22:18.829391 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.829588 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.829613 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.829657 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:18.829695 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.829754 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.829897 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.743930 11022 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:18.867519  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2630) took 1666 ms (client timeout 1874 ms). Trace:
W20260709 12:22:18.893208  8218 rpcz_store.cc:269] 0709 12:22:17.201568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.201741 (+   173us) service_pool.cc:224] Handling call
0709 12:22:18.867324 (+1665583us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54000ca3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:18.867451 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55190784}
I20260709 12:22:18.853803 10244 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:18.876295  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 467) took 2713 ms (client timeout 2098 ms). Trace:
W20260709 12:22:18.897297  8143 rpcz_store.cc:269] 0709 12:22:16.163193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.424459 (+261266us) service_pool.cc:224] Handling call
0709 12:22:18.876027 (+2451568us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400042754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:18.876171 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692713856}
W20260709 12:22:18.877460  8068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1528) took 1694 ms (client timeout 1740 ms). Trace:
I20260709 12:22:18.861136 10910 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:18.882895  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 379) took 1680 ms. Trace:
I20260709 12:22:18.900971  8062 rpcz_store.cc:276] 0709 12:22:17.202410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.881988 (+1679578us) service_pool.cc:224] Handling call
0709 12:22:18.882363 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.882549 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.882575 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.882615 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:18.882647 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.882702 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.882820 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:18.740470 10922 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.865836 11023 raft_consensus.cc:993] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
W20260709 12:22:18.898380  8068 rpcz_store.cc:269] 0709 12:22:17.182763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.192330 (+  9567us) service_pool.cc:224] Handling call
0709 12:22:18.877198 (+1684868us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002030d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:18.877386 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889834368}
I20260709 12:22:18.831233 11039 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:18.858382  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 421) took 1270 ms. Trace:
I20260709 12:22:18.914405 10922 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:18.908841  8758 rpcz_store.cc:276] 0709 12:22:17.587920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.593918 (+  5998us) service_pool.cc:224] Handling call
0709 12:22:17.634203 (+ 40285us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:17.634708 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.634741 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:17.635541 (+   800us) log.cc:844] Serialized 78 byte log entry
0709 12:22:18.222237 (+586696us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:18.232439 (+ 10202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.248281 (+ 15842us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.830215 (+581934us) raft_consensus.cc:1685] finished
0709 12:22:18.831122 (+   907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.858276 (+ 27154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27389,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":489320,"threads_started":1,"wal-append.queue_time_us":687380}
I20260709 12:22:18.917572 11039 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.925375  8067 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:18.850973 10798 consensus_queue.cc:1243] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:22:18.905594 10834 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.183s	user 0.013s	sys 0.003s
I20260709 12:22:18.938792  8214 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:18.919967 10958 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:18.906050 10244 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:18.931505 10722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.231s	user 0.026s	sys 0.012s
I20260709 12:22:18.845036 10965 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:18.929117 10999 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:18.963644  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 758) took 1003 ms. Trace:
I20260709 12:22:18.930907 10842 raft_consensus.cc:1081] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:22:18.965103  8765 rpcz_store.cc:276] 0709 12:22:17.960982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.961231 (+   249us) service_pool.cc:224] Handling call
0709 12:22:17.984508 (+ 23277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:17.985035 (+   527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:17.985077 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.016176 (+ 31099us) log.cc:844] Serialized 52 byte log entry
0709 12:22:18.332487 (+316311us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:18.332529 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.332594 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.963313 (+630719us) raft_consensus.cc:1685] finished
0709 12:22:18.963344 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.963574 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146900,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":18802,"thread_start_us":244793,"threads_started":1,"wal-append.queue_time_us":379010}
I20260709 12:22:18.902071 10817 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.968839  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:18.961411 10722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.270s	user 0.027s	sys 0.012s
I20260709 12:22:18.969799  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:18.953197 10958 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:18.977013  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.977252  8138 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:18.955431 10850 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:18.959133 10891 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:18.968751 11047 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:18.971818  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 418) took 2146 ms. Trace:
I20260709 12:22:18.953712 10834 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.976342  8143 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:18.931191 10934 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:22:18.975415 10780 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:18.981230  8219 rpcz_store.cc:276] 0709 12:22:16.825419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.825621 (+   202us) service_pool.cc:224] Handling call
0709 12:22:16.826054 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:16.831502 (+  5448us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:18.546833 (+1715331us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18002fb660. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:18.644772 (+ 97939us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.746441 (+101669us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.773061 (+ 26620us) log.cc:844] Serialized 52 byte log entry
0709 12:22:18.773221 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:18.773260 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.773328 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.971598 (+198270us) raft_consensus.cc:1685] finished
0709 12:22:18.971673 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.971774 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7021,"prepare.queue_time_us":45946,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":8742,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":58080,"spinlock_wait_cycles":7902080,"thread_start_us":171024,"threads_started":2,"wal-append.queue_time_us":178509}
I20260709 12:22:18.979260 10850 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:18.978859 10774 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:18.979101 10891 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:18.993301  8066 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:18.997638 11000 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.002357 10817 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:19.002463 10805 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.006171  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 756) took 1117 ms. Trace:
I20260709 12:22:19.006683  8756 rpcz_store.cc:276] 0709 12:22:17.889262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.889482 (+   220us) service_pool.cc:224] Handling call
0709 12:22:17.975995 (+ 86513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:18.132100 (+156105us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:18.169442 (+ 37342us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.467570 (+298128us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.480734 (+ 13164us) log.cc:844] Serialized 52 byte log entry
0709 12:22:18.480959 (+   225us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:18.481013 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.005665 (+524652us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400447d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:19.005726 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.005786 (+    60us) raft_consensus.cc:1685] finished
0709 12:22:19.005882 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.006099 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9153,"prepare.queue_time_us":37120,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5182,"raft.queue_time_us":61522,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6217,"spinlock_wait_cycles":397706880,"thread_start_us":219696,"threads_started":1,"wal-append.queue_time_us":330996}
I20260709 12:22:18.989632 10782 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:19.014279 10958 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.048928 10958 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:19.053237 10890 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:19.053439  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.016129 10973 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.054433 10973 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.056270  8143 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:22:19.056910  8143 pending_rounds.cc:85] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 4
I20260709 12:22:19.057236  8143 pending_rounds.cc:107] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:19.057705  8143 raft_consensus.cc:2889] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.037492 10780 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:19.017937  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.067850  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:19.068434  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50597.2us
I20260709 12:22:19.021946 11013 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.025988 10757 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:19.018693 11025 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.450s	user 0.018s	sys 0.011s
I20260709 12:22:19.027501  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2627) took 1830 ms. Trace:
I20260709 12:22:19.069685  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.069435  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:19.069525 10757 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:19.071295  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.071559 11045 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:19.071981  8216 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:19.072013 10757 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.073516 10757 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:18.989423 10244 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.033774 11022 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.037420  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:22:19.038182  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:19.038975 10994 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.989s	user 0.019s	sys 0.019s
W20260709 12:22:19.046190 10997 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.926s	user 0.002s	sys 0.015s
W20260709 12:22:19.048996  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 413) took 2831 ms (client timeout 2098 ms). Trace:
I20260709 12:22:19.060902  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.015570 10891 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.062336  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:19.062634  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.063298  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2574) took 1926 ms. Trace:
I20260709 12:22:19.063760  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.064888  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.065349  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.016932 10850 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.065769 10694 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:19.067126  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.068732  8220 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:19.069000  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.070420  8211 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.062249 10968 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.030030 10834 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.030349 11047 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.066272  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:19.219476  8143 raft_consensus.cc:2376] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6. Re-sending same reply.
I20260709 12:22:19.073635  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.094175  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:19.092835  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.221290  8219 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:19.078662  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 391) took 1259 ms. Trace:
I20260709 12:22:19.148912  8065 raft_consensus.cc:606] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.222523  8065 raft_consensus.cc:614] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.149974  8144 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:19.222409  8067 rpcz_store.cc:276] 0709 12:22:17.819910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.467420 (+647510us) service_pool.cc:224] Handling call
0709 12:22:19.078464 (+611044us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400202bd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:19.078601 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994858880}
I20260709 12:22:19.223701  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.150316  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.224004  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:19.151192  8139 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.151574  8138 raft_consensus.cc:2368] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
I20260709 12:22:19.101747  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.152307  8214 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.228111  8067 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:19.229898  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:19.230841  8067 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:19.152554  8069 rpcz_store.cc:276] 0709 12:22:17.137148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.142867 (+  5719us) service_pool.cc:224] Handling call
0709 12:22:19.063120 (+1920253us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5400321ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:19.063233 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4703488}
I20260709 12:22:19.153784  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.233821  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:19.234089  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.234647  8067 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:19.235523  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:19.151204  8215 rpcz_store.cc:269] 0709 12:22:16.217510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.217854 (+   344us) service_pool.cc:224] Handling call
0709 12:22:19.048796 (+2830942us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400373a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:19.048918 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901533056}
I20260709 12:22:19.237071  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.238281  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:19.249699  8214 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:19.182554  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:19.269161  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 86747.3us
W20260709 12:22:19.215309  8035 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.550s (SENT)
I20260709 12:22:19.216701  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.150934  8142 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:19.213292  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:19.079543 10988 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 2.171s	user 0.015s	sys 0.024s
I20260709 12:22:19.070039  8212 rpcz_store.cc:276] 0709 12:22:17.196649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.196774 (+   125us) service_pool.cc:224] Handling call
0709 12:22:17.197096 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:17.349319 (+152223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:17.349596 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.471837 (+122241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:17.471920 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:17.471991 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.018134 (+1546143us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:19.027224 (+  9090us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002b4654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:19.027278 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.027426 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":11222,"raft.queue_time_us":129,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7596,"spinlock_wait_cycles":357779584,"thread_start_us":121117,"threads_started":1,"wal-append.queue_time_us":197922}
I20260709 12:22:19.271540  8216 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:19.085945 11033 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:19.256376  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:19.257905  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.276777  8211 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:19.277724  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.278504  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.258441  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:19.258876  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:19.260488  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166433us
I20260709 12:22:19.070438 10890 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:19.261431  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 187889us
I20260709 12:22:19.282013  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.283689  8729 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:19.079316 10774 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.285004 10774 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.288862 11065 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:19.290324  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.288462 10774 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.262888  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.291884 10698 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:19.292863  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.292666 10698 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.294363  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.295644 10698 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:19.263550  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 161930us
I20260709 12:22:19.296183  8145 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:19.264854  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.265302  8065 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:19.297693  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2582) took 2037 ms. Trace:
I20260709 12:22:19.265483  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.211058  8218 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.154596 10995 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.091847 10973 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:19.271375  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:19.298990 10995 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.299522  8138 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:19.299821  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 84532.9us
I20260709 12:22:19.084132 11005 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:19.300661  8035 leader_election.cc:336] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.564s (SENT)
I20260709 12:22:19.298045  8065 rpcz_store.cc:276] 0709 12:22:17.260446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.264685 (+2004239us) service_pool.cc:224] Handling call
0709 12:22:19.264965 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.297424 (+ 32459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.297635 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.301429 10995 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:19.301895  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.298933  8186 connection.cc:256] RPC call timeout handler was delayed by -1.0288486840004225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:22:19.302377  8065 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:22:19.302609  8186 connection.cc:256] RPC call timeout handler was delayed by -1.0108486840003934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:22:19.271487  8139 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:19.154650 10694 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:19.303009  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2588) took 1367 ms. Trace:
I20260709 12:22:19.072134 11045 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:19.303439  8065 rpcz_store.cc:276] 0709 12:22:17.935469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.301710 (+1366241us) service_pool.cc:224] Handling call
0709 12:22:19.301989 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.302776 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.302955 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.303937 11045 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.303853 10694 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.305565 10694 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.306108  8138 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:19.307408  8138 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:19.273955  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.308245  8215 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:19.309468  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.310463  8215 raft_consensus.cc:2368] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4.
I20260709 12:22:19.311429  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.272661  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.157914 10599 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.291360 10922 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:19.298381  8143 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:19.274873  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.312004 11045 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.312575  8215 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:19.318414  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.211571  8137 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:19.217037 10850 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.313081  8212 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:19.320385  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.321199  8211 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:19.322178  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.322809  8211 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:19.323156  8035 leader_election.cc:400] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 3 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4.
I20260709 12:22:19.324494  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.325438  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.250511 10891 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.326735  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.327057  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:19.329445  8142 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:19.330488  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:19.332401  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51721.1us
I20260709 12:22:19.338907  8220 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:19.316471  8214 raft_consensus.cc:2368] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4.
I20260709 12:22:19.341085  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.360359  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:19.365747  8219 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:19.367336  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.321199  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:19.383641  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62502.7us
I20260709 12:22:19.384292  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.266871 10910 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:19.381891  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.384485  8137 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:19.275972 10893 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:19.273295 11059 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:19.218660 10842 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:22:19.275489 11033 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:19.278714 10834 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:19.319888 10890 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:19.324494 11000 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:19.313114 10599 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.385787  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.388878  8218 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:19.413910  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.472936  8062 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:19.473069  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.473657  8218 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:19.473802  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.473953  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:19.474472  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.475034  8139 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:19.475112  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:19.415465  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.391786  8141 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:19.468957  8216 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:19.399734  8214 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:19.479154  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.440819  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.480223  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.480463  8143 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:19.412976  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.476897  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.480551  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.483381  8138 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:19.313416 10922 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.413208  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.386061  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:19.486657  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.475519  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.487579  8219 raft_consensus.cc:2368] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6.
I20260709 12:22:19.488323  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.406246  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.498456  8211 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:19.395112  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:19.389918  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.499295  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.499686  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.500361  8219 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:19.390460  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.502635  8220 raft_consensus.cc:2376] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:19.503798  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.504504  8220 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:19.506224  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.508512  8220 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:19.469978  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:19.435761  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.510414  8212 raft_consensus.cc:2376] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:19.510776  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:19.439036  8215 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:19.511555  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.512696  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.489988  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.514163  8212 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:19.514716  8218 raft_consensus.cc:2410] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.515802  8212 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:19.404860 10997 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:22:19.522683  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.523567  8138 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:19.483777  8214 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:19.525780  8214 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:19.393175 10988 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:19.393651 10995 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:19.534096  8212 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:19.426457 10994 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:22:19.511808  8139 raft_consensus.cc:2368] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:19.515882  8218 pending_rounds.cc:85] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 1
I20260709 12:22:19.509893  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:19.535765  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.509111 11002 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:19.519157 10774 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:19.509850 11045 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:19.413830 11059 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.434397 10890 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.414762 10893 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:19.426944 10834 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.434793 11000 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.477941 10698 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:22:19.407575 10817 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:19.487157  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 101189us
I20260709 12:22:19.537981  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.569334  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.570207  8139 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:19.538403  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.520259  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.533875 10995 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.535831  8218 pending_rounds.cc:107] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:22:19.575373  8218 raft_consensus.cc:2889] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.508771 10780 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:19.544080  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.561084  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.581710  8141 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:19.389317 10999 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:19.563444  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1428) took 4319 ms. Trace:
I20260709 12:22:19.476897  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:19.563946  8211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:22:19.591427  8211 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.591797  8211 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:19.574020  8184 connection.cc:256] RPC call timeout handler was delayed by -2.038087508999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:22:19.579269  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 407) took 3412 ms. Trace:
I20260709 12:22:19.542469 11002 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:19.527796  8219 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:19.560976 11059 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:19.566526 10893 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.592898  8213 rpcz_store.cc:276] 0709 12:22:16.166689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.167122 (+   433us) service_pool.cc:224] Handling call
0709 12:22:16.167481 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.171314 (+  3833us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:16.540204 (+368890us) log.cc:844] Serialized 14 byte log entry
0709 12:22:16.628777 (+ 88573us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.629275 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.629434 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:16.629472 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.629544 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.078965 (+2449421us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:19.578882 (+499917us) raft_consensus.cc:1685] finished
0709 12:22:19.579011 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.579187 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3355,"prepare.queue_time_us":637241,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":106533,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":18347,"spinlock_wait_cycles":544119168,"thread_start_us":417333,"threads_started":2,"wal-append.queue_time_us":288169}
W20260709 12:22:19.592867  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.603685  8184 connection.cc:256] RPC call timeout handler was delayed by -1.8571875090001413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:22:19.604177  8184 connection.cc:256] RPC call timeout handler was delayed by -1.5727875090001362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 12:22:19.573179 11023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.056s	sys 0.042s
I20260709 12:22:19.566318 11000 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:19.578065 11056 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.056s
I20260709 12:22:19.566049 10834 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:19.580387 10995 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:19.593364 11039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.037s	sys 0.037s
I20260709 12:22:19.589071 10999 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.590457 10817 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:19.535761 11033 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.605803 10934 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.615459 11023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.057s	sys 0.042s
W20260709 12:22:19.606900 10980 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.778s	user 0.031s	sys 0.035s
W20260709 12:22:19.618517 11056 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.057s
I20260709 12:22:19.671088 11029 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:19.730041 10934 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:19.633944 11039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.037s	sys 0.040s
W20260709 12:22:19.734496 10980 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.919s	user 0.031s	sys 0.036s
I20260709 12:22:19.638455 10999 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:19.650209 11065 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:19.678090 11002 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.864542 11002 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:19.873567 11065 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.858239 11059 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:19.915648  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.501304  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:19.923167  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 421768us
W20260709 12:22:19.927170  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.927982  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.929252  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.003s	sys 0.013s
W20260709 12:22:19.929738  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.003s	sys 0.013s
I20260709 12:22:19.931360  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2576) took 2717 ms. Trace:
I20260709 12:22:19.571002  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.577567  8143 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:19.475824  8137 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:19.627166  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 343533us
I20260709 12:22:19.592837 10780 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.862389 11000 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.934839  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1391) took 4930 ms. Trace:
I20260709 12:22:20.045003 10698 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:20.045897 10698 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:20.044886  8140 rpcz_store.cc:276] 0709 12:22:15.003944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.376084 (+372140us) service_pool.cc:224] Handling call
0709 12:22:15.376444 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.446308 (+ 69864us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:16.584497 (+1138189us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.024228 (+439731us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:17.057072 (+ 32844us) log.cc:844] Serialized 26 byte log entry
0709 12:22:17.057346 (+   274us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:17.057451 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.057583 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.038253 (+1980670us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:19.934071 (+895818us) raft_consensus.cc:1685] finished
0709 12:22:19.934239 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.934560 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44511,"prepare.queue_time_us":1130267,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":7313,"raft.queue_time_us":447923,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":25739,"spinlock_wait_cycles":263699712,"thread_start_us":1384624,"threads_started":3,"wal-append.queue_time_us":362307}
W20260709 12:22:20.020685  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48155.6us
I20260709 12:22:20.021888  8211 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:20.025750  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 752) took 2781 ms (client timeout 2646 ms). Trace:
I20260709 12:22:19.589255  8146 rpcz_store.cc:276] 0709 12:22:15.243736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.637456 (+393720us) service_pool.cc:224] Handling call
0709 12:22:15.637941 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:16.617861 (+979920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.617895 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:16.618372 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:22:16.939248 (+320876us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:17.012672 (+ 73424us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.025878 (+ 13206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.025991 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:18.881116 (+1855125us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b180045e5c0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:19.045413 (+164297us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:19.563180 (+517767us) raft_consensus.cc:1685] finished
0709 12:22:19.563206 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.563378 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12835,"prepare.queue_time_us":65433,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":185656,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":26295,"spinlock_wait_cycles":120525440,"thread_start_us":1258281,"threads_started":2,"wal-append.queue_time_us":419215}
I20260709 12:22:20.042578  8144 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:22:19.957741  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.000s	sys 0.014s
I20260709 12:22:19.637223 10599 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:20.047806 10698 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:19.932824  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:19.933916  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.050336 10817 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:19.931881  8063 rpcz_store.cc:276] 0709 12:22:17.213749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.892854 (+1679105us) service_pool.cc:224] Handling call
0709 12:22:18.893290 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.893557 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:18.961442 (+ 67885us) log.cc:844] Serialized 14 byte log entry
0709 12:22:19.930474 (+969032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.930603 (+   129us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:19.930751 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.930905 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.931223 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94744,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1598,"thread_start_us":1027395,"threads_started":2}
W20260709 12:22:20.053381  8760 rpcz_store.cc:269] 0709 12:22:17.243979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.244180 (+   201us) service_pool.cc:224] Handling call
0709 12:22:20.025069 (+2780889us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54005b0754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:20.025416 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172698496}
I20260709 12:22:20.049928  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:20.087755  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.018s
I20260709 12:22:20.028606 10934 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.130970  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:20.146930  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 57054us
W20260709 12:22:20.136395  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 839536us
W20260709 12:22:20.140920 10694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.009s
W20260709 12:22:20.140697 10774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.033s
I20260709 12:22:20.160651  8138 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:22:20.158632 10694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.009s
I20260709 12:22:20.168752  8141 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:20.170866  8728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.006s	sys 0.035s
W20260709 12:22:20.171190  8069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.016s	sys 0.021s
I20260709 12:22:20.171204 11023 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:20.172109  8064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.008s
W20260709 12:22:20.172204 10244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.008s	sys 0.003s
W20260709 12:22:20.172746  8064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.009s	sys 0.008s
W20260709 12:22:20.173311 10978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.010s
W20260709 12:22:20.173812 10978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.010s
I20260709 12:22:20.174612  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2581) took 2914 ms. Trace:
W20260709 12:22:20.179246 11037 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.847s	user 0.009s	sys 0.019s
I20260709 12:22:20.179759  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:20.171442  8728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.007s	sys 0.035s
I20260709 12:22:20.180819 10780 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:20.181638  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.049s
W20260709 12:22:20.182032  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.015s	sys 0.049s
I20260709 12:22:20.183389 10798 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:20.184661 10798 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.185907  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.187419  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.187695 10798 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:20.191759 11066 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.703s	user 0.011s	sys 0.026s
I20260709 12:22:20.193864  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:20.195740  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1533) took 2967 ms (client timeout 1688 ms). Trace:
W20260709 12:22:20.169148 10774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.004s	sys 0.034s
I20260709 12:22:20.202109 11084 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.205561  8211 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:20.172797 10244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.003s
W20260709 12:22:20.171669  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.211858 10922 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:20.213361  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.171754  8069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.016s	sys 0.021s
W20260709 12:22:20.166458  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.023s	sys 0.020s
W20260709 12:22:20.166527  8217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.014s
I20260709 12:22:20.210162  8138 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:20.171298  8215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.009s
W20260709 12:22:20.219781  8217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.001s	sys 0.014s
W20260709 12:22:20.196439  8061 rpcz_store.cc:269] 0709 12:22:17.227691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.587398 (+359707us) service_pool.cc:224] Handling call
0709 12:22:20.195180 (+2607782us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5400346054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:20.195451 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32425728}
I20260709 12:22:20.175148  8064 rpcz_store.cc:276] 0709 12:22:17.260153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.010093 (+1749940us) service_pool.cc:224] Handling call
0709 12:22:19.010489 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.010699 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:19.471433 (+460734us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.173812 (+702379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.173948 (+   136us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.174118 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.174267 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.174514 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1991,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1172,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":292,"thread_start_us":1154169,"threads_started":2}
W20260709 12:22:20.224548  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.024s	sys 0.021s
W20260709 12:22:20.225162  8215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.015s	sys 0.010s
I20260709 12:22:20.230895  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.235122 10544 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.236130 11000 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.237180 11059 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:20.239028  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.228591  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2585) took 2934 ms. Trace:
I20260709 12:22:20.217804 10774 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:20.270234  8070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 381) took 3034 ms (client timeout 1613 ms). Trace:
W20260709 12:22:20.271075  8070 rpcz_store.cc:269] 0709 12:22:17.235945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.506798 (+270853us) service_pool.cc:224] Handling call
0709 12:22:20.269487 (+2762689us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540011e4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:20.269868 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490422528}
I20260709 12:22:20.272876 11084 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.240188  8069 rpcz_store.cc:276] 0709 12:22:17.293946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.275943 (+1981997us) service_pool.cc:224] Handling call
0709 12:22:19.276223 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.276414 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:19.327366 (+ 50952us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.223323 (+895957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.223452 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.223609 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.223750 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.228515 (+  4765us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51086,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1104,"thread_start_us":888274,"threads_started":1}
W20260709 12:22:20.278276  8110 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.012s	sys 0.013s
W20260709 12:22:20.290680  8110 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.013s	sys 0.013s
W20260709 12:22:20.298681  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0149204600002122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:22:20.289310  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.023s
W20260709 12:22:20.297254  8145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.010s
W20260709 12:22:20.301175  8218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.006s
I20260709 12:22:20.300380  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:20.312311  8218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.006s
W20260709 12:22:20.311853  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.007s	sys 0.024s
I20260709 12:22:20.327886  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1544) took 1148 ms. Trace:
W20260709 12:22:20.329416  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 859463us
I20260709 12:22:20.331193  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:20.332757  8035 leader_election.cc:336] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.150s (SENT)
I20260709 12:22:20.328018 10774 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.333585  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:20.315601 10794 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:22:20.350724  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2577) took 3131 ms. Trace:
I20260709 12:22:20.316676 10244 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:20.342202  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 162696us
I20260709 12:22:20.351487 11002 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:20.352077 10244 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.340298 11084 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:20.309774  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 975848us
I20260709 12:22:20.351225  8062 rpcz_store.cc:276] 0709 12:22:17.218734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.901888 (+1683154us) service_pool.cc:224] Handling call
0709 12:22:18.927622 (+ 25734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.473361 (+545739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.340597 (+867236us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400395dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:20.350529 (+  9932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253215488}
I20260709 12:22:20.356324 10244 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:20.358381  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:20.298697  8064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:22:20.359408  8137 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:20.359841  8064 raft_consensus.cc:606] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.360668  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1546) took 1098 ms. Trace:
W20260709 12:22:20.354182  8065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.000s	sys 0.028s
W20260709 12:22:20.321393  8145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.000s	sys 0.011s
I20260709 12:22:20.360872  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51926 (request call id 9) took 1053 ms. Trace:
I20260709 12:22:20.357323  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:20.364123  8144 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:20.363694  8064 rpcz_store.cc:276] 0709 12:22:19.307599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.259686 (+952087us) service_pool.cc:224] Handling call
0709 12:22:20.360754 (+101068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28416}
W20260709 12:22:20.363478  8065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.001s	sys 0.029s
I20260709 12:22:20.366516  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.354815  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.370223 11065 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:20.361140  8062 rpcz_store.cc:276] 0709 12:22:19.262168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.359265 (+1097097us) service_pool.cc:224] Handling call
0709 12:22:20.359845 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.360229 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.360260 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.360324 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.360380 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.360455 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.360573 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.374418  8062 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:20.374857  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.376062  8756 raft_consensus.cc:2368] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:20.375500  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1547) took 1112 ms. Trace:
I20260709 12:22:20.377285  8062 rpcz_store.cc:276] 0709 12:22:19.262634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.373576 (+1110942us) service_pool.cc:224] Handling call
0709 12:22:20.374060 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.374921 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.375436 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.379942  8061 pending_rounds.cc:85] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 3
W20260709 12:22:20.376317  8109 connection.cc:256] RPC call timeout handler was delayed by -1.6010385399999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:22:20.309116 11079 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:20.380690  8109 connection.cc:256] RPC call timeout handler was delayed by -1.5830385399999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:22:20.380880  8756 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:20.375178 11065 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:20.381234 11079 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:20.379993  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1548) took 1117 ms. Trace:
W20260709 12:22:20.315845  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51338.3us
I20260709 12:22:20.383431  8069 rpcz_store.cc:276] 0709 12:22:19.179838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.300937 (+1121099us) service_pool.cc:224] Handling call
0709 12:22:20.326847 (+ 25910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.327336 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.327375 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.327441 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.327489 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.327577 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.327764 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.364212  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 437) took 1254 ms. Trace:
I20260709 12:22:20.393250  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:20.393831  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0700385400000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27799999999999997s for a response
I20260709 12:22:20.315675 10599 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:20.394411 11065 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.394810 10599 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.381743  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1545) took 1094 ms. Trace:
I20260709 12:22:20.396904  8063 rpcz_store.cc:276] 0709 12:22:19.221466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.309077 (+1087611us) service_pool.cc:224] Handling call
0709 12:22:20.315526 (+  6449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.315889 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.315924 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.316005 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.316041 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.316098 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.316230 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.397804 10599 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.399554  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.399857  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2589) took 2044 ms. Trace:
I20260709 12:22:20.401505 10769 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:20.400247  8065 rpcz_store.cc:276] 0709 12:22:18.355747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.314476 (+958729us) service_pool.cc:224] Handling call
0709 12:22:19.315113 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.315962 (+   849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.316012 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.320431 (+  4419us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.377972 (+1057541us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:20.382578 (+  4606us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.399473 (+ 16895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.399604 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.399655 (+    51us) raft_consensus.cc:1685] finished
0709 12:22:20.399667 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.399796 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1188,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":131,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"thread_start_us":938487,"threads_started":1,"wal-append.queue_time_us":944204}
I20260709 12:22:20.403985  8144 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:22:20.378842 10995 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.009s
I20260709 12:22:20.382714  8062 rpcz_store.cc:276] 0709 12:22:19.262897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.378666 (+1115769us) service_pool.cc:224] Handling call
0709 12:22:20.379167 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.379579 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.379605 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.379716 (+   111us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.379778 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.379830 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.379941 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:20.396389  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 377) took 3209 ms (client timeout 1909 ms). Trace:
I20260709 12:22:20.384927  8061 pending_rounds.cc:107] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:22:20.432909  8061 raft_consensus.cc:2889] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.432444  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:20.440778  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52678us
W20260709 12:22:20.375591 10891 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.994s	user 0.000s	sys 0.016s
W20260709 12:22:20.431130  8066 rpcz_store.cc:269] 0709 12:22:17.187074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.682427 (+495353us) service_pool.cc:224] Handling call
0709 12:22:20.395848 (+2713421us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400347454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:20.396179 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753304960}
I20260709 12:22:20.451651  8760 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:20.444389 10995 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.432330 10544 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:20.466631  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.388513  8217 rpcz_store.cc:276] 0709 12:22:19.110207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.110331 (+   124us) service_pool.cc:224] Handling call
0709 12:22:19.110662 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.110882 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:19.217469 (+106587us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.259461 (+1041992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.286662 (+ 27201us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:20.312939 (+ 26277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.363944 (+ 51005us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.364122 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106365,"prepare.run_cpu_time_us":208,"prepare.run_wall_time_us":5263,"raft.queue_time_us":592060,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":330,"spinlock_wait_cycles":93546880,"thread_start_us":1002186,"threads_started":2,"wal-append.queue_time_us":948927}
I20260709 12:22:20.444012 11084 raft_consensus.cc:2764] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:20.402413 10769 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:20.484082  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 85314.8us
I20260709 12:22:20.467000 10995 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:20.486059  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 155153us
I20260709 12:22:20.447438 10244 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:20.484881 11047 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.501961  8761 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.499085  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.510075  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:20.498252 10850 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.100s	user 0.007s	sys 0.016s
I20260709 12:22:20.524945 11079 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.526152 10769 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.527014 11097 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.528842 11047 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:20.535375 10999 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.699s	user 0.001s	sys 0.010s
I20260709 12:22:20.536216 10999 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.539155 10999 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.527014 10769 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:20.540182 10769 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.540609 10769 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:20.540876  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47019.7us
W20260709 12:22:20.542044  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.542603  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.543215  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.545496  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82361.9us
W20260709 12:22:20.547529 10890 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.991s	user 0.003s	sys 0.012s
W20260709 12:22:20.549571 11096 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.337s	user 0.003s	sys 0.000s
I20260709 12:22:20.551468  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:20.547475  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.548033 10890 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:20.583482  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 283355us
I20260709 12:22:20.583606  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.581730  8186 leader_election.cc:400] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
I20260709 12:22:20.586305  8186 leader_election.cc:403] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:20.586826  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67741.9us
I20260709 12:22:20.588433  8214 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:20.589080  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:20.514602 10544 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.512336 10244 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:20.601092  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.603856  8065 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:20.606967  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 122693us
I20260709 12:22:20.604301 10544 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.631085  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.633625  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.618738 11047 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.637315  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 394) took 2099 ms. Trace:
I20260709 12:22:20.646441  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.646801 11101 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.647533 11101 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.647980  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.655522  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1450) took 1236 ms. Trace:
I20260709 12:22:20.648000  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.624362 11097 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
W20260709 12:22:20.648578  8791 heartbeater.cc:646] Failed to heartbeat to 127.6.182.190:33539 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.182.190:33539 timed out after 15.000s (SENT)
I20260709 12:22:20.669835  8065 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:20.674122  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.674881  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.677745  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.725664  8067 raft_consensus.cc:2410] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:20.726428 10835 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:20.727393 10835 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.657083  8145 rpcz_store.cc:276] 0709 12:22:19.408951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.413583 (+  4632us) service_pool.cc:224] Handling call
0709 12:22:19.462192 (+ 48609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.462711 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.462751 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.463320 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.363335 (+900015us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.548798 (+185463us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:20.607655 (+ 58857us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.622117 (+ 14462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.630278 (+  8161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.630358 (+    80us) raft_consensus.cc:1685] finished
0709 12:22:20.636133 (+  5775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.645452 (+  9319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20439,"prepare.queue_time_us":248785,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4802,"raft.queue_time_us":894,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17000,"spinlock_wait_cycles":16547584,"thread_start_us":1073371,"threads_started":2,"wal-append.queue_time_us":697906}
W20260709 12:22:20.729761  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62136.9us
I20260709 12:22:20.644186  8070 rpcz_store.cc:276] 0709 12:22:18.532458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.272685 (+1740227us) service_pool.cc:224] Handling call
0709 12:22:20.273418 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.273916 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:20.497452 (+223536us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.631419 (+133967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.631487 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:20.631540 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.631613 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.631737 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16880,"prepare.queue_time_us":63232,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":14487,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":9049,"thread_start_us":261794,"threads_started":2}
W20260709 12:22:20.736528  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 227747us
W20260709 12:22:20.737918  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 105358us
W20260709 12:22:20.734542  8110 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.874s (SENT)
W20260709 12:22:20.753568 11102 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:22:20.753870 10244 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.757278  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:20.758865  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.759235 10835 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.764823 11088 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:20.765661 11088 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:20.767040 11088 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.768936  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:20.770386  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 147347us
I20260709 12:22:20.771718  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.771824 11079 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:20.772765 11079 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.774261  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.775086  8213 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:20.778743  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.779376  8756 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.779731  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:20.737643 10834 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.976s	user 0.012s	sys 0.002s
I20260709 12:22:20.780661  8761 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.783048  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:20.785467  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.780990  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1541) took 1665 ms. Trace:
I20260709 12:22:20.789227  8765 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:20.793206  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:20.794178  8219 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.794781  8757 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:20.796801  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.797873  8069 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:22:20.798583  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58873.4us
I20260709 12:22:20.799171  8763 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:20.791555 10244 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.800530 10890 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:20.800597 10244 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.802410  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.803253 10244 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.804710  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:20.806144  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69560.7us
I20260709 12:22:20.793390  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.751725 11056 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.809787 10995 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.785207  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:20.771734 10973 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:22:20.808936  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:20.814857  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58317.8us
I20260709 12:22:20.789156  8061 rpcz_store.cc:276] 0709 12:22:19.115942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.297319 (+1181377us) service_pool.cc:224] Handling call
0709 12:22:20.379592 (+ 82273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:20.466088 (+ 86496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.466122 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:20.466772 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 12:22:20.515575 (+ 48803us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:20.599050 (+ 83475us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.599623 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.599802 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.780741 (+180939us) raft_consensus.cc:1685] finished
0709 12:22:20.780762 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.780931 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6124,"prepare.queue_time_us":81625,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":2034,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":16669,"thread_start_us":40557,"threads_started":1,"wal-append.queue_time_us":182247}
I20260709 12:22:20.817740  8762 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.816833  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:20.821671  8761 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:20.818634  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.821779  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.819954  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:20.812765 10995 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.827808  8763 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.824645 11101 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.830174  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.810228 11033 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:20.819195 11097 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.832516 11119 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.834141 10973 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:20.834617 11081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.008s
I20260709 12:22:20.834739  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.837077 11109 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:20.864984 11109 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.866595 11047 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:20.867522 11109 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.838188 11079 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.838773 10850 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:20.869470 10850 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:20.869922 10850 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:20.870864  8069 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:20.871166 10850 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.871943  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.839800 11029 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:20.873440  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.874063  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:20.830821  8758 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.874766  8140 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:20.831682  8070 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:20.876242  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.877074  8070 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:20.877893  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.881341  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.846782  8186 leader_election.cc:400] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:20.882296  8186 leader_election.cc:403] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:22:20.883136  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.883730 11079 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:20.883935  8220 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:20.885020  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.885589  8217 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:22:20.840998  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 111370us
W20260709 12:22:20.887378 11117 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:20.887579 10850 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.889029  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.889753  8213 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:20.868345 11109 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:22:20.891412  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:20.892275  8217 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:20.846872  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.893486  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 426) took 2322 ms. Trace:
I20260709 12:22:20.893929  8764 rpcz_store.cc:276] 0709 12:22:18.570605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.570734 (+   129us) service_pool.cc:224] Handling call
0709 12:22:18.572567 (+  1833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.189178 (+1616611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.189246 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.189325 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:20.189357 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.893027 (+703670us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002143d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:20.893076 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.893273 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3716652928}
I20260709 12:22:20.896724 10835 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.897655 11084 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:20.897359 10835 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:20.898090 11084 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.846784  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.898489 11084 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:20.898989  8061 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:20.900018  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:20.893505  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62707.7us
I20260709 12:22:20.901543  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.901949  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:20.902704  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.903591 11087 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:20.904011 11087 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.904326 11087 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.907169  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1539) took 1804 ms. Trace:
I20260709 12:22:20.907614  8067 rpcz_store.cc:276] 0709 12:22:19.103238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.237978 (+134740us) service_pool.cc:224] Handling call
0709 12:22:20.906853 (+1668875us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400396cd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:20.907069 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946125568}
I20260709 12:22:20.828420 11089 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:20.908866 11097 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:20.909044 11089 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:20.909327 11097 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:20.909781 11097 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.910842  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.829033 10769 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:20.857813  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52243.2us
I20260709 12:22:20.840602  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.913316  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:20.863508  8759 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:20.863709  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:20.915035  8065 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:20.830574 10995 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.812942 10834 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:20.861429 11081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.012s	sys 0.008s
I20260709 12:22:20.874379  8069 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:20.891561  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.910406 11089 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.902694  8064 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:20.854027  8219 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:20.851701  8756 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:20.843029 11101 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.841463 11111 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.859683 10973 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:20.929929  8064 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:20.941012  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:20.941159 11101 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.934706 10544 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.932150 10913 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.943648 10544 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.944191 11101 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.944381 10913 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.931912 10999 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:20.930143 11002 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.945873 10544 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.937080  8762 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:20.929822  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:20.926518  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.941772  8764 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:20.925745  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 85232.5us
W20260709 12:22:20.939918  8110 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.087s (SENT)
I20260709 12:22:20.925503  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.926699  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.949330  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:20.954507  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:20.956902  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.953797  8765 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:20.936865  8070 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:20.928495 10805 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:20.960579 10769 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:20.926106 11029 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:22:20.961453 11029 consensus_queue.cc:1243] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:20.962075 11029 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:20.962491  8140 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:20.962462 11029 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:20.963538  8064 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:20.928933 10599 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:20.846700 10694 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:22:20.946019 10973 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.944752 11083 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
W20260709 12:22:20.971050  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44618.8us
I20260709 12:22:20.973104  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.975822  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:20.980584  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53979.1us
I20260709 12:22:20.970012 10599 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.983146 10599 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:20.990029 10973 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.990944  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1424) took 1708 ms. Trace:
I20260709 12:22:20.991343  8218 rpcz_store.cc:276] 0709 12:22:19.282834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.515262 (+232428us) service_pool.cc:224] Handling call
0709 12:22:19.515642 (+   380us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:20.487386 (+971744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.490948 (+  3562us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:20.606573 (+115625us) log.cc:844] Serialized 78 byte log entry
0709 12:22:20.805962 (+199389us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.806016 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.829140 (+ 23124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.990715 (+161575us) raft_consensus.cc:1685] finished
0709 12:22:20.990734 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.990888 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":611159,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":226,"spinlock_wait_cycles":45440,"thread_start_us":895467,"threads_started":2,"wal-append.queue_time_us":350560}
W20260709 12:22:20.992977 10893 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.383s	user 0.003s	sys 0.017s
I20260709 12:22:20.993487 10893 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.994282  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:20.995688 10794 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:20.995922  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:20.996812 11109 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:20.998373  8035 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.799s (SENT)
I20260709 12:22:21.012141  8061 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:21.012588  8035 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.952s (SENT)
I20260709 12:22:21.013182  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:20.998873 11076 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:20.999437 11074 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.000056 10910 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:21.014781 11097 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.015739 10910 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:21.016182 10850 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.016793 10910 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.014786 11076 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.021287 11076 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:21.001327 11116 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:22:21.001828  8036 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.002413 10999 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:20.997881  8137 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:21.005056 11079 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:21.005851 10834 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:20.931690 11005 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:22:21.006001 10817 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:21.008391  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:20.960255 11111 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:21.032618  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92739us
I20260709 12:22:20.993029  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1432) took 1708 ms. Trace:
I20260709 12:22:20.934525 11087 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:21.042538  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66828.7us
I20260709 12:22:20.996510 10794 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:21.010427 11084 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.045087  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:20.970481 10995 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.049203  8214 rpcz_store.cc:276] 0709 12:22:19.284987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.526759 (+241772us) service_pool.cc:224] Handling call
0709 12:22:19.527110 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.589095 (+1061985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.992677 (+403582us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54000e7254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:20.992971 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281686272}
I20260709 12:22:21.021819 11029 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.040855 11079 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.056916 11097 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.043326 11033 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.061964  8211 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:21.044523 11002 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:21.060118  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:21.061870  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:21.051136 10244 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.080868  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.063759 10694 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:21.086642  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 157514us
I20260709 12:22:21.077963 11079 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.092793  8219 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:21.082190 11075 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:21.076347 11088 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:21.103132  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 175343us
I20260709 12:22:21.092550 10893 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:21.099438  8035 leader_election.cc:336] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.007s (SENT)
I20260709 12:22:21.115073  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:21.092341 10891 raft_consensus.cc:2764] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:22:21.120970  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 195535us
I20260709 12:22:21.127804  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:21.129587  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46856.4us
I20260709 12:22:21.133744 10999 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.134476 10999 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:21.135260 11105 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.405s	user 0.000s	sys 0.003s
I20260709 12:22:21.138248 11087 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.139180 11087 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.140803 11056 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.147132 10913 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:21.148895  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91450.7us
I20260709 12:22:21.151973  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.155417 11130 raft_consensus.cc:993] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:21.155774 10544 raft_consensus.cc:993] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:21.155933 11130 raft_consensus.cc:1081] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:21.156363 10544 raft_consensus.cc:1081] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:21.106173 11088 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:21.157166 11088 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.120606 11029 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.163190 11084 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.122551 11075 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:21.169838 10995 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:21.173187  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45497.1us
I20260709 12:22:21.174733 10913 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:21.176489 11120 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.344s	user 0.002s	sys 0.000s
I20260709 12:22:21.177059 10544 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:21.178571 10999 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:21.178941 10999 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:21.179901 10999 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.083922 11033 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:21.132041  8035 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.037s (SENT)
I20260709 12:22:21.189025  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.193112 11111 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:21.189535  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64483.5us
I20260709 12:22:21.181078 10999 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:21.188504 11002 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.189822 10913 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.181072 11075 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.198417 10834 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.207525  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:21.207684  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55850.8us
I20260709 12:22:21.200901 10599 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:21.208397  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76400.7us
W20260709 12:22:21.221621  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.222117  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.208873 11130 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:21.209652  8140 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:21.209641 10913 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.227309 10599 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.227945  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.228777  8140 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.228924 10913 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.213073 11002 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.231649 11002 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.232963  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:21.233738  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.219662  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.234913  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.235627  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.216782  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.225013  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.228461  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.225167  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.201231 10850 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.233873  8145 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:21.241029  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.237072  8140 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:21.244158  8144 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:21.244933  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:21.252097  8139 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.253319  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.216109 10244 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.252190  8146 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:21.260418  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.236598 10835 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:21.263361  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.264767  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.266047  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.267305  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.268095  8141 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:21.268823 11125 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:21.269812  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.260124 11130 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:21.270618 11130 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:21.271587 11130 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.273175 11033 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.245428 11065 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:22:21.267102  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:21.281652  8142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:22:21.284947  8142 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.285319  8142 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:21.288928  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.291956  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1423) took 2009 ms. Trace:
I20260709 12:22:21.293242  8064 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:22:21.293654  8064 pending_rounds.cc:85] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 5
I20260709 12:22:21.292413  8215 rpcz_store.cc:276] 0709 12:22:19.282583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.513631 (+231048us) service_pool.cc:224] Handling call
0709 12:22:19.514014 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.295976 (+781962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.300928 (+  4952us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.325752 (+ 24824us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.447268 (+121516us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.447321 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.288369 (+841048us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54003a7354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:21.288414 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.288457 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:21.288471 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.291883 (+  3412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":605484,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"spinlock_wait_cycles":166648448,"thread_start_us":752876,"threads_started":2,"wal-append.queue_time_us":171674}
I20260709 12:22:21.293910  8064 pending_rounds.cc:107] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:22:21.294246  8064 raft_consensus.cc:2889] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:21.300071  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2579) took 4067 ms. Trace:
I20260709 12:22:21.300508  8068 rpcz_store.cc:276] 0709 12:22:17.232291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.902958 (+1670667us) service_pool.cc:224] Handling call
0709 12:22:20.196840 (+1293882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.197485 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:20.198129 (+   644us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.310305 (+112176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.310517 (+   212us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:20.310661 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.310874 (+   213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.291637 (+980763us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18002ef300. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4
0709 12:22:21.299735 (+  8098us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400346050. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:21.299857 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":910,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":57,"raft.queue_time_us":13229,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"spinlock_wait_cycles":2958304896,"thread_start_us":96198,"threads_started":1,"wal-append.queue_time_us":313771}
I20260709 12:22:21.304001 10891 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:21.306196 11056 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:21.306653 11056 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:21.307664 11056 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.308924 10817 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:21.310802 11056 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.311334  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:21.312043  8211 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:21.313239  8216 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:21.315490  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.283921 11111 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:21.316285  8141 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:21.316431 11111 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.318023  8141 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:21.255924 11047 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.318969 11111 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.320062  8140 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:21.315392  8137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
W20260709 12:22:21.336609  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 74185.3us
I20260709 12:22:21.334826  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:21.341341  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:21.348912  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.348872  8142 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.355401  8141 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:21.365758  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 318026us
I20260709 12:22:21.366704  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.365062  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:21.371536  8215 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:21.374163  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.375000  8141 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:21.375519 10850 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:21.376137 10850 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.378213  8140 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:21.378989  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 125368us
I20260709 12:22:21.376468  8141 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:21.381547  8145 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:21.352839 11059 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:21.362450 11128 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:21.389051  8142 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:21.383275 11029 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:21.398270  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.384475  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.367857 10694 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.376729 10850 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:21.354614 11033 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:22:21.379755 11134 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.386974 10698 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.390793 11059 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.411155  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:21.414065  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65239.9us
I20260709 12:22:21.355445 11079 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.420231  8139 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:21.405658 10544 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.424515  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:21.405413 10890 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.390785 10817 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:22:21.428930 10900 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:22:21.433539  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.434679  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:21.435299 10973 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.437920 11092 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.441908  8142 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:21.379581 11125 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:21.392802 11074 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:21.445222  8036 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.452134  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.452521  8141 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:21.454340  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:21.426091 11059 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.458389  8756 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:21.459177  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:21.462960  8140 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:21.443951 10835 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:21.473829 11133 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:22:21.441623 10698 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.478921 10698 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.480895 10599 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.481149  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.482535  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.483177  8141 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.485069 11127 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:21.485684 11127 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.486166 11127 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.486210  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:21.487962  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.471412  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:21.508737  8137 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.509352  8137 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.425807 11065 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:22:21.508749  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 74147.7us
I20260709 12:22:21.513846  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:21.516426  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:21.473816 10835 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.441288 10694 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.470319 11002 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.502391 10805 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:22:21.423331 11134 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.512142 10999 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:21.452437 11076 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.500988 10891 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:22:21.555855  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:21.501860 10913 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:22:21.536558 10835 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:21.562297  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 152361us
I20260709 12:22:21.559696  8146 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:21.513267 11088 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.541155 10999 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.566437 10913 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:21.558849 10891 consensus_queue.cc:1243] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:21.597004  8217 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:21.598927  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.600975  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.601210 11013 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:21.605309  8141 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:21.566949  8146 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:21.581321 10954 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:21.620741  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 108884us
W20260709 12:22:21.626798  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71017.3us
W20260709 12:22:21.683480  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62723.4us
I20260709 12:22:21.528159 10834 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 12:22:21.631723  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.499s (SENT) [suppressed 57 similar messages]
I20260709 12:22:21.699429  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:21.697865  8142 raft_consensus.cc:2955] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:21.625330 11005 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:21.706617  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74926.9us
W20260709 12:22:21.711148  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.635046 10999 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.634498 10913 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:21.708468 10698 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:21.737171  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 138385us
I20260709 12:22:21.741607  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.707975 11146 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:22:21.747236 11141 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:22:21.748893 11142 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:22:21.778750 10774 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:21.728545 11005 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:21.740008 11002 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:21.782243 10913 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:21.788182  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.796134  8137 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:21.803597 11029 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:21.842480  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54438.9us
I20260709 12:22:21.871135 11079 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.870548 10698 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:21.833899 11148 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:22:21.888324 11005 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:21.907280  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 223010us
I20260709 12:22:21.918772 11059 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:21.921927  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.933571 11059 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.919955 10698 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:21.937140 10698 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.937318  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.939985  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.941553 10891 raft_consensus.cc:2764] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:21.946691 10900 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:22:21.954643 10774 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:21.955224 10774 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:21.955675 10774 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:21.961045 11134 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:21.962710  8068 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:21.964088  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:21.964872 10891 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:21.941828 10834 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:21.942394 10913 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:21.944437 11076 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:21.969280  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64790.6us
W20260709 12:22:21.836675  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 235732us
I20260709 12:22:21.947760 10694 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:21.992777  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:21.978178 11152 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:21.982271 11088 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:21.949718 10999 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.011747  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.021983  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.023734  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:22.001302 11134 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:22.035593 11156 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:22.041951  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.036303  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.047606  8141 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:22.049319  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.050637  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.013710 11152 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:22.056815 11152 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:22.019711 11013 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.059932 11013 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:22.061625 11056 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 12:22:22.062322 11013 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:22.062392  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.063319  8220 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.064595  8762 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:22.063302  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.048349  8145 pending_rounds.cc:85] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
W20260709 12:22:22.067766  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.067907  8145 pending_rounds.cc:107] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:22:22.066864 11148 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:22.069883 11148 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.069994  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.070333 11148 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:22.070945  8220 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.068324  8145 raft_consensus.cc:2889] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:22.074262  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.074914  8141 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:22.087471  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:22.038722 11134 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:22.092170  8142 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:22.083681  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:22.087073  8035 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.513s (SENT)
I20260709 12:22:22.100239  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:22.104200  8220 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.105782  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.083720  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.104359  8068 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:22.128474  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:22.133589  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:22.035444 10774 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.143082  8217 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.146086  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.146930  8220 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 5: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.148025  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:22.106182 11127 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.002s
I20260709 12:22:22.110159 11134 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:22.156842  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.159475  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.088939 11065 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:22:22.164287  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:22.164971  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 77933.3us
I20260709 12:22:22.165019  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:22.166420 11137 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.735s	user 0.006s	sys 0.005s
W20260709 12:22:22.167155 11149 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 12:22:22.207141  8035 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.540s (SENT)
I20260709 12:22:22.209664  8211 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.171165  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:22.155176 11150 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:22:22.262902  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:22.269022  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 172350us
I20260709 12:22:22.276890  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:22.095849 11033 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:22:22.154510 10834 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:22.292994  8063 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:22.298311  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.299433  8220 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:22.301914  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:22.294189  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:22.305048  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.303782  8213 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:22.216234 11088 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:22.307966  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.313535  8218 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:22.309633  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.315302  8217 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:22.320475  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 113356us
W20260709 12:22:22.322870 11157 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:22:22.324520 10835 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.004s
I20260709 12:22:22.324975 10835 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.309785 11162 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:22:22.326370 11148 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.327282 10835 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:22.330053 10774 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:22.330979 10774 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:22.331390 10774 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:22.331796 10774 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:22.329978  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:22.333099  8061 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:22.333441  8061 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:22.334230  8061 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:22.335706  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.325183  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:22.336724  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.337498  8212 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.336491  8220 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:22.338578  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.170617 11127 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.339655  8140 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:22.337749  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.337771  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:22.342084  8069 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:22.342795  8035 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.574s (SENT)
I20260709 12:22:22.344216  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.344357  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.344833  8213 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.356077  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:22.357477  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.357497  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:22.369462  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.370860  8141 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:22.374867  8140 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:22.377918  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.370705  8220 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:22.320850 11029 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:22.383062  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:22.390133  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:22.346467 11148 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:22.400041  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.400302  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:22.400041  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:22.404973  8760 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:22.394605  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:22.401929  8756 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:22.402685  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81455.2us
W20260709 12:22:22.408006  8110 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.037s (SENT)
W20260709 12:22:22.408371  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 128994us
I20260709 12:22:22.436322  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1448) took 1212 ms. Trace:
I20260709 12:22:22.443512  8138 rpcz_store.cc:276] 0709 12:22:21.223723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.270439 (+ 46716us) service_pool.cc:224] Handling call
0709 12:22:21.270825 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:21.271297 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.271336 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:21.272009 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 12:22:21.386118 (+114109us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:21.386164 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.386241 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.166103 (+779862us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b24000fb3a8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899de09d 00007f498c61010e 00007f498c62788c 00007f498c626bb6 00007f498c6267d8 00007f498c630221
0709 12:22:22.411698 (+245595us) raft_consensus.cc:1685] finished
0709 12:22:22.411733 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.436245 (+ 24512us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":26635648,"thread_start_us":113684,"threads_started":1,"wal-append.queue_time_us":158652}
W20260709 12:22:22.446393  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58492.7us
I20260709 12:22:22.448963  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:22.449198  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:22.449945  8035 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.702s (SENT)
I20260709 12:22:22.450462  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:22.457880 11127 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:22.432816 11169 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:22.460173 11169 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.462608 11169 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:22.465016 11159 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:22:22.465086 10891 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:22.466353 10973 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:22:22.467207 10973 consensus_queue.cc:1243] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:22.467692 10973 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:22.468039 10973 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:22.462428  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.477216  8765 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:22:22.477726  8110 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.570s (SENT)
I20260709 12:22:22.479620  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:22.483901  8213 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:22.444280 11167 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:22.492771  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:22.491515  8063 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:22.492733  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46443.6us
I20260709 12:22:22.494521  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:22.495749  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:22.494683  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.496835  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.471266  8758 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:22.502372  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
W20260709 12:22:22.493407 10850 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.022s	user 0.013s	sys 0.000s
I20260709 12:22:22.515286  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:22.517822  8110 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.593s (SENT)
I20260709 12:22:22.518577  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:22.533149  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.396973 10834 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.538419  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:22.539249  8215 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:22.501760 10954 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:22.543439  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 135916us
I20260709 12:22:22.504165 11088 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:22.509379 11148 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:22.566092  8213 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:22:22.547978 10913 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
W20260709 12:22:22.567576  8035 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.238s (SENT)
I20260709 12:22:22.533581 11167 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:22.571990  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 54216.6us
W20260709 12:22:22.572482  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71099us
W20260709 12:22:22.570394  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 121557us
I20260709 12:22:22.556002 10769 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:22.615613  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45432.5us
I20260709 12:22:22.618708  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.532583 10850 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.570991 10893 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:22.633029  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 110984us
I20260709 12:22:22.634436  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:22.566833 11176 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:22.634797 11187 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:22.635227 10893 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:22.637605 11174 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:22.574440 10954 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.650223  8065 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:22.651244  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.565672 11088 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:22.634069 11013 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:22.651821 11002 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.007s
W20260709 12:22:22.695502  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44355.8us
I20260709 12:22:22.651875 10893 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.696205  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:22.697386 11005 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:22.697050 11167 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:22.697839 11005 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:22.698289 11005 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:22.698578 11179 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.699093 11179 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:22.703143  7964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 173) took 17414 ms (client timeout 15000 ms). Trace:
I20260709 12:22:22.704155 11188 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:22.704365 11173 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:22:22.704947 11188 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:22.705349 11181 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:22.706065 11188 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:22.707420 11182 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:22:22.691965 10954 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:22.690267 10769 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:22.714028 10850 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:22.652050 10698 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.709s	user 0.014s	sys 0.000s
I20260709 12:22:22.631677 11168 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 12:22:22.704998 11170 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:22:22.760676  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 126077us
W20260709 12:22:22.786298 10890 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.341s	user 0.012s	sys 0.002s
I20260709 12:22:22.808671  8217 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:22.704512 11088 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:22.752935 11002 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:22.866377  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52482.7us
W20260709 12:22:22.874971  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.880897  8212 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 12:22:22.864847 11185 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:22.882395  8212 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:22.931594  8217 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:22.786077 10698 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:22.934990  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51507.1us
I20260709 12:22:22.882496  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:22.982527  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 100121us
W20260709 12:22:22.981676  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 417526us
I20260709 12:22:22.844615 10890 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:22.996749  8218 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.005s
I20260709 12:22:22.998868  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:23.001407  8069 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:23.000458  8218 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
W20260709 12:22:23.003589  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 386233us
I20260709 12:22:22.886499 11185 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:23.006512  8110 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.550s (SENT)
I20260709 12:22:23.008463  8214 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:23.017688  8757 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:23.017112  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:22.993850 11002 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:23.027885  8217 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:23.032186  8217 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:22.997071 11167 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:22.999064 11187 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.039494 11192 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:23.015460 10954 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:22.703599  7964 rpcz_store.cc:269] 0709 12:22:05.131814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.329965 (+198151us) service_pool.cc:224] Handling call
0709 12:22:22.532060 (+17202095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:14.481112 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:14.481694 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:14.481738 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:22:14.481756 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:14.482703 (+   947us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:14.482758 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:14.482784 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:22:14.483699 (+   915us) tablet.cc:701] Row locks acquired
0709 12:22:14.483720 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:22:14.483870 (+   150us) write_op.cc:270] Start()
0709 12:22:14.483988 (+   118us) write_op.cc:276] Timestamp: P: 1783599734483821 usec, L: 0
0709 12:22:14.484008 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:14.514786 (+ 30778us) log.cc:844] Serialized 4367 byte log entry
0709 12:22:16.757768 (+2242982us) op_driver.cc:464] REPLICATION: finished
0709 12:22:19.092762 (+2334994us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f49899820ac 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f49904c2ef0
0709 12:22:20.203551 (+1110789us) write_op.cc:301] APPLY: starting
0709 12:22:20.203805 (+   254us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:20.204289 (+   484us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:20.204344 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:20.206286 (+  1942us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:20.206800 (+   514us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:22:20.206884 (+    84us) write_op.cc:312] APPLY: finished
0709 12:22:20.207484 (+   600us) log.cc:844] Serialized 83 byte log entry
0709 12:22:20.649004 (+441520us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f49899820ac 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b
0709 12:22:20.945151 (+296147us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:20.958777 (+ 13626us) write_op.cc:454] Released schema lock
0709 12:22:20.958860 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:20.959504 (+   644us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:20.959542 (+    38us) write_op.cc:454] Released schema lock
0709 12:22:21.175609 (+216067us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
Metrics: {"mutex_wait_us":1291668,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":3436466,"apply.run_cpu_time_us":22508,"apply.run_wall_time_us":755992,"num_ops":11,"prepare.queue_time_us":272503,"prepare.run_cpu_time_us":48101,"prepare.run_wall_time_us":1369868,"raft.queue_time_us":547887,"raft.run_cpu_time_us":69248,"raft.run_wall_time_us":3161358,"replication_time_us":2239595,"spinlock_wait_cycles":720365568,"thread_start_us":5378835,"threads_started":5,"wal-append.queue_time_us":2102630,"wal-append.run_cpu_time_us":84857,"wal-append.run_wall_time_us":2886857}]]}
I20260709 12:22:22.988974 11013 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:22:23.052399  8217 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.051295  8760 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.002s
I20260709 12:22:23.076977  8760 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:23.077775  8062 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:22.996277 11190 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:22:23.087705  8217 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:23.097154  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 211776us
I20260709 12:22:23.101347 11180 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.101984 11180 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.095928 11195 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:23.105527 11164 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:23.106113 11164 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.109941 11208 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:23.110453 11208 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:23.111526 11208 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.117062 11208 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.119434  8137 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.120059  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51464 (request call id 1457) took 1893 ms. Trace:
W20260709 12:22:23.121058  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114595us
I20260709 12:22:23.047262 11002 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.080689 11167 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:23.120373  8137 rpcz_store.cc:276] 0709 12:22:21.226419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.315262 (+ 88843us) service_pool.cc:224] Handling call
0709 12:22:23.114488 (+1799226us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000523d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca83a3d 00007f4991a53cd0 00007f498afd8254 00007f498afd81e2 00007f498afd8111 00007f498afd808c 00007f498afd7342 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:23.119958 (+  5470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423828736}
W20260709 12:22:23.144205  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44548us
I20260709 12:22:23.108367 11164 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.104344 11180 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.174230  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:23.181233  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.161159  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.207170  8110 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.845s (SENT)
I20260709 12:22:23.207683  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:23.162823 11194 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:23.091634 11179 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:23.145161 11013 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:23.144296 10913 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.220533  8146 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:23.220431  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 147437us
I20260709 12:22:23.158999 10973 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.073941 11187 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.250037  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:23.401880  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 240783us
I20260709 12:22:23.402796 11211 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.403077  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.345369 11005 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.003s
I20260709 12:22:23.404002 11180 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.403965 11207 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:23.233284  8138 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:23.406265 11168 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.404969 10694 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.411883 11207 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.412220 11168 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.412395 10694 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.249481  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 249227us
I20260709 12:22:23.404135 11005 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.219022 11185 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.414945 10694 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.415452 11168 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.283855 11002 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:23.274967  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 278758us
I20260709 12:22:23.361630 10698 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:23.160666 11195 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.259s
I20260709 12:22:23.267064 10798 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.415493 11005 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.419983 10798 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.422969  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:23.345695 10774 consensus_meta.cc:287] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.984s	user 0.008s	sys 0.005s
I20260709 12:22:23.423856 10774 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.411595 10913 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.345043 11198 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:22:23.427961  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2616) took 1104 ms. Trace:
I20260709 12:22:23.428879  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:23.428366  8063 rpcz_store.cc:276] 0709 12:22:22.323675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.502854 (+179179us) service_pool.cc:224] Handling call
0709 12:22:22.534986 (+ 32132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.539107 (+  4121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.539137 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.566249 (+ 27112us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.988459 (+422210us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.988502 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.988575 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.427719 (+439144us) raft_consensus.cc:1685] finished
0709 12:22:23.427745 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.427890 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":358,"raft.queue_time_us":13005,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15662,"thread_start_us":342742,"threads_started":1,"wal-append.queue_time_us":455527}
I20260709 12:22:23.429824 11002 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.430179  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.259195 11184 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.196s	user 0.000s	sys 0.005s
I20260709 12:22:23.431126 11002 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:23.275897  8761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.007s
I20260709 12:22:23.421536  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.433171  8761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.008s
I20260709 12:22:23.433729 11217 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:23.434544  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 771) took 1048 ms. Trace:
I20260709 12:22:23.418699  8217 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:23.437544  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.156616 10999 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.380448 10244 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.405264  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 198125us
I20260709 12:22:23.431427  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.258891 11205 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:23.212862 11164 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.398440 11075 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.452086  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:23.452864  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:23.455893  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:23.445175 11088 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:22:23.460201  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.456243  8067 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:23.460819  8067 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:23.456676  8218 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:23.456318  8069 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.431980 11013 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:23.434919  8761 rpcz_store.cc:276] 0709 12:22:22.385937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.386064 (+   127us) service_pool.cc:224] Handling call
0709 12:22:22.409729 (+ 23665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.442322 (+ 32593us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:22.494340 (+ 52018us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.433981 (+939641us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.434177 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:23.434229 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:23.434274 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.434337 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.434464 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21701,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":23165,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":869907,"threads_started":2,"wal-append.queue_time_us":517989}
I20260709 12:22:23.463585 10798 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:23.448320 10694 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:23.463465  8067 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.464257 10694 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.466747 10694 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.469008  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 772) took 1082 ms. Trace:
I20260709 12:22:23.469182  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.469411  8757 rpcz_store.cc:276] 0709 12:22:22.386289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.386427 (+   138us) service_pool.cc:224] Handling call
0709 12:22:22.401094 (+ 14667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.023052 (+621958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.468735 (+445683us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:23.468920 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414272256}
I20260709 12:22:23.469820  8212 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:23.448654 11168 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.455646 10973 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:23.478478  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.483368  8218 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:23.480594  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:23.491725 11134 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.201s	user 0.012s	sys 0.000s
I20260709 12:22:23.492189 11134 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.494333 11134 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:23.260080 11167 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.499199 10893 consensus_meta.cc:287] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.003s
I20260709 12:22:23.499703 10893 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:23.503170 11144 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.950s	user 0.010s	sys 0.014s
I20260709 12:22:23.503425 11187 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.504756  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 458) took 2170 ms. Trace:
I20260709 12:22:23.478081 11168 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.505147  8216 rpcz_store.cc:276] 0709 12:22:21.334242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.334804 (+   562us) service_pool.cc:224] Handling call
0709 12:22:21.354365 (+ 19561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.405084 (+ 50719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.405117 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.416907 (+ 11790us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.547487 (+130580us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:21.547534 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.547603 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.502617 (+1955014us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:23.504397 (+  1780us) raft_consensus.cc:1685] finished
0709 12:22:23.504416 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.504670 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33486,"raft.queue_time_us":40183,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5602,"spinlock_wait_cycles":9186688,"thread_start_us":89892,"threads_started":1,"wal-append.queue_time_us":110766}
W20260709 12:22:23.506690  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 438) took 2184 ms (client timeout 1864 ms). Trace:
W20260709 12:22:23.507090  8762 rpcz_store.cc:269] 0709 12:22:21.322345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.341013 (+ 18668us) service_pool.cc:224] Handling call
0709 12:22:23.506447 (+2165434us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400447354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:23.506597 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600243456}
I20260709 12:22:23.507442  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.509042 10954 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:23.509477 10954 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:23.509831  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1448) took 1466 ms (client timeout 1540 ms). Trace:
I20260709 12:22:23.510377 10954 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.511670 10954 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:23.509061 11151 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.572s	user 0.000s	sys 0.025s
I20260709 12:22:23.515158  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 462) took 1957 ms. Trace:
I20260709 12:22:23.461764 11075 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.515571  8219 rpcz_store.cc:276] 0709 12:22:21.557693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.557900 (+   207us) service_pool.cc:224] Handling call
0709 12:22:21.601973 (+ 44073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.602402 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.602435 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.602981 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.858607 (+255626us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:21.858662 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.858738 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.508457 (+1649719us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:23.514833 (+  6376us) raft_consensus.cc:1685] finished
0709 12:22:23.514854 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.515087 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":9549056,"thread_start_us":255155,"threads_started":1,"wal-append.queue_time_us":333626}
I20260709 12:22:23.517498  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.517791 11075 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.518132  8219 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:23.487552 11207 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:23.520119  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.510241  8214 rpcz_store.cc:269] 0709 12:22:22.043059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.047372 (+  4313us) service_pool.cc:224] Handling call
0709 12:22:23.509611 (+1462239us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54002251d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:23.509744 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200504192}
I20260709 12:22:23.522092  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:23.522619  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.522962 11005 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:23.523283  8214 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:23.523581 11005 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:23.525046 10835 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:23.525460 10835 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:23.527431  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.528137  8214 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:23.529608  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.532068  8212 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:23.449128 10244 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.535158  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.526266 10835 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.485842  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.541669  8218 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:23.524868 11005 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.546386 10835 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.548177 10244 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.539680 11169 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:23.551508 11176 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.000s
I20260709 12:22:23.552012 11176 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.552795  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:23.554524 11215 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:23.556862 11056 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:23.508469 11168 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.559918  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.562672  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.564709  8218 raft_consensus.cc:2368] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:23.565909  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.566780  8218 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:23.567986  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.569011  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.569968  8216 raft_consensus.cc:2368] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8.
W20260709 12:22:23.572759  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99581.9us
I20260709 12:22:23.572945  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.573843  8212 raft_consensus.cc:2368] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9.
I20260709 12:22:23.574883  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:23.537803 11192 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:23.553887 10910 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:23.557349 11056 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.576602  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:23.598239  8219 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:23.617547  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.618494  8218 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:23.619403  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.620083  8218 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:23.613623 11207 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:23.621933 11207 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:23.622310 11207 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.593045 11013 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.625882 11013 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.627234  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 466) took 1483 ms. Trace:
I20260709 12:22:23.597265 11056 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.628818  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.630065  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.631067  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.631707  8218 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:23.633028  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 510) took 1624 ms. Trace:
I20260709 12:22:23.633423  8139 rpcz_store.cc:276] 0709 12:22:22.008914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.009076 (+   162us) service_pool.cc:224] Handling call
0709 12:22:22.029399 (+ 20323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.084006 (+ 54607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.084059 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.149972 (+ 65913us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.360190 (+210218us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:22.360235 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.632647 (+1272412us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54000438d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:23.632696 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.632744 (+    48us) raft_consensus.cc:1685] finished
0709 12:22:23.632755 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.632972 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13247,"raft.queue_time_us":31584,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":22080,"spinlock_wait_cycles":80196352,"thread_start_us":196234,"threads_started":1,"wal-append.queue_time_us":277776}
I20260709 12:22:23.634855 11210 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:23.635468 11210 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.636364  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.644104  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.644801 11153 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:23.645433 11153 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.645979  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 417) took 1702 ms. Trace:
I20260709 12:22:23.646385  8062 rpcz_store.cc:276] 0709 12:22:21.943801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.946829 (+  3028us) service_pool.cc:224] Handling call
0709 12:22:23.645794 (+1698965us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:23.645915 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252511104}
I20260709 12:22:23.624917 11164 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:23.648058  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1465) took 2214 ms. Trace:
I20260709 12:22:23.647563  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:23.620322  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:23.638111 11210 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:23.673377  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53121us
I20260709 12:22:23.674479  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:23.643158  8069 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:23.649782  8062 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:23.627717  8215 rpcz_store.cc:276] 0709 12:22:22.144263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.540196 (+395933us) service_pool.cc:224] Handling call
0709 12:22:22.568535 (+ 28339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.715861 (+147326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.715920 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.715973 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:22.716020 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.626946 (+910926us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:23.627005 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.627164 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338247040}
I20260709 12:22:23.658711  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.578831 11002 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.580875 11169 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:23.577329 11192 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:23.681459  8061 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:23.648439  8143 rpcz_store.cc:276] 0709 12:22:21.433450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.521093 (+ 87643us) service_pool.cc:224] Handling call
0709 12:22:21.537475 (+ 16382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.581098 (+ 43623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.584733 (+  3635us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.585584 (+   851us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.733438 (+147854us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:21.733490 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.733574 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.647239 (+1913665us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b24000fb3a8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:22:23.647743 (+   504us) raft_consensus.cc:1685] finished
0709 12:22:23.647763 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.647975 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47694,"raft.queue_time_us":8546,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5386,"spinlock_wait_cycles":7899008,"thread_start_us":147248,"threads_started":1,"wal-append.queue_time_us":356478}
I20260709 12:22:23.685400  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:23.686069 11130 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:23.686830 11139 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 2.204s	user 0.013s	sys 0.021s
I20260709 12:22:23.676213 10999 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:23.690806  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.692858 11175 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.998s	user 0.000s	sys 0.003s
I20260709 12:22:23.693198 11180 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:23.694633 11166 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.261s	user 0.001s	sys 0.001s
I20260709 12:22:23.700832 11155 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.701489  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.701869  8063 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:23.742563  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.749306  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63994.8us
I20260709 12:22:23.581272 10910 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.772536  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.766535  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:23.775723  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.776795  8217 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:23.770979  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:23.777820  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.778798  8217 raft_consensus.cc:2368] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:23.780139  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:23.783327  8218 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:23.782612  8146 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:23.785416  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.709053 11210 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.789639  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.791954  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.792586  8143 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.792831  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.793694  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.794435  8141 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.795356  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.795285  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.795913  8137 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.796027  8138 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:23.757658 11162 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:23.744047 11192 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:23.797871  8146 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:23.798328  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:23.804297  8217 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:23.831715  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.833365  8139 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:23.807511  8035 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.308s (SENT)
I20260709 12:22:23.838061  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:23.839085 11130 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:23.801779 11155 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:23.840870 11155 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:23.841354 11155 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:23.847708 11222 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
W20260709 12:22:23.849866 11220 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 12:22:23.852461 10913 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.856994  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:23.858431  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:23.859122  8069 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:23.859993  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:23.861312 11153 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.862468  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:23.863511 10805 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:23.863994 10805 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:23.865170 10805 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.865816 11155 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.866236 10999 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:23.866865 10999 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.869517 11088 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:23.870512  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.870227 11088 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:23.873615  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1455) took 1810 ms (client timeout 2308 ms). Trace:
I20260709 12:22:23.874589  8215 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:23.875765  8069 raft_consensus.cc:2368] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
W20260709 12:22:23.874033  8211 rpcz_store.cc:269] 0709 12:22:22.062971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.072608 (+  9637us) service_pool.cc:224] Handling call
0709 12:22:23.873428 (+1800820us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b540017ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:23.873551 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139509504}
I20260709 12:22:23.884508  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:23.886552  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.799188 11162 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:23.894165  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:23.890815  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.210s (SENT)
W20260709 12:22:23.897646  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 344942us
W20260709 12:22:23.899151  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.894884  8215 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:23.916313  8137 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:23.900489  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.917678  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:23.921355  8141 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:23.797394 11210 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.816892 11169 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:22:23.936414  8141 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.817132 11056 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:23.931622  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.945973  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.933300  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 421) took 1961 ms. Trace:
I20260709 12:22:23.897284 11162 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:23.935809  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:23.944267  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 513) took 1934 ms. Trace:
I20260709 12:22:23.950101  8758 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:22:23.951002  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50444.5us
W20260709 12:22:23.933126  8110 leader_election.cc:336] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.026s (SENT)
I20260709 12:22:23.952026  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:23.950249  8145 rpcz_store.cc:276] 0709 12:22:22.010199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.020093 (+  9894us) service_pool.cc:224] Handling call
0709 12:22:22.043306 (+ 23213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:22.151250 (+107944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.151282 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:22.158208 (+  6926us) log.cc:844] Serialized 52 byte log entry
0709 12:22:22.434892 (+276684us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:22.434923 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.434973 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.692222 (+1257249us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:23.926929 (+234707us) raft_consensus.cc:1685] finished
0709 12:22:23.926965 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.944190 (+ 17225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4584,"raft.queue_time_us":4928,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":12189,"spinlock_wait_cycles":194520448,"thread_start_us":114230,"threads_started":1,"wal-append.queue_time_us":275527}
I20260709 12:22:23.947062  8064 rpcz_store.cc:276] 0709 12:22:21.971739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.971904 (+   165us) service_pool.cc:224] Handling call
0709 12:22:21.979537 (+  7633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.996796 (+ 17259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.996847 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.999789 (+  2942us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.213760 (+213971us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:22.213827 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.213941 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.694034 (+1480093us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:23.932883 (+238849us) raft_consensus.cc:1685] finished
0709 12:22:23.932918 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.933215 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16771,"raft.queue_time_us":23438,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":22769,"spinlock_wait_cycles":15604480,"thread_start_us":167658,"threads_started":1,"wal-append.queue_time_us":312435}
I20260709 12:22:23.951857  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:23.927122 11155 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.981222  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:23.959328  8140 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:23.960181 11065 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:23.950524 11187 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.960565  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:23.961393  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:23.962153 11210 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:23.944751 11125 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.963388  8762 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:22:23.964020 11056 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:23.960582 11167 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:23.966939  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:23.967597  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.969053 11190 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.970409  8756 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:23.971043  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 420) took 2013 ms. Trace:
W20260709 12:22:23.971654  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.972551  8760 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:22:24.036818  8760 pending_rounds.cc:85] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 7
I20260709 12:22:24.037107  8760 pending_rounds.cc:107] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:22:24.037384  8760 raft_consensus.cc:2889] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:23.973075  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1470) took 1645 ms. Trace:
I20260709 12:22:23.973625  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:23.977000  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:23.988727  8138 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:24.041596 10999 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:24.042259  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:24.042941  8211 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:24.048642 11183 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.345s	user 0.004s	sys 0.000s
I20260709 12:22:24.049047  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.049938  8138 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:24.031471 10973 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:24.050962  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.000443  8765 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.962416  8764 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:24.004289  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.004375  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.053100  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:24.004967 11187 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:23.998569 11065 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.010598  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:24.055351  8759 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:24.050756 10973 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.053478  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:23.997581  8218 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:23.999679 11033 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:24.049047  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:24.089202  8061 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:24.089893  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2618) took 1765 ms (client timeout 2188 ms). Trace:
W20260709 12:22:24.090495  8061 rpcz_store.cc:269] 0709 12:22:22.324250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.329711 (+  5461us) service_pool.cc:224] Handling call
0709 12:22:23.680873 (+1351162us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5800783bd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498c9e80aa 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca9027c 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c
0709 12:22:24.089826 (+408953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708619008}
I20260709 12:22:24.092900  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2608) took 1946 ms. Trace:
I20260709 12:22:24.093041  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.057214  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:24.095151  8757 raft_consensus.cc:2368] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:24.031952 11167 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.053100  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:24.096042  8213 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:24.038584  8220 rpcz_store.cc:276] 0709 12:22:22.327795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.635126 (+307331us) service_pool.cc:224] Handling call
0709 12:22:22.653137 (+ 18011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.275372 (+622235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.275419 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:23.303847 (+ 28428us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.533154 (+229307us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:23.533206 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.533380 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.972855 (+439475us) raft_consensus.cc:1685] finished
0709 12:22:23.972881 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.973019 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19824,"raft.queue_time_us":319814,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6830,"thread_start_us":601134,"threads_started":2,"wal-append.queue_time_us":375918}
I20260709 12:22:24.058954  8211 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.097178  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.097259  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:24.065387  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.068548  8143 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.012964  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:24.099529  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 86709.8us
I20260709 12:22:24.099736  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:24.032965  8066 rpcz_store.cc:276] 0709 12:22:21.958122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.966018 (+  7896us) service_pool.cc:224] Handling call
0709 12:22:21.966356 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.998022 (+ 31666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.998057 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.999432 (+  1375us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.161122 (+1161690us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4800080058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:23.505408 (+344286us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800386e00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:23.885986 (+380578us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:23.886044 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.886119 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.970742 (+ 84623us) raft_consensus.cc:1685] finished
0709 12:22:23.970765 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.970965 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8719,"raft.queue_time_us":29842,"raft.run_cpu_time_us":6407,"raft.run_wall_time_us":1163410,"spinlock_wait_cycles":8665216,"thread_start_us":399929,"threads_started":2,"wal-append.queue_time_us":1967839}
W20260709 12:22:24.035234 11074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.829s	user 0.016s	sys 0.035s
I20260709 12:22:24.056499  8145 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:24.095188  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.098807  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.092060  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:24.093616  8068 rpcz_store.cc:276] 0709 12:22:22.146163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.146344 (+   181us) service_pool.cc:224] Handling call
0709 12:22:22.165105 (+ 18761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.360923 (+195818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.360975 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.382451 (+ 21476us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.511955 (+129504us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:22.512016 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.512118 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.047948 (+1535830us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:24.063541 (+ 15593us) raft_consensus.cc:1685] finished
0709 12:22:24.063574 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.092804 (+ 29230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67995,"raft.queue_time_us":145667,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":16552,"spinlock_wait_cycles":190954368,"thread_start_us":261931,"threads_started":2,"wal-append.queue_time_us":231685}
W20260709 12:22:24.080926 10835 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.004s
I20260709 12:22:24.109436  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:24.105041  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:24.081367 11088 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:24.033321 11152 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:22:24.122829  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.125414  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.123059  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:24.131529  8211 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.131780  8064 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:24.124605  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.080456 11065 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:24.129204  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72073.9us
I20260709 12:22:24.128965  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.137630  8215 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.138149  8213 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
W20260709 12:22:24.110765  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 318814us
I20260709 12:22:24.140817  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.141021  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:24.101418 11146 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:22:24.110256  8066 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
W20260709 12:22:24.143065  8110 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.223s (SENT)
I20260709 12:22:24.148051  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:24.123286  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.148422  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:23.928656 11192 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.080710 10698 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:22:24.107332  8214 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:24.146118  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:24.105960 11074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.936s	user 0.016s	sys 0.036s
I20260709 12:22:24.128978  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:24.153771  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:24.169725  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.231555  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.080888 11195 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:22:24.233126  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 128197us
W20260709 12:22:24.274377  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.234308  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.275936  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.276692  8143 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.276976  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:24.235294  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83937.5us
W20260709 12:22:24.277725  8184 connection.cc:256] RPC call timeout handler was delayed by -3.493762261000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3269s for a response
I20260709 12:22:24.135727 11152 consensus_queue.cc:1243] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:24.238055  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:24.107398 11167 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:24.238242  8756 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:24.067956 11125 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.240013  8061 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
W20260709 12:22:24.240454  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.240509  8765 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:24.242472  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.243139  8068 raft_consensus.cc:2410] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:24.125099 10910 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:24.460167  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 181745us
I20260709 12:22:24.111377 10999 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:24.272891  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.127754 11187 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:24.101125 11033 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.232831 11155 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.243310 11169 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:24.472566  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.528337  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2641) took 1091 ms. Trace:
I20260709 12:22:24.528821  8218 rpcz_store.cc:276] 0709 12:22:23.436587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.237603 (+801016us) service_pool.cc:224] Handling call
0709 12:22:24.528258 (+290655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:24.471101  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.538794  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.147006 11088 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.312s
I20260709 12:22:24.544353  8138 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:24.548254  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.551673  8145 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:22:24.479389 11013 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.005s
I20260709 12:22:24.358315  8757 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:24.357617  8220 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:24.494642  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:24.499466 10900 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:24.500617  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:24.471009  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:24.573602  8765 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:24.524482  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:24.546666  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 464271us
I20260709 12:22:24.561412  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1474) took 1378 ms. Trace:
I20260709 12:22:24.574416  8143 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:24.574783  8216 rpcz_store.cc:276] 0709 12:22:23.182838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.450269 (+1267431us) service_pool.cc:224] Handling call
0709 12:22:24.531675 (+ 81406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.560306 (+ 28631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.560354 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.560424 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:24.560480 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.560567 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.561341 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:24.567837  8211 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:24.447499 11002 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:24.474946 11231 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:24.593377 10900 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.626289 11125 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:24.631909  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 476) took 1110 ms. Trace:
I20260709 12:22:24.632519  8216 rpcz_store.cc:276] 0709 12:22:23.521388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.576028 (+1054640us) service_pool.cc:224] Handling call
0709 12:22:24.631241 (+ 55213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.631488 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.631526 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.631582 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:24.631628 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.631694 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.631830 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:24.639456  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.640595  8757 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:24.649456  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:24.482344  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:24.546932 11155 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:24.933929  8215 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:24.881372  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1474) took 1008 ms. Trace:
W20260709 12:22:24.890020  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.025s	sys 0.039s
W20260709 12:22:24.885452  8064 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.008s
I20260709 12:22:24.928179  8067 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:24.676007  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:24.835852  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1473) took 1004 ms. Trace:
W20260709 12:22:24.982479  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.051s
I20260709 12:22:25.027388  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1480) took 1022 ms. Trace:
W20260709 12:22:24.881412  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 799336us
W20260709 12:22:24.742094  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.040s
I20260709 12:22:25.080256  8064 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:24.927253  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.078322  8066 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:25.080950  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.065s
I20260709 12:22:24.718357  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:25.080793  8140 rpcz_store.cc:276] 0709 12:22:23.831416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.880094 (+ 48678us) service_pool.cc:224] Handling call
0709 12:22:23.880486 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.001387 (+120901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.835531 (+834144us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54000523d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:24.835776 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180664576}
I20260709 12:22:25.082901  8061 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:25.082051  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.040s	sys 0.072s
W20260709 12:22:24.956312  8141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.046s	sys 0.092s
W20260709 12:22:25.083700  8141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.067s	sys 0.093s
W20260709 12:22:25.074901  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 613079us
I20260709 12:22:25.076911  8218 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.085098  8138 rpcz_store.cc:276] 0709 12:22:24.004611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.050692 (+ 46081us) service_pool.cc:224] Handling call
0709 12:22:25.027127 (+976435us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54002bf7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:25.027298 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132879616}
W20260709 12:22:25.081660  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.021s	sys 0.060s
I20260709 12:22:25.085916  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2643) took 1604 ms. Trace:
I20260709 12:22:25.086300  8218 rpcz_store.cc:276] 0709 12:22:23.481961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.530027 (+1048066us) service_pool.cc:224] Handling call
0709 12:22:25.076666 (+546639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.085673 (+  9007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.085863 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.089023  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:25.076066  8757 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:25.094547  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 452) took 1118 ms. Trace:
I20260709 12:22:25.095031  8757 rpcz_store.cc:276] 0709 12:22:23.975811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.722048 (+746237us) service_pool.cc:224] Handling call
0709 12:22:25.075796 (+353748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.094162 (+ 18366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.094459 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.080850  8145 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:25.097416  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 524) took 1116 ms. Trace:
I20260709 12:22:25.098018  8145 rpcz_store.cc:276] 0709 12:22:23.980856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.580922 (+600066us) service_pool.cc:224] Handling call
0709 12:22:25.097323 (+516401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.080791  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2642) took 1620 ms. Trace:
I20260709 12:22:25.079800  8146 rpcz_store.cc:276] 0709 12:22:23.873341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.874166 (+   825us) service_pool.cc:224] Handling call
0709 12:22:23.883574 (+  9408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.883836 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:23.898450 (+ 14614us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.059639 (+161189us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.880771 (+821132us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180026d580. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:22:24.880963 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.881023 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:24.881078 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.881159 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.881308 (+   149us) inbound_call.cc:177] Queueing success response
0709 12:22:25.041953 (+160645us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b180026d580. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f557 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
Metrics: {"mutex_wait_us":873221,"prepare.queue_time_us":37243,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":897736,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":36336,"spinlock_wait_cycles":264225792,"thread_start_us":112021,"threads_started":1,"wal-append.queue_time_us":547972}
I20260709 12:22:25.100561  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.101372  8756 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:25.102175  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 525) took 1121 ms. Trace:
W20260709 12:22:24.854380 11204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.006s	sys 0.031s
I20260709 12:22:25.102384  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.000415 11153 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:25.105181  8756 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:25.105329 11153 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:25.106009 11204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.024s	sys 0.036s
I20260709 12:22:25.106340 11153 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.107060 11204 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:25.107470 11153 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.103375  8218 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:25.099974  8215 rpcz_store.cc:276] 0709 12:22:23.460847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.525842 (+1064995us) service_pool.cc:224] Handling call
0709 12:22:24.933646 (+407804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.080479 (+146833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.080722 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.109609  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 520) took 1130 ms. Trace:
I20260709 12:22:25.113727  8138 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:25.115715  8067 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:25.123873  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 526) took 1142 ms. Trace:
W20260709 12:22:25.124151  8067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2627) took 1680 ms (client timeout 1866 ms). Trace:
W20260709 12:22:25.115114  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.124316  8138 rpcz_store.cc:276] 0709 12:22:23.981582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.112979 (+1131397us) service_pool.cc:224] Handling call
0709 12:22:25.113332 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.123609 (+ 10277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.123812 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.108676  8146 rpcz_store.cc:276] 0709 12:22:23.981268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.101266 (+1119998us) service_pool.cc:224] Handling call
0709 12:22:25.101600 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.101849 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.101879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.101921 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:25.101953 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.102010 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.102117 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.116211  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:25.124950  8067 rpcz_store.cc:269] 0709 12:22:23.443654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.443806 (+   152us) service_pool.cc:224] Handling call
0709 12:22:24.927904 (+1484098us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b58002f72d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498c9e80aa 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca9027c 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c
0709 12:22:25.124086 (+196182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3361432320}
I20260709 12:22:25.126708  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1574) took 1037 ms. Trace:
W20260709 12:22:25.126490  8143 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:22:25.128520  8143 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:25.128068  8064 rpcz_store.cc:276] 0709 12:22:24.044863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.096135 (+ 51272us) service_pool.cc:224] Handling call
0709 12:22:25.081830 (+985695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.129655  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 527) took 1125 ms. Trace:
W20260709 12:22:25.129861  8220 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
I20260709 12:22:25.133910  8143 rpcz_store.cc:276] 0709 12:22:24.004067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.445164 (+441097us) service_pool.cc:224] Handling call
0709 12:22:25.129573 (+684409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.131536  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2644) took 1607 ms. Trace:
I20260709 12:22:25.133167  8145 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:25.134475  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:25.123307  8140 rpcz_store.cc:276] 0709 12:22:23.979640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.108700 (+1129060us) service_pool.cc:224] Handling call
0709 12:22:25.109064 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.109257 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.109292 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.109332 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:25.109370 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.109429 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.109545 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.141007  8218 rpcz_store.cc:276] 0709 12:22:23.524323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.102864 (+1578541us) service_pool.cc:224] Handling call
0709 12:22:25.103195 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.123059 (+ 19864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.131240 (+  8181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.154060  8213 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 9. Ops: [7.7-7.7]
I20260709 12:22:25.154788  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 521) took 1174 ms. Trace:
W20260709 12:22:25.135381  8069 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.005s	user 0.011s	sys 0.000s
I20260709 12:22:25.136783  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:25.334019  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 197543us
I20260709 12:22:25.137876  8061 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 3.
I20260709 12:22:25.335712  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1566) took 1655 ms. Trace:
I20260709 12:22:25.336154  8061 rpcz_store.cc:276] 0709 12:22:23.680244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.605321 (+925077us) service_pool.cc:224] Handling call
0709 12:22:25.335628 (+730307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.337141  8066 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:25.337402  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:25.049288 11162 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.067s	user 0.012s	sys 0.001s
I20260709 12:22:25.138806  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.339380  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:24.923655 11233 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.647s	user 0.000s	sys 0.002s
W20260709 12:22:24.728746 11207 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.106s	user 0.013s	sys 0.000s
W20260709 12:22:24.881127 11230 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.751s	user 0.000s	sys 0.001s
W20260709 12:22:24.996325 11238 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 12:22:24.996961 11242 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:22:24.877436 11245 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:25.140050  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:24.283877 11185 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:24.924093 10805 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.283s
I20260709 12:22:24.697471 10913 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:25.344220 11152 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:25.077095 11033 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:24.957278 11195 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:25.361089 11167 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.001s
I20260709 12:22:25.365499 11195 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:25.236706 10893 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.366338 11231 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.366010 11167 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.366684 11195 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.368115 11195 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:25.175756  8146 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:25.152386  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.141294 11130 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:25.087574 11146 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.114488 11160 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 12:22:25.142699 11127 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:25.332266  8212 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:24.604558 10835 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:25.208693  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 119777us
I20260709 12:22:25.344492 11162 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:24.729018 11169 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:25.379458  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2645) took 1852 ms. Trace:
I20260709 12:22:25.351137 11207 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.139146  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:25.334921  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.340572  8069 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:25.332448  8218 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:25.346052  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.346822  8215 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:25.381114  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1560) took 1702 ms. Trace:
I20260709 12:22:25.381601  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2647) took 1856 ms. Trace:
I20260709 12:22:25.381523  8064 rpcz_store.cc:276] 0709 12:22:23.678425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.138894 (+1460469us) service_pool.cc:224] Handling call
0709 12:22:25.381047 (+242153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.354557  8067 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:25.348013 11065 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.194s	user 0.015s	sys 0.000s
I20260709 12:22:25.382674  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1561) took 1704 ms. Trace:
I20260709 12:22:25.333060 11236 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:25.333312 10999 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:25.392323 11236 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.392844 11236 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.153955  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 488) took 1142 ms. Trace:
I20260709 12:22:25.361729 11255 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:25.394541 11255 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:25.395488 11255 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.364892 10913 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.398878 10913 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.399655 10913 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:25.400249 10913 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:24.948952 10973 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.405072 11207 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.404827 10913 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.405828 10774 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:25.285189  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.016s
W20260709 12:22:25.407541  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.006s	sys 0.017s
W20260709 12:22:25.407905  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 833237us
I20260709 12:22:25.412710  8220 rpcz_store.cc:276] 0709 12:22:24.011339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.145544 (+134205us) service_pool.cc:224] Handling call
0709 12:22:25.153872 (+1008328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.372835  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2633) took 1938 ms. Trace:
I20260709 12:22:25.414839  8217 rpcz_store.cc:276] 0709 12:22:23.434204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.470919 (+1036715us) service_pool.cc:224] Handling call
0709 12:22:24.471350 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.499015 (+ 27665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.499046 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.499557 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.824618 (+325061us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:24.824698 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.824808 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.372536 (+547728us) raft_consensus.cc:1685] finished
0709 12:22:25.372556 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.372771 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":359011,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":43933,"thread_start_us":324602,"threads_started":1,"wal-append.queue_time_us":856506}
I20260709 12:22:25.418783  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:25.417750  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:25.419554  8217 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.417757  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:25.375761 11249 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.362210 11152 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.358741 10900 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:25.377604  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2629) took 1933 ms. Trace:
I20260709 12:22:24.697773 11002 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.425311 11207 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:25.380290  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1491) took 1578 ms. Trace:
I20260709 12:22:25.381840  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2648) took 1856 ms. Trace:
I20260709 12:22:25.429958  8218 rpcz_store.cc:276] 0709 12:22:23.525574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.153568 (+1627994us) service_pool.cc:224] Handling call
0709 12:22:25.332255 (+178687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.381501 (+ 49246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.381781 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.428866  8070 rpcz_store.cc:276] 0709 12:22:23.444353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.460959 (+ 16606us) service_pool.cc:224] Handling call
0709 12:22:23.478374 (+ 17415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.478665 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.478707 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:23.479301 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.929392 (+450091us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:23.929436 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.929511 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.377368 (+1447857us) raft_consensus.cc:1685] finished
0709 12:22:25.377393 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.377532 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":388719,"threads_started":1,"wal-append.queue_time_us":508256}
I20260709 12:22:25.431303  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:25.432816 10774 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:25.432937  8218 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:25.424495 11252 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:25.433825 11252 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:25.429752  8142 rpcz_store.cc:276] 0709 12:22:23.802268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.803037 (+   769us) service_pool.cc:224] Handling call
0709 12:22:23.803467 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.835117 (+ 31650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.835163 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:23.874293 (+ 39130us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.239768 (+365475us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:24.239806 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.239865 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.380068 (+1140203us) raft_consensus.cc:1685] finished
0709 12:22:25.380088 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.380227 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2051,"raft.queue_time_us":31290,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":43103,"thread_start_us":275224,"threads_started":1,"wal-append.queue_time_us":734953}
I20260709 12:22:25.434927 11252 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.435611  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.435469 11249 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.436298  8070 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:25.379944  8212 rpcz_store.cc:276] 0709 12:22:23.524666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.135724 (+1611058us) service_pool.cc:224] Handling call
0709 12:22:25.203433 (+ 67709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.376346 (+172913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.376549 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.383183  8067 rpcz_store.cc:276] 0709 12:22:23.678759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.139735 (+1460976us) service_pool.cc:224] Handling call
0709 12:22:25.382612 (+242877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.379441 10698 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:25.363483 11185 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.384658 11250 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.382982 10835 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.385303  8757 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:25.376963 11130 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.386372  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 775) took 2403 ms. Trace:
I20260709 12:22:25.386001 11169 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.378953 11146 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.388398 11162 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.370783 11254 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:25.388885 11065 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.390158 11153 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.391777  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 518) took 1412 ms. Trace:
I20260709 12:22:25.393374 10999 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.393745  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.366950 11231 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.155306  8145 rpcz_store.cc:276] 0709 12:22:23.979906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.108899 (+1128993us) service_pool.cc:224] Handling call
0709 12:22:25.122415 (+ 13516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.154417 (+ 32002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.154712 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.373804 11167 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.419273  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:25.489374  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 70223.4us
I20260709 12:22:25.490653  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.371708  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1482) took 1366 ms. Trace:
I20260709 12:22:25.429046  8220 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:25.433506 10774 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.492515  8146 rpcz_store.cc:276] 0709 12:22:24.005296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.126096 (+1120800us) service_pool.cc:224] Handling call
0709 12:22:25.138761 (+ 12665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.369538 (+230777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.371252 (+  1714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.492975  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2652) took 1966 ms. Trace:
W20260709 12:22:25.493227  8065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2611) took 3191 ms (client timeout 1976 ms). Trace:
I20260709 12:22:25.493412  8220 rpcz_store.cc:276] 0709 12:22:23.526706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.422711 (+1896005us) service_pool.cc:224] Handling call
0709 12:22:25.428861 (+  6150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.492702 (+ 63841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.492912 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:25.493642  8065 rpcz_store.cc:269] 0709 12:22:22.301469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.301631 (+   162us) service_pool.cc:224] Handling call
0709 12:22:25.493060 (+3191429us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:25.493163 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721801600}
I20260709 12:22:25.494292 10774 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.436646  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.494796  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:25.494961  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.495348  8062 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:25.495493  8220 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:25.496104  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:25.496306  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.466993 11250 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.497874 11185 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.498672 11250 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.500325 11065 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.501257  8763 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:25.502616 10835 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.429615 11207 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.010682 10244 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:25.432989 11152 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:25.438314 11249 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:25.438421  8069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1554) took 1792 ms (client timeout 1754 ms). Trace:
I20260709 12:22:25.433794  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2658) took 1848 ms. Trace:
I20260709 12:22:25.503592 11153 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.429580 11236 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.382082  8215 rpcz_store.cc:276] 0709 12:22:23.525278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.137688 (+1612410us) service_pool.cc:224] Handling call
0709 12:22:25.332753 (+195065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.381329 (+ 48576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.381544 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.445251 11155 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:25.449146  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.30603e+06us
W20260709 12:22:25.449476  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.450011  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 517) took 1480 ms. Trace:
W20260709 12:22:25.523195  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.524502  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.523066  8137 rpcz_store.cc:276] 0709 12:22:23.969671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.977204 (+  7533us) service_pool.cc:224] Handling call
0709 12:22:23.977523 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.977759 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:23.978086 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.449664 (+1471578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.449718 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:25.449764 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.449834 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.449955 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1276418,"prepare.queue_time_us":611,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1281271,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":194758,"threads_started":1,"wal-append.queue_time_us":856336}
I20260709 12:22:25.454468 11109 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:25.454628  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 475) took 1933 ms. Trace:
I20260709 12:22:25.456246  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:25.529042  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 72895.4us
W20260709 12:22:25.529296  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.458475  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2635) took 2023 ms. Trace:
I20260709 12:22:25.533677  8142 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:25.534068  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.534711  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.535540  8142 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:25.337819  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1572) took 1407 ms. Trace:
I20260709 12:22:25.535766  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.535887  8066 rpcz_store.cc:276] 0709 12:22:23.930451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.167073 (+236622us) service_pool.cc:224] Handling call
0709 12:22:25.337759 (+1170686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.537166  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.537914  8066 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:25.461808  8212 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.466058  8758 rpcz_store.cc:276] 0709 12:22:22.983307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.989257 (+  5950us) service_pool.cc:224] Handling call
0709 12:22:23.030068 (+ 40811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.957140 (+927072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.386102 (+1428962us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54005ef954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:25.386312 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115127680}
W20260709 12:22:25.467551  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.469924  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 479) took 1947 ms. Trace:
I20260709 12:22:25.539626  8219 rpcz_store.cc:276] 0709 12:22:23.522238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.469346 (+1947108us) service_pool.cc:224] Handling call
0709 12:22:25.469590 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.469722 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.469738 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.469765 (+    27us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:25.469782 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.469813 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.469875 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.541304  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:25.542099  8219 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.535776  8214 rpcz_store.cc:276] 0709 12:22:23.521070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.555617 (+1034547us) service_pool.cc:224] Handling call
0709 12:22:24.807555 (+251938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.808031 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.808076 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.882163 (+ 74087us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.337188 (+455025us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.337224 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.337288 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.454392 (+117104us) raft_consensus.cc:1685] finished
0709 12:22:25.454412 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.454562 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9707,"raft.queue_time_us":549365,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3700,"thread_start_us":359433,"threads_started":1,"wal-append.queue_time_us":497116}
I20260709 12:22:25.543155  8214 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:25.543692  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2660) took 1958 ms. Trace:
I20260709 12:22:25.544060  8214 rpcz_store.cc:276] 0709 12:22:23.585510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.542702 (+1957192us) service_pool.cc:224] Handling call
0709 12:22:25.542979 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.543473 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.543641 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.379221 11127 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.545343  8214 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:25.546092  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2662) took 1960 ms. Trace:
I20260709 12:22:25.546413  8214 rpcz_store.cc:276] 0709 12:22:23.586083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.544866 (+1958783us) service_pool.cc:224] Handling call
0709 12:22:25.545177 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.545844 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.546038 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.547401 11127 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.548388  8214 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:25.553187  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.476723  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.554785  8067 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:25.549608 11234 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:22:25.484462  8064 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:25.463549 10698 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:25.486356  8061 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:25.487751  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.492245  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.504072  8220 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:25.557684  8070 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:25.504547  8065 raft_consensus.cc:2376] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6. Re-sending same reply.
I20260709 12:22:25.559963  8143 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:25.560307  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 528) took 1556 ms. Trace:
I20260709 12:22:25.560578  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:25.561025  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:25.561365  8066 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:25.522038 11250 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:25.349299  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.082s	sys 0.113s
W20260709 12:22:25.565548  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.082s	sys 0.114s
I20260709 12:22:25.565692  8064 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:25.511528  8069 rpcz_store.cc:269] 0709 12:22:23.645757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.884248 (+238491us) service_pool.cc:224] Handling call
0709 12:22:25.438205 (+1553957us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003958d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:25.438344 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563586944}
I20260709 12:22:25.511641  8218 rpcz_store.cc:276] 0709 12:22:23.584943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.432424 (+1847481us) service_pool.cc:224] Handling call
0709 12:22:25.432751 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.433550 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.433741 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.566143  8219 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:25.566339  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2630) took 2038 ms. Trace:
W20260709 12:22:25.527742  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.549093 10835 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:25.473871  8217 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:25.549151  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:25.528716 11225 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.534157  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 529) took 1476 ms. Trace:
I20260709 12:22:25.550414  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.532037  8213 rpcz_store.cc:276] 0709 12:22:23.434959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.505544 (+1070585us) service_pool.cc:224] Handling call
0709 12:22:25.153838 (+648294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.154609 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.458194 (+303585us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540014e950. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:25.458391 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337773824}
I20260709 12:22:25.551563  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2659) took 1966 ms. Trace:
I20260709 12:22:25.572338  8140 rpcz_store.cc:276] 0709 12:22:24.057568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.152620 (+1095052us) service_pool.cc:224] Handling call
0709 12:22:25.152967 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.153188 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:25.347261 (+194073us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.533650 (+186389us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.533826 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.533871 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:25.533913 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.533995 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.534102 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215569,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2014,"raft.queue_time_us":34643,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":9672,"thread_start_us":185519,"threads_started":1}
I20260709 12:22:25.573814  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:25.573961  8212 rpcz_store.cc:276] 0709 12:22:23.585234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.460258 (+1875024us) service_pool.cc:224] Handling call
0709 12:22:25.461552 (+  1294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.539100 (+ 77548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.551498 (+ 12398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.574795  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.574900  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:25.575817  8218 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:25.474402  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 139598us
I20260709 12:22:25.510468 11207 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:25.576789  8220 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.481216  8139 rpcz_store.cc:276] 0709 12:22:23.979016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.979137 (+   121us) service_pool.cc:224] Handling call
0709 12:22:23.979478 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.979819 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.979849 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:23.980313 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.202444 (+222131us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:24.202506 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.202605 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.391540 (+1188935us) raft_consensus.cc:1685] finished
0709 12:22:25.391559 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.391707 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23289,"raft.queue_time_us":1792,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9678,"thread_start_us":221650,"threads_started":1,"wal-append.queue_time_us":589426}
I20260709 12:22:25.511300 11148 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:25.577442  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2664) took 1990 ms. Trace:
I20260709 12:22:25.576802  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.577847  8220 rpcz_store.cc:276] 0709 12:22:23.586642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.564349 (+1977707us) service_pool.cc:224] Handling call
0709 12:22:25.576592 (+ 12243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.577210 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.577392 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.580907  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2670) took 1992 ms. Trace:
I20260709 12:22:25.560698  8138 rpcz_store.cc:276] 0709 12:22:24.004410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.125961 (+1121551us) service_pool.cc:224] Handling call
0709 12:22:25.331822 (+205861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.332053 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:25.478427 (+146374us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.559818 (+ 81391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.560030 (+   212us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.560078 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.560143 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.560254 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15774,"prepare.queue_time_us":40059,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1505,"thread_start_us":207625,"threads_started":2}
I20260709 12:22:25.504839  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:25.560578  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.581286  8218 rpcz_store.cc:276] 0709 12:22:23.588207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.566697 (+1978490us) service_pool.cc:224] Handling call
0709 12:22:25.575640 (+  8943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.576255 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.580865 (+  4610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.439060  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.566816  8064 rpcz_store.cc:276] 0709 12:22:23.527823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.565229 (+2037406us) service_pool.cc:224] Handling call
0709 12:22:25.565521 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.566110 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.566285 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.567514  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:25.569164  8215 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:25.549696  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.583110  8146 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:25.575958  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.556182  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2663) took 1969 ms. Trace:
I20260709 12:22:25.583854  8140 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:25.583818  8214 rpcz_store.cc:276] 0709 12:22:23.586355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.547139 (+1960784us) service_pool.cc:224] Handling call
0709 12:22:25.548221 (+  1082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.555933 (+  7712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.556125 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.572609  8762 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:25.589323  8139 pending_rounds.cc:85] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:25.589681  8139 pending_rounds.cc:107] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:25.589916  8139 raft_consensus.cc:2889] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.590255 11130 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.591450  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1450) took 4367 ms. Trace:
I20260709 12:22:25.592451 11192 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:25.592730 11119 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:25.593044 11059 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:25.593680 11059 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:25.594696 11059 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.576421 11167 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.597091  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 158138us
I20260709 12:22:25.597467 11153 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.597167 11167 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.598052  8184 leader_election.cc:400] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:25.598129 11195 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:25.598438  8184 leader_election.cc:403] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:22:25.599645 11167 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:25.600260 11167 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:25.600800  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.604131  8066 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:25.600919 11249 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:22:25.550393 10893 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:25.606838  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.552989 10973 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.607637  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 102864us
I20260709 12:22:25.608372  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:25.608991  8110 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.550s (SENT)
I20260709 12:22:25.609532  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:25.550820 11162 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:25.612462  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51946.9us
I20260709 12:22:25.603422  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:25.613456  8067 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:25.607846  8036 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.555003 11211 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:25.550530 11005 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:25.591840  8144 rpcz_store.cc:276] 0709 12:22:21.224298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.270721 (+ 46423us) service_pool.cc:224] Handling call
0709 12:22:21.271064 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:21.271921 (+   857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.271952 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:21.272574 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 12:22:21.406025 (+133451us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:21.406057 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.406105 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.686191 (+2280086us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:25.590509 (+1904318us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b24000fb4c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:22:25.591205 (+   696us) raft_consensus.cc:1685] finished
0709 12:22:25.591227 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.591390 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":290,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":23374848,"thread_start_us":126657,"threads_started":1,"wal-append.queue_time_us":209782}
I20260709 12:22:25.615082  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.564949 10954 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:25.554777 11189 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:25.622886  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.623857  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2631) took 2076 ms. Trace:
I20260709 12:22:25.629906  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.628533  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2633) took 2085 ms. Trace:
I20260709 12:22:25.629335  8220 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.630057  8066 rpcz_store.cc:276] 0709 12:22:23.528130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.564521 (+2036391us) service_pool.cc:224] Handling call
0709 12:22:25.603894 (+ 39373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.604616 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.604868 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.630795  8067 rpcz_store.cc:276] 0709 12:22:23.528800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.570136 (+2041336us) service_pool.cc:224] Handling call
0709 12:22:25.613146 (+ 43010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.613896 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.614083 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.631783  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:25.633002  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 477) took 2111 ms. Trace:
I20260709 12:22:25.633361  8211 rpcz_store.cc:276] 0709 12:22:23.521665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.127194 (+1605529us) service_pool.cc:224] Handling call
0709 12:22:25.331680 (+204486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.332983 (+  1303us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:25.468674 (+135691us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.632696 (+164022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.632743 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:25.632791 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.632847 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.632941 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14140,"prepare.queue_time_us":181499,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3735,"thread_start_us":258729,"threads_started":2,"wal-append.queue_time_us":149829}
I20260709 12:22:25.634948 11169 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:25.635390 11169 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.635782 11169 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.635795  8761 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:25.645202  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.646965  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1486) took 1611 ms. Trace:
I20260709 12:22:25.647516  8220 rpcz_store.cc:276] 0709 12:22:24.035791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.578744 (+1542953us) service_pool.cc:224] Handling call
0709 12:22:25.629158 (+ 50414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.630984 (+  1826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.646862 (+ 15878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.648546  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:25.645282 11250 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:25.649914 11250 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.649750 10698 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.650408 11250 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:25.650826 11033 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:25.651461 11033 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.651883 11033 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:25.650142 10900 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:25.650893 10698 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:25.571448 10835 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:25.666121  8211 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:25.485212 11254 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.668870  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2635) took 2134 ms. Trace:
I20260709 12:22:25.680944  8067 rpcz_store.cc:276] 0709 12:22:23.534869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.631624 (+2096755us) service_pool.cc:224] Handling call
0709 12:22:25.668303 (+ 36679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.668514 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.668537 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.668584 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:25.668618 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.668696 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.668812 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.667856  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:25.579933 11178 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.620313 11153 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.623101 11130 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:25.687662  8066 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.628724 11162 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:25.602044 11225 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.628343 10973 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.630404 10893 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.645659 11211 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:25.865131  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.810122  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 187353us
W20260709 12:22:25.781617  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 127159us
I20260709 12:22:25.909807  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:25.758850  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 129532us
I20260709 12:22:25.719347  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:25.864562  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 255597us
I20260709 12:22:25.718513  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:25.912112  8110 leader_election.cc:336] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.646s (SENT)
I20260709 12:22:25.718101  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:25.912757  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:25.654285 11148 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:25.652920 11249 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:25.666332 11160 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:25.830380  8069 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:22:25.869545  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 480) took 2342 ms. Trace:
I20260709 12:22:25.934417  8216 rpcz_store.cc:276] 0709 12:22:23.522500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.862231 (+2339731us) service_pool.cc:224] Handling call
0709 12:22:25.864017 (+  1786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.864276 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:25.864299 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.864337 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:25.864369 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.864428 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.864580 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.680357 10835 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:25.707630  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:25.688462  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62101.3us
I20260709 12:22:25.689637  8214 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:25.767338  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.707630  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:25.908970  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2634) took 2379 ms. Trace:
I20260709 12:22:25.947216  8066 rpcz_store.cc:276] 0709 12:22:23.529088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.653309 (+2124221us) service_pool.cc:224] Handling call
0709 12:22:25.687382 (+ 34073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.908308 (+220926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.908876 (+   568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.910838  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:25.924701  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:25.752786  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 487) took 1750 ms. Trace:
I20260709 12:22:25.948832  8212 rpcz_store.cc:276] 0709 12:22:24.002223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.574910 (+1572687us) service_pool.cc:224] Handling call
0709 12:22:25.575216 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.575430 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:25.629883 (+ 54453us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.752310 (+122427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.752378 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:25.752423 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.752507 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.752701 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43820,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":85203,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12167,"thread_start_us":170537,"threads_started":2,"wal-append.queue_time_us":122361}
I20260709 12:22:25.723762  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:25.827843  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1555) took 2181 ms. Trace:
W20260709 12:22:25.884941 11246 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.490s	user 0.000s	sys 0.004s
W20260709 12:22:25.879302 11240 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.297s	user 0.000s	sys 0.003s
I20260709 12:22:25.646518 10774 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:25.771692 11274 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:25.717814  8067 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:25.907122 11256 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:25.951093  8061 rpcz_store.cc:276] 0709 12:22:23.645990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.345745 (+1699755us) service_pool.cc:224] Handling call
0709 12:22:25.827580 (+481835us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:25.827766 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240872704}
I20260709 12:22:25.952534  8143 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:25.668784 10999 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:25.966569  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2636) took 2427 ms. Trace:
I20260709 12:22:25.967182  8067 rpcz_store.cc:276] 0709 12:22:23.539242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.682294 (+2143052us) service_pool.cc:224] Handling call
0709 12:22:25.717579 (+ 35285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.966242 (+248663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.966496 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.813506 11167 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:25.850020 11002 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.972801  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:25.973457  8061 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:25.646265 11231 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.959156  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.824721 11236 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.907593 11130 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:25.824347 11275 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:25.772827 11146 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.829941 11254 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:25.965651  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 486) took 1966 ms. Trace:
I20260709 12:22:25.992955  8067 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:25.994040  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1557) took 2316 ms. Trace:
I20260709 12:22:25.992817  8213 rpcz_store.cc:276] 0709 12:22:23.999308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.572722 (+1573414us) service_pool.cc:224] Handling call
0709 12:22:25.572994 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.573201 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:25.573472 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.965237 (+391765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.965294 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:25.965352 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.965429 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.965570 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50563,"prepare.queue_time_us":45734,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":143386,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5552,"thread_start_us":340775,"threads_started":2,"wal-append.queue_time_us":43297}
I20260709 12:22:25.994513  8067 rpcz_store.cc:276] 0709 12:22:23.677319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.968214 (+2290895us) service_pool.cc:224] Handling call
0709 12:22:25.992673 (+ 24459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.993688 (+  1015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.993964 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.969707  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.970039  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2626) took 2526 ms. Trace:
I20260709 12:22:25.645929 11005 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.970698  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:25.971040  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61336.3us
I20260709 12:22:25.680164 11195 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.274s
W20260709 12:22:25.972141  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.999742  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.885900 11109 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:25.978117  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2638) took 2420 ms. Trace:
I20260709 12:22:25.887219 10954 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:25.980607  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.708022 11178 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.689888 11155 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.281s
W20260709 12:22:25.985735  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73653.1us
I20260709 12:22:25.975950 10805 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.969376 10999 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:26.037981  8110 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.974s (SENT)
I20260709 12:22:26.038480  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:25.989590  8061 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:25.990651  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:25.953583 11171 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.996205  8063 rpcz_store.cc:276] 0709 12:22:23.443258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.443448 (+   190us) service_pool.cc:224] Handling call
0709 12:22:23.454034 (+ 10586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.769045 (+315011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.969823 (+2200778us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001f7054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:25.969988 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569318272}
I20260709 12:22:25.885247 11033 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:25.982300  8146 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:26.000288  8137 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:25.964008 11088 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:22:26.002954  8066 rpcz_store.cc:276] 0709 12:22:23.557413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.958348 (+2400935us) service_pool.cc:224] Handling call
0709 12:22:25.977399 (+ 19051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.977662 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.977704 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.977761 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:25.977807 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.977879 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.978038 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:25.963045 11204 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:26.017117  8142 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:22:25.991941 11130 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:26.031558  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:22:26.017491  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 104445us
W20260709 12:22:26.035301  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.935969 11277 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:22:25.991940 11125 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:26.042644  8757 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:26.043299  8140 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:26.045248 11167 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.193154 11088 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:26.193774 11088 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:26.194795 11088 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.197110 11247 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.197808 11247 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.201202 11247 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.136754 11109 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:26.046730  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.205529  8061 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:26.050138 11211 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.667804 11189 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.211248 11189 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:26.039215 11240 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:26.034714 11002 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.035431 11192 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:22:26.042732 10999 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:26.054390 11152 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:22:26.055927 10954 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.059392 10973 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:26.061396 11270 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:22:26.062196 11178 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.063109 11162 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:25.717549 11185 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.244s
W20260709 12:22:26.097436  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65946.9us
I20260709 12:22:26.079463 11171 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.013952 11146 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:26.103250  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.266916  8063 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:26.135473  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.267860  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.135309  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 97346.7us
I20260709 12:22:26.079406 11204 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.146283 11033 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.139876 10805 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.148234 11237 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.783s	user 0.001s	sys 0.004s
I20260709 12:22:26.103128 11125 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:26.149418  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:26.137775  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.305716  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.154748 11225 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.155797  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:26.310272  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.161257  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 519) took 2182 ms. Trace:
I20260709 12:22:26.311129  8063 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:26.161731  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.163196  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.312704 11125 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:26.312891  8070 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:26.313484 11146 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.164745  8068 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:26.315284  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1564) took 2635 ms. Trace:
I20260709 12:22:26.315632  8068 rpcz_store.cc:276] 0709 12:22:23.679684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.164117 (+2484433us) service_pool.cc:224] Handling call
0709 12:22:26.164509 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.315036 (+150527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.315227 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.317111  8068 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:26.317368  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 446) took 2344 ms (client timeout 2216 ms). Trace:
I20260709 12:22:26.317687  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1575) took 2226 ms. Trace:
W20260709 12:22:26.317842  8763 rpcz_store.cc:269] 0709 12:22:23.973214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.973343 (+   129us) service_pool.cc:224] Handling call
0709 12:22:26.317128 (+2343785us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54002f8854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:26.317276 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3362949888}
I20260709 12:22:26.318193  8068 rpcz_store.cc:276] 0709 12:22:24.091071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.316602 (+2225531us) service_pool.cc:224] Handling call
0709 12:22:26.316932 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.317455 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.317635 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.318914 11171 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.166536  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 485) took 2183 ms. Trace:
W20260709 12:22:26.171437 11207 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.004s
I20260709 12:22:26.270744 11204 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.319859  8217 rpcz_store.cc:276] 0709 12:22:23.983631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.569145 (+1585514us) service_pool.cc:224] Handling call
0709 12:22:25.569460 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.569843 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.569878 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.582612 (+ 12734us) log.cc:844] Serialized 26 byte log entry
0709 12:22:25.953057 (+370445us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:25.953104 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.953178 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.166327 (+213149us) raft_consensus.cc:1685] finished
0709 12:22:26.166345 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.166480 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1432,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":21568,"thread_start_us":351182,"threads_started":1,"wal-append.queue_time_us":476817}
I20260709 12:22:26.169545  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 484) took 2187 ms. Trace:
W20260709 12:22:26.178418 11169 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 12:22:26.322665 11169 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.321749  8219 rpcz_store.cc:276] 0709 12:22:23.982356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.568036 (+1585680us) service_pool.cc:224] Handling call
0709 12:22:25.568318 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.746123 (+177805us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:25.746605 (+   482us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.001885 (+255280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.001934 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:26.002053 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.169250 (+167197us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540014ee54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:26.169310 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.169479 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15640,"prepare.queue_time_us":1190,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":2068,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7050,"spinlock_wait_cycles":402814336,"thread_start_us":252862,"threads_started":1,"wal-append.queue_time_us":507765}
I20260709 12:22:26.325007  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.326650  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:26.178323  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 568692us
I20260709 12:22:26.327896  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.327378  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:26.180409 11005 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:26.218354  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.336355  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.336875  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.219914  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:26.196328 11088 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:26.311074  8141 rpcz_store.cc:276] 0709 12:22:23.979335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.979474 (+   139us) service_pool.cc:224] Handling call
0709 12:22:23.979850 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:23.980261 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.980291 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:23.981040 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 12:22:24.998957 (+1017917us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b4800011058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:25.084112 (+ 85155us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:25.084156 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.084225 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.884351 (+800126us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:26.161036 (+276685us) raft_consensus.cc:1685] finished
0709 12:22:26.161058 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.161196 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465682,"raft.queue_time_us":19866,"raft.run_cpu_time_us":11986,"raft.run_wall_time_us":996202,"spinlock_wait_cycles":73796608,"thread_start_us":1102609,"threads_started":1,"wal-append.queue_time_us":1391563}
I20260709 12:22:26.345400  8141 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:22:26.234513  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.041s
W20260709 12:22:26.245489 10244 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
W20260709 12:22:26.253252  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 336504us
I20260709 12:22:26.254426  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:26.039484 11153 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:26.160471 10893 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.261875  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:26.286681  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.156577  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2632) took 2628 ms. Trace:
W20260709 12:22:26.346517  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.016s	sys 0.041s
I20260709 12:22:26.356999  8759 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:26.358172  8069 rpcz_store.cc:276] 0709 12:22:23.528483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.566628 (+2038145us) service_pool.cc:224] Handling call
0709 12:22:25.830120 (+263492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.933365 (+103245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.156309 (+222944us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001da1d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:26.156500 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604970240}
I20260709 12:22:26.315883 11146 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.329411  8064 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:26.366024  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.366338  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 424) took 1277 ms. Trace:
I20260709 12:22:26.366746  8064 rpcz_store.cc:276] 0709 12:22:25.089374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.365482 (+1276108us) service_pool.cc:224] Handling call
0709 12:22:26.365793 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.365997 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.366025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.366069 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:26.366106 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.366169 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.366283 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.367859  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.182122 11231 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.338909  8217 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:26.248667 11002 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.342561  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.343407  8066 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:26.254577 11152 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.360725 11153 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.364048  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.304795 11274 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:26.368597  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 425) took 1239 ms. Trace:
I20260709 12:22:26.387104  8064 rpcz_store.cc:276] 0709 12:22:25.128971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.367755 (+1238784us) service_pool.cc:224] Handling call
0709 12:22:26.368039 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.368217 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.368243 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.368286 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:26.368317 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.368372 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.368543 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:26.346345 11255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.010s	sys 0.015s
I20260709 12:22:26.378515  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:26.382272  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:26.348582 11139 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:26.320029 11207 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.344861 11148 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:26.390093  8219 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:26.391063  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.325038 11169 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.368700  8141 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:26.394179  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 427) took 1234 ms. Trace:
I20260709 12:22:26.394802  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:26.404919  8064 rpcz_store.cc:276] 0709 12:22:25.159904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.388683 (+1228779us) service_pool.cc:224] Handling call
0709 12:22:26.389116 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.389340 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.389372 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.389455 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:26.393457 (+  4002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.393544 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.394123 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.406649  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.405889  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:26.400007  8215 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:26.380091 11185 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:26.389753 11255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.010s	sys 0.016s
I20260709 12:22:26.308434 10805 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.414633  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.408178  8062 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:26.415861  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.432957  8213 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:26.428508  8064 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:26.434821  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2640) took 1055 ms. Trace:
I20260709 12:22:26.435283  8064 rpcz_store.cc:276] 0709 12:22:25.379085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.427940 (+1048855us) service_pool.cc:224] Handling call
0709 12:22:26.428309 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.434481 (+  6172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.434748 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.430240  8217 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:26.390314 11146 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:26.439867  8064 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:26.444183  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2641) took 1064 ms. Trace:
I20260709 12:22:26.417240  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.446477  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.445401  8064 rpcz_store.cc:276] 0709 12:22:25.379450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.436526 (+1057076us) service_pool.cc:224] Handling call
0709 12:22:26.439639 (+  3113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.443837 (+  4198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.444120 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:26.447536  8211 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:26.462070  8067 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:26.382870 11171 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:22:26.398010 11295 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:26.473052  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55956.7us
I20260709 12:22:26.473968  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:26.424822 11294 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.429967 10913 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:26.467424 11250 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.003s
I20260709 12:22:26.488217  8184 leader_election.cc:400] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
I20260709 12:22:26.408011 11286 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:26.489167  8184 leader_election.cc:403] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:26.460824 11162 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:26.450246 11155 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:22:26.496129  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 226971us
I20260709 12:22:26.506675  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.491685  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.494907  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.509778  8216 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:26.482863 11247 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:26.498940  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.486868 11295 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:26.536286  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:26.539546 11127 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.490149 11278 raft_consensus.cc:2764] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:22:26.534727  8217 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:26.525451  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.540321 11127 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.490239 11250 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.535449  8213 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:26.543985 11127 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.544222  8212 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:26.540868  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.514901 10698 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.843s	user 0.010s	sys 0.002s
W20260709 12:22:26.545763  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2902861740003573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2499s for a response
I20260709 12:22:26.547787 10698 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:26.548822  8110 leader_election.cc:336] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 3.425s (SENT)
I20260709 12:22:26.550215  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:26.445729 11185 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.486074 11294 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.509047 11274 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.492952 11162 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:26.557411  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.581930  8220 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:26.558600 11153 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.536003 11286 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7.
W20260709 12:22:26.559878 11300 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:26.538959 11146 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.564062 10835 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.001s
I20260709 12:22:26.603734 10835 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.605623  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.606173 10835 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.607003  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:26.607378  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.608026  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 531) took 1053 ms. Trace:
I20260709 12:22:26.551888 11195 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.608421  8143 rpcz_store.cc:276] 0709 12:22:25.554264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.560851 (+  6587us) service_pool.cc:224] Handling call
0709 12:22:25.576592 (+ 15741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.966630 (+390038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.607792 (+641162us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540008f7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:26.607953 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863858944}
I20260709 12:22:26.609077 11195 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.610131 11207 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.610263 11152 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:26.517493  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 111711us
I20260709 12:22:26.517243  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1573) took 2558 ms. Trace:
I20260709 12:22:26.614651  8070 rpcz_store.cc:276] 0709 12:22:23.958887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.313717 (+2354830us) service_pool.cc:224] Handling call
0709 12:22:26.314029 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.314241 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:26.314506 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.516689 (+202183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.516767 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:26.516834 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.517028 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.517184 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41545,"prepare.queue_time_us":9543,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":59712,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":32509,"thread_start_us":160144,"threads_started":1,"wal-append.queue_time_us":272634}
I20260709 12:22:26.497956  8219 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:26.616371  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.617863  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.619556  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.546446  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:26.622627  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76355us
I20260709 12:22:26.623320  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:26.569279  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.575682 11292 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.590751  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.561025 10999 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.603214 10805 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.620273  8145 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:26.624682  8066 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:26.628484  8214 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:26.629769  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.631232  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:26.633459  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.634207 10698 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.634529  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.636790 11207 raft_consensus.cc:2764] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:26.589867 10913 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:26.637449 11294 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:26.638806  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.639474  8213 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:26.641094 11250 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.584173 11162 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:26.641696 11285 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:22:26.644953  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.627422 11254 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:26.645627 11130 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.646973  8061 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:26.647063  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.647758  8066 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:26.647956 11002 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.648650  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:26.649221  8066 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:26.650164  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 534) took 1047 ms. Trace:
I20260709 12:22:26.650292  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:26.650600  8140 rpcz_store.cc:276] 0709 12:22:25.603056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.611294 (+  8238us) service_pool.cc:224] Handling call
0709 12:22:26.650000 (+1038706us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400255654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:26.650106 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969122688}
I20260709 12:22:26.651490  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:26.651798  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.652243  8065 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:26.652410  8140 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:26.654275  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2646) took 1252 ms. Trace:
I20260709 12:22:26.654698  8062 rpcz_store.cc:276] 0709 12:22:25.402519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.496041 (+ 93522us) service_pool.cc:224] Handling call
0709 12:22:26.654081 (+1158040us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400320fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:26.654212 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095179648}
W20260709 12:22:26.648512 11290 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.336s	user 0.003s	sys 0.000s
I20260709 12:22:26.660737  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1486) took 1101 ms. Trace:
I20260709 12:22:26.661999  8143 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:26.634684 10698 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:26.646142  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.684854  8145 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.662681  8137 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:26.667850  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.599321 11153 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:26.676509 11125 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.678282 11204 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.659010  7965 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.629158 11146 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.632709  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:26.634232 11192 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:26.645628 11254 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.681942 11130 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.682348  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:26.633352 11281 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:22:26.700208 10913 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:26.683434  8069 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:26.655930  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:26.713079  8062 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:26.713733 11125 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.714048 10999 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:26.688655  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56020.6us
W20260709 12:22:26.717504 11305 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:22:26.717885 10913 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.718417 10913 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:26.719312 11293 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:22:26.723865  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1558) took 3046 ms. Trace:
I20260709 12:22:26.724251  8067 rpcz_store.cc:276] 0709 12:22:23.677789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.995631 (+2317842us) service_pool.cc:224] Handling call
0709 12:22:26.034364 (+ 38733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.462554 (+428190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.723638 (+261084us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400348354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:26.723802 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918804224}
I20260709 12:22:26.709771 11153 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.657820 11278 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:26.698711  8140 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:26.784286 11204 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.711091  8065 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:26.663993 11152 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:22:26.697074 10698 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:26.737293  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 188539us
I20260709 12:22:26.697992 11002 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:26.700843 11155 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:26.683840 11292 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.699124  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:26.765482  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.769506  8067 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:26.770407  8070 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:26.738806 11250 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:22:26.770844  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.821949  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 122888us
I20260709 12:22:26.827196  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.829247  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.830030  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.830703  8217 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
W20260709 12:22:26.831287  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.826582  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.845975  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:26.848439  8211 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:22:26.850455  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:26.853564  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.817442 11211 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.773782 10835 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:26.733529 11295 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.780174  8216 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:22:26.781927 11254 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:26.706708  7965 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 5 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:26.784852 11153 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.773720 11146 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:26.802043  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.814392  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.870304  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:26.870966  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.872113  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:26.807425  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:26.873214  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65925.1us
I20260709 12:22:26.685495 11247 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:26.820434  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.879662  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:26.814263 11002 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:26.816921 11155 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.857142  8143 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:26.860590  8145 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:22:26.891135  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.862463  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:26.880600  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:26.836166 11171 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:26.821020 11310 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.864338  8216 pending_rounds.cc:85] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 4
W20260709 12:22:26.864463  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.864296  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234600us
I20260709 12:22:26.865192 11148 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:26.863274 10893 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:26.901003  8216 pending_rounds.cc:107] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:26.906752  8143 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:26.907218  8216 raft_consensus.cc:2889] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:26.866385  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 295678us
W20260709 12:22:26.908881  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.610s (SENT) [suppressed 15 similar messages]
I20260709 12:22:26.875239  8066 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:26.875964  7965 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 5 to 6, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.911095  8066 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:26.910862  7965 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 5 to 6, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.877271  8142 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:26.913679  8145 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:26.848878 11204 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.881343  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2408816409997598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:22:26.881716  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.017s
I20260709 12:22:26.846212 11207 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:22:26.965071  7965 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 5 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:22:26.967331  8110 connection.cc:256] RPC call timeout handler was delayed by -1.131608447999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4829s for a response
I20260709 12:22:26.967613  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:26.967969  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.532s (SENT)
I20260709 12:22:26.961804  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 579) took 1288 ms. Trace:
I20260709 12:22:26.879287 11127 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:26.904179  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:26.856895 11125 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:26.916847  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:26.966843  7965 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.890535 10805 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:22:26.901011 11309 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:22:26.896760 11002 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:26.917114 11310 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.948143 11291 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:26.863978 11211 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:26.895207 11155 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:26.954895  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46057.6us
I20260709 12:22:26.961750 10893 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:26.903741 11171 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.903541 11294 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:26.771363  8062 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:27.000810  8062 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:22:26.970379  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.010s	sys 0.022s
I20260709 12:22:26.968803  8765 rpcz_store.cc:276] 0709 12:22:25.673486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.673654 (+   168us) service_pool.cc:224] Handling call
0709 12:22:26.961561 (+1287907us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54005000d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:26.961708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140133632}
W20260709 12:22:26.974054  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69977.7us
I20260709 12:22:27.002950  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.973892 11204 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.915663  8066 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:26.977382  7965 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.982483  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:26.983352  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 76997.5us
W20260709 12:22:27.016775  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 141190us
I20260709 12:22:27.047297  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:27.046921  7965 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 5, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 5 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:26.984978  8110 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.499s (SENT)
I20260709 12:22:27.048952  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:26.953544 11148 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.981223 11315 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:27.050631  7965 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 8 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:27.040123  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.988999 11309 consensus_queue.cc:1243] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:27.079358  7965 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.949066 10913 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:26.986680 11192 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.016901  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:27.054112  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 71745.2us
I20260709 12:22:27.090451  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:26.989204 10835 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:27.057507  8062 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:27.001310 11171 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.045826 11254 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.065788 11328 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:27.111444  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55781.4us
I20260709 12:22:27.111130  8065 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:27.072274 11331 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:27.003386 10954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.014s	sys 0.011s
I20260709 12:22:27.004290  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.060592 11322 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:26.998806 11127 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:26.996824 10893 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:26.998248 11311 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:27.111863  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 95046.2us
I20260709 12:22:27.093861  8217 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:27.114188  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:27.115366  7965 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:27.110333  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62238.5us
I20260709 12:22:27.144491  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.001567 11294 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:27.056437 11315 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:27.139371  8062 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:27.091163 11255 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:27.089747 11192 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.093194 10835 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.146395  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:27.140148  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 135936us
I20260709 12:22:27.152531 11276 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:27.153983 11276 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:27.156234 11276 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:27.139322 10954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.018s	sys 0.016s
I20260709 12:22:27.139914 11258 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:27.138334 11059 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:27.163836 11254 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:27.176003 11059 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.176532 11059 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.176374 11254 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.177042 11192 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.178375 11192 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.178784 11254 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:27.179653 11323 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:27.140939 10805 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:22:27.169852 11258 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.181033 11258 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.181589 10954 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:27.141729 11328 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.182006 10954 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:27.153944  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.141506 11278 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:27.164558 11231 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.163470 11294 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.148119 11315 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.111171 11162 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.165041 10835 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:27.140214 11331 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.182435 10954 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.166813 11311 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:27.192296 11254 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:27.188807 10805 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.186923 11292 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.241472  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 457) took 1708 ms. Trace:
W20260709 12:22:27.258802  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 168438us
I20260709 12:22:27.313256  8757 rpcz_store.cc:276] 0709 12:22:25.532976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.553838 (+ 20862us) service_pool.cc:224] Handling call
0709 12:22:25.570554 (+ 16716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.123974 (+553420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.241107 (+1117133us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400447354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:27.241383 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078725504}
I20260709 12:22:27.313854  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.194944  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:27.262389  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.262225  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 148085us
I20260709 12:22:27.264977 10913 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:27.269611 11320 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:22:27.275166 11171 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.213723 10893 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.286413 11331 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.288872 11211 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:27.289512 11312 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:22:27.290457 11204 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:27.290629 10774 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:27.244982 11127 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.293329 11162 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:26.661212  8139 rpcz_store.cc:276] 0709 12:22:25.558910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.577540 (+ 18630us) service_pool.cc:224] Handling call
0709 12:22:25.589087 (+ 11547us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:25.715336 (+126249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.715387 (+    51us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:25.716331 (+   944us) log.cc:844] Serialized 78 byte log entry
0709 12:22:26.001969 (+285638us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:26.212462 (+210493us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.659709 (+447247us) spinlock_profiling.cc:243] Waited 882 us on lock 0x7b1800299200. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:26.659966 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.660235 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.660330 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.660468 (+   138us) raft_consensus.cc:1685] finished
0709 12:22:26.660487 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.660670 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145739,"prepare.queue_time_us":653029,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":246752,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":20751,"spinlock_wait_cycles":2028800,"thread_start_us":332437,"threads_started":2,"wal-append.queue_time_us":396156}
I20260709 12:22:27.254109 11328 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:27.300709 11317 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:22:27.301623 11310 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:27.303684 11301 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.815s	user 0.004s	sys 0.006s
I20260709 12:22:27.304525  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 788) took 1167 ms. Trace:
W20260709 12:22:27.317956  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 123104us
I20260709 12:22:27.323537  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:27.324491  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:27.325537  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:27.414407  8137 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.326767 11002 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:27.331918  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.335839  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.335974  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:27.357249  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.312201 10805 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:27.457055  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 121147us
I20260709 12:22:27.321548 11153 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.337632 11248 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:27.409945 10893 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.333997 11254 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:27.413260  8761 rpcz_store.cc:276] 0709 12:22:26.137059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.137220 (+   161us) service_pool.cc:224] Handling call
0709 12:22:27.304322 (+1167102us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54005460d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:27.304462 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102956288}
I20260709 12:22:27.416128  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:27.455214  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.508308  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.365375 10774 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:27.458001  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:27.314491 11059 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:27.459038  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123256us
I20260709 12:22:27.363245 11331 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 12:22:27.409672  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 424688us
W20260709 12:22:27.483944  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.488658 11171 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.366134 11324 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:22:27.488730 11310 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:27.496999 11292 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.497251 10954 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.409426 11204 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.513612  8137 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:27.514585  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.518500  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:27.520453  8064 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:27.534919 10954 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.513232 11248 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:27.539845 10774 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.541167 10774 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:27.541452 11248 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.543843 11276 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:27.545022 10698 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.002s
I20260709 12:22:27.545449 11331 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:27.545943 11331 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.544863  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.546778 11331 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.547441  8217 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.548089 11331 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.509608 11311 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:27.549131  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 91247us
W20260709 12:22:27.554032  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.554630  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:27.557813  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.567126  8217 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:27.579121  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 161511us
W20260709 12:22:27.579279  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60878.7us
I20260709 12:22:27.559746  8213 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.592801  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:27.595304 11254 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.610755  8070 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:22:27.522185 11278 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:27.518653 11162 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:22:27.579293 11291 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:27.577907 11171 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:27.559048 11148 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.552911 11329 raft_consensus.cc:2764] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:27.610410  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.610329 11310 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.618839 11324 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:27.536556 11292 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.621008 10835 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.623163 11340 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.545476 10698 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.619015 11341 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:22:27.629696 11278 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:27.637712  8213 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:27.644804  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:27.581363 11211 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:22:27.581212 11192 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:22:27.665072  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.636453  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.626109 11171 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.560177 11204 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.676441  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:27.663796 11155 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.000s
I20260709 12:22:27.651391 11340 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.634395 11310 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:27.656417 11337 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 12:22:27.637830 11328 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:22:27.687242 11278 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:27.687562 11344 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:27.689518  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1570) took 3873 ms. Trace:
I20260709 12:22:27.711263  8061 rpcz_store.cc:276] 0709 12:22:23.816507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.206416 (+2389909us) service_pool.cc:224] Handling call
0709 12:22:26.206808 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.647456 (+440648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.689260 (+1041804us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001f6654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:27.689451 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011848960}
I20260709 12:22:27.558784 10805 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.635632 11152 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.703074  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.723048  8213 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:27.633306 11148 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.706401  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:27.750296  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43984.1us
I20260709 12:22:27.751031  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:27.749356  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.755671  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:27.710556 11321 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.494s	user 0.002s	sys 0.013s
I20260709 12:22:27.759406  8213 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:27.759765  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:27.761013 11347 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:27.748003 10954 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:22:27.746134 11315 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.747537 11310 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.651922 10835 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.647320 11059 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:27.653095 10698 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:27.650892 11292 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:27.714915 11231 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:22:27.718093 11192 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.685259 11171 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.689056 11002 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:27.720319  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:27.703580  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.703074  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:27.718503 11340 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.678056 11324 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:22:27.716327 11195 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:27.762146 10954 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:27.787359 11310 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:27.798759 11292 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:27.821782 11310 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:27.822585  8062 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:27.823093 11310 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.824030  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:27.705842 11155 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.824972 10954 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.821825 11324 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.826335 11324 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.826592 11155 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.657431 11258 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:27.756378 11294 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:22:27.827247 11231 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:27.827484 11294 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:27.827736 11324 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.829990 11294 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:27.789314 11192 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:27.787830 11335 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:22:27.831909 11335 consensus_queue.cc:1243] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:27.826002 10954 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.719569 11344 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:27.833459 11344 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.833065 11192 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.766054  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:27.740540 10805 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.835675  8062 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:27.776360  8110 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.976s (SENT)
I20260709 12:22:27.821894  8061 raft_consensus.cc:2376] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8. Re-sending same reply.
I20260709 12:22:27.848853  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:27.836848 11340 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:27.836732 11328 consensus_queue.cc:1175] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c70d5020db543caa986f80b0adaa8d2" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:27.764883  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:27.862102  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 97341.2us
I20260709 12:22:27.865568  8213 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:27.865568  8212 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:22:27.867491  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 180364us
I20260709 12:22:27.850121  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:27.760763 11307 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:27.868062  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.881325  8213 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:27.870249  8061 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:27.872769  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96452.5us
I20260709 12:22:27.830005 11324 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.862349  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:27.841233 10954 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.739898 11204 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:27.843106 11313 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.977s	user 0.007s	sys 0.009s
I20260709 12:22:27.894019  8061 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:27.921849  8137 raft_consensus.cc:1217] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-8.7]   Dedup: 4.5->[6.6-8.7]
I20260709 12:22:27.786180 11276 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:27.833096 11258 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.927873  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:27.932363  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61226.6us
I20260709 12:22:27.918694  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:27.947281  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:27.957919  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.948011  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.963848  8219 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:27.740724 11152 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:27.811386 11315 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:27.753723 11211 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 12:22:27.820932 11148 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:27.949388  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1506) took 1357 ms. Trace:
I20260709 12:22:27.963260  8146 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:27.973592  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:27.888127 10973 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:27.987305  8211 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:27.886874 11207 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:27.956920  8137 pending_rounds.cc:85] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:27.989462  8137 pending_rounds.cc:107] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:22:27.989948  8137 raft_consensus.cc:2889] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:27.996143  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.957464 11214 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:27.999943  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 240254us
I20260709 12:22:27.955193 11162 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:27.952176  8213 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:28.014277  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.014891  8213 raft_consensus.cc:2410] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:28.014983  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.015527  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.016036  8213 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:27.985922  8216 rpcz_store.cc:276] 0709 12:22:26.591990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.592730 (+   740us) service_pool.cc:224] Handling call
0709 12:22:26.602567 (+  9837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.907831 (+305264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.945105 (+1037274us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400374454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:27.949319 (+  4214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407263488}
I20260709 12:22:27.985224 10835 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:27.888520 11249 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:22:27.975946 11002 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.971393  8062 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:27.976761  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.010766  8219 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
W20260709 12:22:28.012885  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 262058us
I20260709 12:22:27.974860  8212 raft_consensus.cc:2368] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:28.017414  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.016568  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:27.994539 11347 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:27.957201 11204 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:22:28.024646  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 422) took 2941 ms. Trace:
I20260709 12:22:28.062445  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.062373  8063 rpcz_store.cc:276] 0709 12:22:25.083661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.325986 (+1242325us) service_pool.cc:224] Handling call
0709 12:22:26.326292 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.326504 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.326549 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.327018 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.001948 (+674930us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:27.001991 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.002068 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.842283 (+840215us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:28.024257 (+181974us) raft_consensus.cc:1685] finished
0709 12:22:28.024279 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.024558 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9194240,"thread_start_us":674550,"threads_started":1,"wal-append.queue_time_us":537970}
I20260709 12:22:27.947124 11155 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:28.003067 11207 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:28.059693  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.059957  8220 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:28.059721  8061 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:28.061546  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.063094  8216 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:28.067519  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.023893 11351 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.000056 11258 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:22:28.069427  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:28.011391 11278 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:28.004364 11153 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:28.073621  8061 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:28.007506 10973 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:28.071314  8211 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:28.084767  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.075884  8213 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:28.077157  8219 raft_consensus.cc:2368] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9.
I20260709 12:22:28.078164  8212 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:28.085896  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:28.079355  8110 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.641s (SENT)
I20260709 12:22:28.065564 11249 consensus_queue.cc:1243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:28.008177 11214 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.082247  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.083949  8061 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:28.086549  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:28.089624  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:28.092013  8219 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:28.089004 10973 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.094444  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.097185 10973 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.097729 10973 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.097781  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.098239 10973 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:28.099326 10893 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 12:22:28.099941 10893 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:28.100003  8143 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:28.100666 10973 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.075328 11335 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:28.105023 11335 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.105229 11278 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.107865 11335 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.080284 11351 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.111162 11351 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.113188 11207 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.114250 11214 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.118237 11347 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.119405  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.120290  8219 raft_consensus.cc:2410] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:28.120164  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.120909  8216 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:28.121132  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:28.121915  8219 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:28.123428  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.121918  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.124864  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.122992  8219 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 6. Ops: [4.2-4.2]
I20260709 12:22:28.125452  8211 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:28.126559  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.127082  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.130141  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.137072  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.027014 11294 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:22:28.066984 11002 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.072453 11155 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.027657 10835 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.182675  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.184496  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:28.146214  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51865.8us
W20260709 12:22:28.148743 11349 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:22:28.176057  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.154212  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2642) took 2774 ms. Trace:
I20260709 12:22:28.278518  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:28.153302 11350 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:22:28.278924  8064 rpcz_store.cc:276] 0709 12:22:25.379732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.447896 (+1068164us) service_pool.cc:224] Handling call
0709 12:22:26.448359 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.542080 (+1093721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.153974 (+611894us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400106dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:28.154150 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465113472}
I20260709 12:22:28.229038  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.280046  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.280200  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:28.280663  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51732.2us
I20260709 12:22:28.281347  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.281405  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.282624  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.282826 11315 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:28.283058 11340 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:28.283380 11352 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:28.283576 11340 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.284049 11340 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.145251 10774 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.284876  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 543) took 1469 ms. Trace:
I20260709 12:22:28.285301  8145 rpcz_store.cc:276] 0709 12:22:26.815692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.890660 (+ 74968us) service_pool.cc:224] Handling call
0709 12:22:26.913497 (+ 22837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.914077 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.284688 (+1370611us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b5400312c50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:28.284815 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51740928}
I20260709 12:22:28.284881  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:28.286185  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:28.158042  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:28.281461 10805 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:28.287801  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.291363  8219 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:28.292402  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.292985  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.277485  8141 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:28.293370  8061 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.287691  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:28.294999  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.295212  8212 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:28.377308  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:28.377310  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 80906.5us
I20260709 12:22:28.378597  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:28.378968  8184 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.249s (SENT)
I20260709 12:22:28.379441  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:28.379755  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.147595 11059 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:28.386258  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.388002  8061 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:28.277909 11204 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.375883  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.376575  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.396431  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.144523 11344 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.394922  8144 raft_consensus.cc:1217] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 12:22:28.389477  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.381038  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:28.385792  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.425869  8141 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:28.417824  8219 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:28.445175  8144 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:28.291720 10893 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:28.382661 11254 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.445706  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.446319 11352 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.388844 10805 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:28.450584  8213 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:28.388854 10973 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:22:28.456058  8217 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:28.428939  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 49990.8us
I20260709 12:22:28.390590 11059 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.423573  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.465910  8214 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:28.466434  8213 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:28.398716 11211 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:28.302233 10774 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.477715  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1576) took 4349 ms. Trace:
I20260709 12:22:28.478137  8068 rpcz_store.cc:276] 0709 12:22:24.128585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.319245 (+2190660us) service_pool.cc:224] Handling call
0709 12:22:26.319528 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.426571 (+107043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.426626 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.426691 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:26.426749 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.477463 (+2050714us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400193cd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:28.477512 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.477660 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245419904}
I20260709 12:22:28.416726 11152 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.397992 11278 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:28.449349 11315 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.502054  8139 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:28.479511  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.542083 11356 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:28.542722 11360 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:22:28.544564 11358 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
W20260709 12:22:28.545724 11171 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.002s
W20260709 12:22:28.548671 10954 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.003s
I20260709 12:22:28.451432 10893 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:28.552450 10805 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:28.554298 10835 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.568490  8219 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:28.571051  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.573410  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.574714  8068 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:28.575932  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.403152 11204 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.472540 11276 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:28.582221  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:28.578111 11171 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.582871 10954 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.456748 11352 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.610790 11247 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:28.611256 11247 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:28.456221 11254 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.476893 11059 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.567283 10893 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:28.621631  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 202879us
I20260709 12:22:28.590490  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:28.622433  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.622611  8211 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:28.593317 11330 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:28.605016  8214 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:28.607649  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:28.613246  8064 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:28.567054 10805 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:28.616811 11363 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:22:28.617936 11155 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.632174  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:28.623708  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:28.638644  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.603502 11356 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:28.643970  8068 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 5.
I20260709 12:22:28.612109 11352 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.612098 11247 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.618758 11002 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.654488  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.654474  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.655994  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.628605 11258 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.657079 11258 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.659798 11258 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.661010  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.662918  8757 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:28.663982  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.628549 11351 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.665071  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.666543 11247 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.664939 11351 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.670210 11351 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.642943 11160 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:22:28.628731 10805 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.683179 10893 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.684494 11328 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:28.685002 11328 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:28.685444 11328 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.628854 11152 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.686081 11152 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.687953  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2650) took 2732 ms. Trace:
I20260709 12:22:28.688063 11152 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.688380  8065 rpcz_store.cc:276] 0709 12:22:25.955797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.814718 (+858921us) service_pool.cc:224] Handling call
0709 12:22:26.837722 (+ 23004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.113852 (+276130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.687698 (+1573846us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003219d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:28.687891 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628259072}
I20260709 12:22:28.567718 11315 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.689805  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.655380  8068 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:28.700152  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:28.702171  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 452) took 1080 ms. Trace:
I20260709 12:22:28.702919  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 453) took 1078 ms. Trace:
I20260709 12:22:28.709065  8758 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:28.709844  8213 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:28.653692 11330 consensus_queue.cc:1243] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:28.708983  8764 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:28.706316  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.708407  8068 rpcz_store.cc:276] 0709 12:22:27.621753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.700427 (+1078674us) service_pool.cc:224] Handling call
0709 12:22:28.700749 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.701782 (+  1033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.701807 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.701858 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:28.701895 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.701974 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.702105 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.703619  8759 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:28.712165  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.709232  8065 rpcz_store.cc:276] 0709 12:22:27.624171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.701917 (+1077746us) service_pool.cc:224] Handling call
0709 12:22:28.702255 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.702474 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.702512 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.702577 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:28.702628 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.702698 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.702850 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.710644  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.717986  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.734378  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.736163  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.739835  8065 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:28.742595  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.743798  8758 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:28.745370  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 583797us
W20260709 12:22:28.734355 11322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.563s	user 0.006s	sys 0.033s
I20260709 12:22:28.746840  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.749547  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.750520  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.750916  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.754057  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.735811 10973 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:28.756850  8763 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:28.762465 11315 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.763068 10954 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:28.763855 11299 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:22:28.764402 11367 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:22:28.764552  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.770733  8759 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.764914  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.763854  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.765385  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.765669 11369 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:28.774902  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.775259 11369 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:28.775377  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.775712 11369 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:28.776127  8757 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:28.776546  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.782765 11340 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:28.749593 11322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.582s	user 0.006s	sys 0.033s
I20260709 12:22:28.745790 11370 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.774325 11373 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:28.774515  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.774694  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:28.777071  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.753364 11276 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:28.811967  8138 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:28.812525  8138 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:28.766269  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.771173 10973 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.819108 10973 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:28.767246 11362 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:22:28.787442 11338 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.168s	user 0.000s	sys 0.002s
I20260709 12:22:28.788307 11254 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.788368 11204 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.767925 11292 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:28.790331 11125 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:28.796083  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:28.796972 11324 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.004s
I20260709 12:22:28.797111  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:28.833528 11296 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:22:28.846099 11296 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:28.846520 11296 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:28.847496 11296 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.847942  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.849160  8145 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:28.850383  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.851035  8145 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:28.799803  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1503) took 2284 ms. Trace:
I20260709 12:22:28.833503 11341 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:28.852917  8218 rpcz_store.cc:276] 0709 12:22:26.515157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.515326 (+   169us) service_pool.cc:224] Handling call
0709 12:22:26.570018 (+ 54692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.598856 (+ 28838us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:26.865772 (+266916us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.971861 (+106089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.971934 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:26.972010 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.799539 (+1827529us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:28.799587 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.799733 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291933,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":3785,"raft.queue_time_us":1499,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8217,"spinlock_wait_cycles":65685376,"thread_start_us":330296,"threads_started":2,"wal-append.queue_time_us":193212,"wal-append.run_cpu_time_us":14842,"wal-append.run_wall_time_us":1297793}
I20260709 12:22:28.753029 11356 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.856199 10805 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.807722  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 786) took 3172 ms. Trace:
I20260709 12:22:28.806947  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.857191  8762 rpcz_store.cc:276] 0709 12:22:25.635060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.635183 (+   123us) service_pool.cc:224] Handling call
0709 12:22:25.635534 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.063106 (+427572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.063151 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.063782 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.270189 (+206407us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:26.310353 (+ 40164us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.372973 (+ 62620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.443063 (+ 70090us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:26.443135 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.609266 (+2166131us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800399d60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:28.807507 (+198241us) raft_consensus.cc:1685] finished
0709 12:22:28.807530 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.807660 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31497,"prepare.queue_time_us":40125,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":47552,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":23440,"spinlock_wait_cycles":993339520,"thread_start_us":200196,"threads_started":1,"wal-append.queue_time_us":335419}
I20260709 12:22:28.815582  8764 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.859831  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.860505  8139 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:28.861388 11327 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.861464  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.862161 11327 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.770762 10893 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.823583  8138 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.833418 11125 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:28.822599  8758 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:28.865288 11125 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.835083 11033 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:28.866480 11125 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.867022 11033 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:28.867533 11033 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:28.821784 11276 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:22:28.773849 11231 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:22:28.868613 11033 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.870816 11296 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.871462 11292 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:28.871734 11033 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.872891  8138 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:28.822158 11370 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.875329 11370 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.858747 10805 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.829806  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:28.869635 11231 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:28.864063 11323 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:28.877118 11231 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:28.877280 11323 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:28.877136  8137 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:28.843144  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.856590  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1517) took 1954 ms. Trace:
I20260709 12:22:28.872560 11292 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.878055 11231 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.882660  8764 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:28.880853  8142 rpcz_store.cc:276] 0709 12:22:26.902580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.920909 (+ 18329us) service_pool.cc:224] Handling call
0709 12:22:26.921330 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.145087 (+223757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.145116 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.171572 (+ 26456us) log.cc:844] Serialized 52 byte log entry
0709 12:22:27.319863 (+148291us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:27.319901 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.319979 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.786718 (+1466739us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:28.856147 (+ 69429us) raft_consensus.cc:1685] finished
0709 12:22:28.856179 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.856510 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39754,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"spinlock_wait_cycles":5117824,"thread_start_us":348441,"threads_started":2,"wal-append.queue_time_us":276983}
I20260709 12:22:28.852352  8760 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:28.887080  8757 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:22:28.887328  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 132649us
I20260709 12:22:28.883986  8138 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:28.885591  8140 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:28.889171  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.891515  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:28.893311  8034 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.216s (SENT)
I20260709 12:22:28.894101 11376 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:28.878326 11340 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:28.861282 11328 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.884428 11370 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:28.914959  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.923631  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:28.896942 11327 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:28.908821 11291 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:28.891249 11373 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:22:28.886730 11294 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:22:28.909610 11185 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:28.937922  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 423) took 3854 ms. Trace:
I20260709 12:22:28.933305  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:28.920120 11231 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.878211 11323 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.925056 11146 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.938342  8069 rpcz_store.cc:276] 0709 12:22:25.085204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.359293 (+1274089us) service_pool.cc:224] Handling call
0709 12:22:26.359603 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.712693 (+353090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.937659 (+2224966us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54001f7f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:28.937854 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744324480}
I20260709 12:22:28.939775  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:28.949452  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58019.2us
I20260709 12:22:28.929281 11291 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:28.951330  8069 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:28.936481  8145 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:28.952455  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.952504  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.953814  8145 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:28.952572  8069 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:28.932277 11356 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:28.955986  8069 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:28.957695  8069 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:28.925951 11370 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:28.960893  8212 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:28.962574  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:28.963088  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:28.964179  8069 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:28.937713 11276 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:22:28.947212 11169 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:28.955344 11356 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.969585 11323 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.019228 11195 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:29.002481  8138 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:28.946424 10913 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:22:28.977222 11291 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:28.969216 10999 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:29.024574  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 56110.5us
I20260709 12:22:29.025739  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:28.958997 11065 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:22:28.960286 11386 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:22:29.014683  8144 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:29.017021 11383 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:22:29.031229 10913 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:22:29.019876 11356 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:29.018224  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.019840 11195 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:29.038363  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67018us
I20260709 12:22:29.050534  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:29.033528 11369 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.074741  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:29.076395  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:29.081274  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:29.085264 11195 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.086505 11195 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:29.057344 11169 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:29.148307  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.243510  8146 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:29.078076 11327 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:29.282091  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 370928us
W20260709 12:22:29.298482  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.230463 11370 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:29.282646 11327 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.091058 11296 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.237s
I20260709 12:22:29.348053  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 498) took 3002 ms. Trace:
I20260709 12:22:29.333678 11249 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:29.376765 11327 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:29.441381 11059 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.006s
W20260709 12:22:29.450600  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 129950us
I20260709 12:22:29.379794  8215 rpcz_store.cc:276] 0709 12:22:26.345590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.359080 (+ 13490us) service_pool.cc:224] Handling call
0709 12:22:26.391021 (+ 31941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.391293 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:26.574438 (+183145us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.013777 (+2439339us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b180011efc0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:29.036706 (+ 22929us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.326992 (+290286us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.327221 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.327284 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.327346 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.327438 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.347937 (+ 20499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123107,"prepare.queue_time_us":2195571,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":9934,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":31624,"spinlock_wait_cycles":45877248,"thread_start_us":563640,"threads_started":3,"wal-append.queue_time_us":406515,"wal-append.run_cpu_time_us":2290,"wal-append.run_wall_time_us":1420720}
I20260709 12:22:29.473479  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:29.481935  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:29.497967 11204 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:29.478641 11059 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.523074 11369 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:29.540869  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.544474  8761 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:29.550149  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.550817  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.544291 11323 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:22:29.541393 11204 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.556521  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 439) took 3005 ms. Trace:
I20260709 12:22:29.573105  8066 rpcz_store.cc:276] 0709 12:22:26.550995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.914925 (+363930us) service_pool.cc:224] Handling call
0709 12:22:26.915272 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.915516 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:27.141391 (+225875us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.264354 (+122963us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.045401 (+1781047us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b180020ec00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:29.045605 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.540414 (+494809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.540463 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:29.540510 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.540600 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.556449 (+ 15849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1822908,"prepare.queue_time_us":2275388,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":28649,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":61290,"spinlock_wait_cycles":100982016,"thread_start_us":541323,"threads_started":3,"wal-append.queue_time_us":830430,"wal-append.run_cpu_time_us":1567,"wal-append.run_wall_time_us":1098766}
W20260709 12:22:29.623409 11388 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
W20260709 12:22:29.628312 11195 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 12:22:29.628980 11148 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:29.639182  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:29.636698 11148 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:29.639349 11356 consensus_meta.cc:287] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.003s
I20260709 12:22:29.655530 11401 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:29.658658  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:29.664302  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:29.665374  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 183568us
W20260709 12:22:29.705545  8064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1588) took 1581 ms (client timeout 1900 ms). Trace:
I20260709 12:22:29.706693  8069 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:22:29.674017 11393 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:22:29.706045  8064 rpcz_store.cc:269] 0709 12:22:28.124298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.306587 (+182289us) service_pool.cc:224] Handling call
0709 12:22:29.705303 (+1398716us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003237d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:29.705481 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498150272}
I20260709 12:22:29.690083 11399 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.663265 11401 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:29.665288 11059 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:29.665501 11311 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:29.718336  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.710256 11169 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:29.711988 11231 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.005s
I20260709 12:22:29.720400  8760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:29.712671 11148 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:29.733459 11395 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:22:29.749259  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.663877 11356 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:29.757100  8760 raft_consensus.cc:606] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:29.763293  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:29.742761 11311 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:29.759774 11148 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:29.794030  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:29.756408 11169 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.717144 11399 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.801273 11169 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:29.803411 11408 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:29.858404 11146 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:29.859223 11146 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.863464 11146 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:29.864735 11146 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.865404 11146 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:29.866838  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:29.811040 11369 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:29.881742  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 445) took 2262 ms. Trace:
I20260709 12:22:29.882241  8063 rpcz_store.cc:276] 0709 12:22:27.619423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.064167 (+444744us) service_pool.cc:224] Handling call
0709 12:22:28.064481 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.064680 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:29.509609 (+1444929us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.881408 (+371799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.881458 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:29.881499 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.881561 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.881685 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177942,"prepare.queue_time_us":1461193,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3720,"thread_start_us":554844,"threads_started":2}
I20260709 12:22:29.817893 11323 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.905697  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:29.886700 11207 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:29.804816 11401 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:29.889964 11127 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.886484 11369 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:29.890569 11323 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:29.935844  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 177036us
I20260709 12:22:29.880841 11408 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:29.965566  8140 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:29.930931 11171 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:29.973706  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1525) took 1837 ms. Trace:
I20260709 12:22:29.974133  8141 rpcz_store.cc:276] 0709 12:22:28.127811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.136401 (+  8590us) service_pool.cc:224] Handling call
0709 12:22:29.964967 (+1828566us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54000442d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:29.965098 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112195840}
I20260709 12:22:29.891670 11311 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:29.970125 11407 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:22:29.953320 11333 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:29.921655 11207 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:29.989084  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:29.970752 11146 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:29.969996 11002 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:30.003238  8216 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:29.990854  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 124110us
I20260709 12:22:30.004009  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:30.005136  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1590) took 1880 ms (client timeout 1710 ms). Trace:
W20260709 12:22:30.005533  8061 rpcz_store.cc:269] 0709 12:22:28.125071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.184186 (+ 59115us) service_pool.cc:224] Handling call
0709 12:22:30.004971 (+1820785us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b54003228d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.005072 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145871232}
W20260709 12:22:30.006377  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1519) took 2299 ms (client timeout 2039 ms). Trace:
W20260709 12:22:30.006765  8217 rpcz_store.cc:269] 0709 12:22:27.703161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.703341 (+   180us) service_pool.cc:224] Handling call
0709 12:22:30.002502 (+2299161us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54001b8d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.002651 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451089152}
I20260709 12:22:30.008919  8062 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:30.009582 11412 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:30.010013 11335 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:30.010421  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2662) took 2448 ms. Trace:
I20260709 12:22:30.010610 11335 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.010854  8062 rpcz_store.cc:276] 0709 12:22:27.562151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.065383 (+503232us) service_pool.cc:224] Handling call
0709 12:22:28.065824 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.009387 (+1943563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.010184 (+   797us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400322dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:30.010360 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4468240640}
I20260709 12:22:29.978025 11422 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.019448  8145 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:29.991925  8141 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:29.977818 11356 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:29.990437 11409 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:22:30.029625  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 120153us
I20260709 12:22:29.999364 11162 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.027308 11309 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:22:29.989295 11333 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:30.035562  8062 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.035409  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:30.036000  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1521) took 2709 ms (client timeout 1540 ms). Trace:
I20260709 12:22:30.036653  8141 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:30.012982 11419 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.036707  8143 rpcz_store.cc:269] 0709 12:22:27.323519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.323635 (+   116us) service_pool.cc:224] Handling call
0709 12:22:30.032908 (+2709273us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400311354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.033081 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576294784}
I20260709 12:22:30.013384 11417 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:30.026425 11399 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:30.039858  8186 connection.cc:256] RPC call timeout handler was delayed by -1.2911818689995016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:22:30.031198 11204 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:30.045586  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.041498  8186 connection.cc:256] RPC call timeout handler was delayed by -1.1336818689997017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 12:22:30.031153 11162 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:30.043777 11414 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:30.044557 11169 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.045375 11335 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:30.046489  8186 connection.cc:256] RPC call timeout handler was delayed by -1.1228818689996842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 12:22:30.044495 11416 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:30.060339  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:30.059432  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:30.062443  8764 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:30.058166  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:30.063431  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.034188 11146 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:22:30.067462  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:30.068279  8758 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:30.069583  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.071316 11369 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.071439 11335 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:30.073904  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:30.075850  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.077205  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.030078 11422 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.110015  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2665) took 1477 ms. Trace:
I20260709 12:22:30.110616  8069 rpcz_store.cc:276] 0709 12:22:28.632312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.967307 (+334995us) service_pool.cc:224] Handling call
0709 12:22:29.706427 (+739120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.707127 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.109704 (+402577us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54003237d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.109910 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699101568}
I20260709 12:22:30.112484  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 477) took 1291 ms. Trace:
I20260709 12:22:30.113087  8757 rpcz_store.cc:276] 0709 12:22:28.821014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.821202 (+   188us) service_pool.cc:224] Handling call
0709 12:22:28.886733 (+ 65531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.887475 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.112205 (+1224730us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540064e950. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.112402 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149799168}
I20260709 12:22:30.128870 10774 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.130692  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 502) took 1683 ms. Trace:
I20260709 12:22:30.131247  8216 rpcz_store.cc:276] 0709 12:22:28.447180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.452905 (+  5725us) service_pool.cc:224] Handling call
0709 12:22:30.003065 (+1550160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.008078 (+  5013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.130384 (+122306us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001b8d50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.130600 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3537576704}
I20260709 12:22:30.138108 11291 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:30.141613 11294 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:30.142238 11294 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:30.143445 11294 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.152024  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 797) took 1447 ms. Trace:
I20260709 12:22:30.153381 11192 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:30.155298 11328 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.158270  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1542) took 1277 ms. Trace:
I20260709 12:22:30.158814  8140 rpcz_store.cc:276] 0709 12:22:28.880752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.890889 (+ 10137us) service_pool.cc:224] Handling call
0709 12:22:29.965218 (+1074329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.966009 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.158014 (+192005us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000442d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.158193 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470000896}
I20260709 12:22:30.152591  8761 rpcz_store.cc:276] 0709 12:22:28.704856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.704991 (+   135us) service_pool.cc:224] Handling call
0709 12:22:30.151695 (+1446704us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.151923 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911658368}
I20260709 12:22:30.165557  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2651) took 4163 ms. Trace:
I20260709 12:22:30.166137  8067 rpcz_store.cc:276] 0709 12:22:26.002427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.892812 (+890385us) service_pool.cc:224] Handling call
0709 12:22:27.297842 (+405030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.298039 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:29.353736 (+2055697us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.966839 (+613103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.966902 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:29.966964 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.967061 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.165309 (+198248us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400347e50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.165471 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1785562,"prepare.queue_time_us":2211370,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2795,"raft.queue_time_us":14057,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":108,"spinlock_wait_cycles":874929920,"thread_start_us":708838,"threads_started":3,"wal-append.queue_time_us":519064}
I20260709 12:22:30.181574 11344 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.183248  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 555) took 1531 ms. Trace:
I20260709 12:22:30.183777  8146 rpcz_store.cc:276] 0709 12:22:28.652191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.652346 (+   155us) service_pool.cc:224] Handling call
0709 12:22:28.656367 (+  4021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.244117 (+587750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.182911 (+938794us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400314054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:30.183167 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349717376}
W20260709 12:22:30.193010  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.193562  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.193495 11294 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:30.194085  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.194566  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.197046  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 506) took 1736 ms. Trace:
I20260709 12:22:30.201098 11153 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:30.207599  8065 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:30.196493  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1534) took 1389 ms. Trace:
I20260709 12:22:30.209245  8139 rpcz_store.cc:276] 0709 12:22:28.807005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.863724 (+ 56719us) service_pool.cc:224] Handling call
0709 12:22:28.864089 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:28.887735 (+ 23646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.887775 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:28.888327 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:22:28.957298 (+ 68971us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:28.958173 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.196075 (+1237902us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54002f1554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:30.196126 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.196177 (+    51us) raft_consensus.cc:1685] finished
0709 12:22:30.196193 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.196418 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4013,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4754,"spinlock_wait_cycles":41457536,"thread_start_us":33776,"threads_started":1,"wal-append.queue_time_us":62549,"wal-append.run_cpu_time_us":2350,"wal-append.run_wall_time_us":1124542}
I20260709 12:22:30.211589 11250 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:30.212334 11250 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.213132  8140 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:30.216905 11214 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:30.217377 11214 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:30.219973 11002 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.221876  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2713) took 1935 ms (client timeout 1678 ms). Trace:
W20260709 12:22:30.222433  8220 rpcz_store.cc:269] 0709 12:22:28.286872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.287017 (+   145us) service_pool.cc:224] Handling call
0709 12:22:30.221611 (+1934594us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:30.221782 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427782400}
I20260709 12:22:30.225054  8067 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 4. Current term is 6. Ops: []
I20260709 12:22:30.226226  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1585) took 2102 ms. Trace:
I20260709 12:22:30.230654  8069 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:30.231518 11002 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.232674  8067 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:30.237705 11250 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.197429  8219 rpcz_store.cc:276] 0709 12:22:28.460589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.464756 (+  4167us) service_pool.cc:224] Handling call
0709 12:22:28.465070 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.569431 (+104361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.196813 (+1627382us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:30.196981 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236722432}
I20260709 12:22:30.241573 11002 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.244692  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:30.245625  8140 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:30.246234  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.250341 11127 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.250917 11127 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.253214  8061 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:30.255079  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.255927  8063 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:30.255746  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.256518  8061 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:30.258071  8064 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:30.261199  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.261895  8064 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:30.264292 11127 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.265638  8063 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:30.265882  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.267699  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.268808  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.270512  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:30.271157  8064 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:30.273900  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.274154  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:30.276286  8139 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:30.226737  8065 rpcz_store.cc:276] 0709 12:22:28.123493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.741152 (+617659us) service_pool.cc:224] Handling call
0709 12:22:28.741570 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.207377 (+1465807us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b54001adc20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:22:30.208155 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.225994 (+ 17839us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001f6b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:30.226161 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228292736}
I20260709 12:22:30.283490  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:30.284760  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 216931us
I20260709 12:22:30.054563 11399 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:22:30.276198  8069 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:30.045909 11204 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.068046 11348 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:30.286373  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.040524 11419 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.293793  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.071349 11323 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.303793  8065 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:30.307547  8219 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:30.087353 11162 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.317234  8220 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [5.5-8.7]
W20260709 12:22:30.317644  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 128429us
I20260709 12:22:30.321066  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 454) took 2619 ms. Trace:
W20260709 12:22:30.321487  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.322151  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.321640  8068 rpcz_store.cc:276] 0709 12:22:27.701968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.712230 (+1010262us) service_pool.cc:224] Handling call
0709 12:22:28.712528 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.716476 (+  3948us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:29.872381 (+1155905us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.001999 (+129618us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.029151 (+ 27152us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.031788 (+  2637us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:30.031827 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.031898 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.320781 (+288883us) raft_consensus.cc:1685] finished
0709 12:22:30.320812 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.320990 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651055,"prepare.queue_time_us":827168,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3984,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":19510,"thread_start_us":556230,"threads_started":2,"wal-append.queue_time_us":138389}
I20260709 12:22:30.341774  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:30.344791  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:30.345681  8760 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:30.102140 11369 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.214s
I20260709 12:22:30.310464  8064 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:30.311880  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.355919  8214 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:30.310918  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.356802  8217 raft_consensus.cc:2376] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9. Re-sending same reply.
I20260709 12:22:30.302407 11428 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.371126  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52416.5us
I20260709 12:22:30.303364 11348 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:30.316171  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.375941  8213 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:30.288938 11416 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:22:30.357847  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.328688 11344 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.311866 10774 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:30.371184  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.315515  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.343118 11185 raft_consensus.cc:476] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:30.371017  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:30.378717  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:30.379321  8214 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:30.403798  8068 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:30.404028  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.404809  8214 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:30.381372  8217 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:30.405851  8218 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:30.314453  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.408608  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.319414 11247 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.373478  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.320459 11335 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.386579  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.387195  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:30.066802 11307 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.223s
I20260709 12:22:30.067620 11333 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.341179 11323 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:22:30.424448  8757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:30.426115  8757 raft_consensus.cc:606] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:30.426554  8757 raft_consensus.cc:614] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:30.428484  8217 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
W20260709 12:22:30.413123  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 339654us
I20260709 12:22:30.413924 11146 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:30.415009 11356 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:30.421816 11247 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.411158  8216 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:30.298565 11214 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.381745 11402 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.348456 11373 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:22:30.381129 11426 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:30.382388 11434 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.469188 11434 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.472168 11434 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:30.473302 11169 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.430136  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:30.384194 11408 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:30.435881  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:30.474984 11214 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:30.483345  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.462586 11431 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.478307 11327 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.030s	user 0.013s	sys 0.000s
I20260709 12:22:30.484473  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.472901 11402 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:30.511902  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 81888.7us
I20260709 12:22:30.384135 11428 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.406730 11344 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.525859  8213 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:30.412585 11385 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:22:30.526546  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:30.423381 11335 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.630882  8216 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:30.532863  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:30.553717  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.572482  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:30.639469  8215 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:22:30.635187  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231945us
W20260709 12:22:30.647601  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.650068  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.652736  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.653901  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:30.653798  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 219431us
I20260709 12:22:30.654587  8141 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:30.526906 11436 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:30.669888  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 137846us
I20260709 12:22:30.511982 11430 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:22:30.509586 11399 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 12:22:30.510421 11195 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:22:30.531730 11185 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:22:30.468125 11426 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.655653 11323 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.766037  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110601us
W20260709 12:22:30.766091  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 122023us
I20260709 12:22:30.523914 11434 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:22:30.629442 11327 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.465730 11348 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.711289 11442 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.572275 11431 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.779886 11422 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.783444 11204 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.790022 11292 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:30.783401 11323 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.794867 11443 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:30.799243 11442 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:30.808274 11419 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:30.823984 11433 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
W20260709 12:22:30.827090 11439 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:22:30.820427 11443 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:30.826576 11426 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.832427 11431 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:30.843909 11428 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:30.841457 11442 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.842541 11443 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.846393 11443 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.700138  8145 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:30.890594  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.891177  8035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.009s	sys 0.017s
W20260709 12:22:30.891827  8035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.009s	sys 0.017s
I20260709 12:22:30.700613  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:30.830199 11335 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.809286 11292 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:30.813069 11291 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.009s
I20260709 12:22:30.838073 11344 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:30.892547  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.892705  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.899749  8110 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.046s
W20260709 12:22:30.903201 11192 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.653s	user 0.014s	sys 0.003s
I20260709 12:22:30.897559  8139 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:30.901243 10774 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:30.900036  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 199341us
I20260709 12:22:30.893613  8070 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:30.894134  8218 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 12:22:30.892592  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 811952us
I20260709 12:22:30.909479 11247 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:30.911024 11292 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.952585  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.993111  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:30.957726 10774 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:30.969558  8110 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.012s	sys 0.046s
I20260709 12:22:30.994947  8138 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:30.995436  8138 pending_rounds.cc:85] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
W20260709 12:22:30.995466  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 605421us
W20260709 12:22:30.989108  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.996999  8140 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:30.989425 11323 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:30.997474  8140 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:30.994984 10774 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:30.999336  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.999467  8110 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.780s (SENT)
I20260709 12:22:30.999202  8140 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:30.828855 11327 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:30.986184 11370 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.001807 11327 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.001724 11370 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.002591 11327 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:30.995816  8138 pending_rounds.cc:107] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:22:31.004837  8138 raft_consensus.cc:2889] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:31.005399  8138 pending_rounds.cc:107] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:31.005730  8138 raft_consensus.cc:2889] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:31.007081  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 227270us
I20260709 12:22:31.010432  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:22:31.011647  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.019500  8140 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:31.004833  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:30.986482 11148 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.187s	user 0.022s	sys 0.000s
I20260709 12:22:31.042801 11148 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:30.987795  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:31.109256  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.108434  8068 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:22:31.070500  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65930.6us
W20260709 12:22:31.130468  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 120434us
I20260709 12:22:31.087124  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:31.094646  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 522145us
I20260709 12:22:31.084760  8137 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:31.010594 11432 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:22:31.107528  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:31.144174  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.145481  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.003s	sys 0.009s
I20260709 12:22:31.122447 11327 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.109093 11440 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.151465  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.003s	sys 0.010s
I20260709 12:22:31.153734  8145 raft_consensus.cc:2410] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:31.150748  8140 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:22:31.154536  8140 pending_rounds.cc:85] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 7
I20260709 12:22:31.154832  8140 pending_rounds.cc:107] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:22:31.155086  8140 raft_consensus.cc:2889] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:31.151155  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:31.107729 11214 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:31.161824 11432 consensus_queue.cc:1243] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:31.162345 11192 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:31.162704  8141 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:31.163076 11192 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:31.159590  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 1.05777e+06us
I20260709 12:22:31.166560  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.166735  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:31.168155 11207 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.168756 11443 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.169096 11292 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.170105  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:31.170413  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.171257  8145 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:31.173909 11443 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.174320  8064 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:31.174408 11443 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.174814 11443 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.175823 11452 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.176828 11452 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.178838 11390 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.179610 11452 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.179950 11385 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.175738 10774 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.184130 11464 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:31.184572 11466 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.194183 11466 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.193954 11214 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.194715 11466 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:31.182492  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 352390us
I20260709 12:22:31.197707  8065 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:31.198113 11464 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:31.198714 11464 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:31.199138  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.200129  8061 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
W20260709 12:22:31.200941 11330 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:22:31.201159  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:31.202111  8758 raft_consensus.cc:606] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.202220  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.203955  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.205000  8067 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:31.205265 11432 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:31.205773 11402 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.206007 11432 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:31.206710 11422 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.207350 11422 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.159289 11440 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.209934 11422 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.210700 11386 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.211378 11440 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.187933 11436 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:31.212172 11436 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:31.212673 11436 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.213404 11451 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:31.215673  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.200747 11309 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:31.216356  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.216876 11309 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:31.217231  8761 raft_consensus.cc:2376] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8. Re-sending same reply.
I20260709 12:22:31.218336 11309 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.164307 11192 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.224891 11309 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:31.226517  8110 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.133s (SENT)
I20260709 12:22:31.179543 11390 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.227186  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.180891 11385 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.216517  8757 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:31.229681 11390 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.230099 11385 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:31.231118  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64563.9us
W20260709 12:22:31.193054  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54062us
I20260709 12:22:31.233803  8138 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:31.179451 11399 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.207376 11432 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:31.238451  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1547) took 2324 ms (client timeout 2131 ms). Trace:
I20260709 12:22:31.239310  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.241039 11214 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.211421 11386 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.243526  8138 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.244947  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.246459  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.246618  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.246733  8764 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:31.247605  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.247745  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.248154  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.248517  8139 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.249409  8756 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:31.249282  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.250504 10774 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.250721  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:31.251214  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:31.251685 11423 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:31.255679 11465 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
W20260709 12:22:31.256078  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.252355  8061 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:31.267201  8760 raft_consensus.cc:2376] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7. Re-sending same reply.
I20260709 12:22:31.276945 11370 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.278512 11417 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:31.279053 11417 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:31.282342 11399 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.282945  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2666) took 2650 ms. Trace:
I20260709 12:22:31.275803  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:31.265380  8137 rpcz_store.cc:269] 0709 12:22:28.913929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.952244 (+ 38315us) service_pool.cc:224] Handling call
0709 12:22:31.238148 (+2285904us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400311854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:31.238325 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4734679936}
I20260709 12:22:31.271389 11423 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:31.288583  8137 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:31.284945  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.283417  8070 rpcz_store.cc:276] 0709 12:22:28.632644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.558553 (+925909us) service_pool.cc:224] Handling call
0709 12:22:29.558903 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.968111 (+1409208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.282573 (+314462us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540011d5d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:31.282835 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067567872}
I20260709 12:22:31.293619  8137 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:31.300225  8762 raft_consensus.cc:2376] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10. Re-sending same reply.
I20260709 12:22:31.303463  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:31.305079 11422 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.305754  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:31.306881 10774 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.307595 10774 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.301239  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.320727 11231 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:22:31.325055 11249 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:31.326097 11440 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:31.326571 11440 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:31.326992 11440 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:31.331931  8144 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:31.310426 11370 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:31.289762 11423 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.337318 10913 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.357359 10913 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.347493  8065 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:31.315936 11386 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.280342 11417 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.359210 11417 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:31.348748  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.361517  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.361927  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.350034  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 157568us
I20260709 12:22:31.364075 10774 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.364236  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.366513  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.367527 11249 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:31.368535 11249 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.367261 11333 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:31.350606  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1538) took 2542 ms. Trace:
I20260709 12:22:31.373060  8142 rpcz_store.cc:276] 0709 12:22:28.808089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.887191 (+ 79102us) service_pool.cc:224] Handling call
0709 12:22:28.887468 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.971174 (+ 83706us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:28.975914 (+  4740us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.201345 (+1225431us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180034a200. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:22:30.412921 (+211576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:30.412986 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.413033 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.350131 (+937098us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b5400043654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:31.350208 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.350392 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4719,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1422,"raft.queue_time_us":5853,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":39512,"spinlock_wait_cycles":196112896,"thread_start_us":210759,"threads_started":1,"wal-append.queue_time_us":1573073}
I20260709 12:22:31.375838 11370 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:31.350530 11399 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:31.357102 11276 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:31.345757 11460 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:22:31.357815 10913 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.367244 11426 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:31.383854 11426 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:31.384235 11426 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:31.351627  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.385375 11426 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.385980  8137 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 3.
I20260709 12:22:31.387009 11426 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:31.391815 11447 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.564s	user 0.000s	sys 0.001s
I20260709 12:22:31.400882  8139 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:31.401644 11323 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.404965 11323 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.406940 11442 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.406991 11431 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:31.408017 11431 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.409538  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:31.409989  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43592.7us
I20260709 12:22:31.410372  8068 raft_consensus.cc:2368] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:31.410631 11423 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:31.410821  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.412488 11247 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:31.413657  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 517) took 2441 ms. Trace:
W20260709 12:22:31.413797  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 187338us
I20260709 12:22:31.415328 11348 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.414099  8212 rpcz_store.cc:276] 0709 12:22:28.972605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.005187 (+ 32582us) service_pool.cc:224] Handling call
0709 12:22:30.224399 (+1219212us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:30.320876 (+ 96477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.320907 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:30.349813 (+ 28906us) log.cc:844] Serialized 52 byte log entry
0709 12:22:30.641191 (+291378us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:30.641235 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.641310 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.390723 (+749413us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:31.411793 (+ 21070us) raft_consensus.cc:1685] finished
0709 12:22:31.411817 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.413287 (+  1470us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540014e950. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:31.413443 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95993,"raft.queue_time_us":185480,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":26773,"spinlock_wait_cycles":2810151680,"thread_start_us":223465,"threads_started":1,"wal-append.queue_time_us":401627}
I20260709 12:22:31.416179  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.416690 11431 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.417241 11420 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:31.417896 11420 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:31.418473  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.419078 11420 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.425679 10774 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:31.426213 10774 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:31.426682 10774 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.429035 11452 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:31.429781 11452 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.430305  8138 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:31.433518  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.438452  8212 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:22:31.412573 11323 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:31.450524  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.407946 11442 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.475116  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:31.478304  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 166930us
W20260709 12:22:31.480116  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.481931  8758 raft_consensus.cc:606] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.482208  8139 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:31.483117 11401 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.483909 11401 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.487107 11401 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.488653  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:31.505793  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:31.510596 11247 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.513139  8212 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:31.514744 11436 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.512068 11443 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.528760  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:31.534574  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:31.521672  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50961.6us
I20260709 12:22:31.444516 11466 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.545190 11192 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:31.534188  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:31.530424  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:31.518985  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:31.524946 10999 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.519582 11443 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.531814 11162 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:22:31.553210  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 81178.4us
I20260709 12:22:31.520866 11436 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.559258  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:31.516577 11422 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.524811 11356 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:31.558480  8061 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:31.560745  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 86900.8us
I20260709 12:22:31.546289 11401 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.560279  8212 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
W20260709 12:22:31.590252  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43789.1us
I20260709 12:22:31.527024 11146 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:31.594197  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:31.531473 11153 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:22:31.592182  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.602802  8219 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:22:31.605729 11476 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:22:31.609335  8141 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:31.610766  8144 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:31.526770 11130 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:22:31.610824  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.591998 11401 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.545953 11192 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.601753 11452 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:31.605733 11477 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:22:31.554543 11464 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.562781 10913 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.608495 11292 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:31.628275  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.625520  8068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:22:31.629024  8068 raft_consensus.cc:606] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.617321 11401 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.631747  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:31.634467 11294 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.693648 11294 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.694103 11294 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:31.698395  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 139903us
I20260709 12:22:31.699267  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.616919 11356 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:31.700906 11333 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.701498 11356 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.708973  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:31.710685  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.711593  8068 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:31.649472 11440 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.650542  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.652091 11442 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:31.652791  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46845.8us
I20260709 12:22:31.653215 11466 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.654613  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.719480 11422 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:31.656581 11348 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:31.720705 11255 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:31.721211 11348 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:31.656776  8062 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:31.621232 11231 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:22:31.646988  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.661078 11323 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:31.664284  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 194280us
I20260709 12:22:31.666770 11401 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.667896  8763 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:31.633366 11249 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.628649 10999 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:31.672250  8764 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:31.673200  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.673588 11386 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.673954  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.674715  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.677575 11192 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.749017  8756 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:31.678315  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.679247  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.628525 11292 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.683925 11370 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.693017  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:31.711655 10913 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.650197 11464 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.721637  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.722776  8765 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:31.723822  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:31.731632  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.733709 11440 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:31.737321  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 90430.6us
I20260709 12:22:31.738036 11453 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.739297 11323 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:31.750574  8219 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:31.784111  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44162.3us
I20260709 12:22:31.740780 11452 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:31.792915  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:31.794065  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.788695  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.831194  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.834709 11423 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.835232 11423 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.838428 11423 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:31.846254  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58644.1us
I20260709 12:22:31.847787 11153 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.849772  8220 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:31.850524 11423 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:31.851137  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54417.1us
I20260709 12:22:31.797118 11192 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.855048 11192 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:31.847929  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 59349.1us
I20260709 12:22:31.789311 11292 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.873991 11436 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:31.874444 11436 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:31.874806 11436 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:31.876940  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 159902us
I20260709 12:22:31.877717  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.878077 11423 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.879392 11401 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.879987 11401 raft_consensus.cc:993] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:31.860385  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.882582  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:31.883388  8142 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.883728 11399 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.884295 11399 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.885006  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:31.886503 11399 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:31.869902  8760 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:31.843448  7965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 259) took 12436 ms (client timeout 15000 ms). Trace:
I20260709 12:22:31.894430  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:31.869392  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:31.748024 11146 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:22:31.857295  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:31.893402  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96259.4us
I20260709 12:22:31.895185  8140 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:31.909529  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.896154  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:31.900386  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53245us
I20260709 12:22:31.880445 11401 raft_consensus.cc:1081] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:31.801702 11452 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:31.798591 11323 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:31.857031 11426 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.801844 10999 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:31.914546  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:31.804095  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.783989 11417 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.122s
W20260709 12:22:31.925462  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.923969  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:31.948939  8146 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:31.951555  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 73905.7us
I20260709 12:22:31.952615  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:31.797134 11370 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:31.952765  8035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.990s (SENT) [suppressed 30 similar messages]
I20260709 12:22:31.941184 11464 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.966924  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:31.969707  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:31.968945 11231 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:31.968382 11130 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.976755 11130 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.977135 11323 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.978991 11323 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:31.979497 11130 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:31.981401 10999 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:31.921509 11484 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:22:31.962301 11426 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.964716 11327 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:31.986917  7964 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 8 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.989630  7964 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:31.991453  7964 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:32.006287  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 162322us
W20260709 12:22:32.004081  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51577.5us
I20260709 12:22:32.018165  8142 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:31.871040 10774 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:32.021445  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 75106.8us
I20260709 12:22:31.960688 11422 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:32.024015  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54345.9us
I20260709 12:22:31.856832 11348 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:31.798926 11386 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:32.001504 11482 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:31.996677 11192 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:31.995436 11426 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.005409 11249 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:32.037457 11146 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:32.056849  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 111241us
I20260709 12:22:32.060101  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:32.067135  8140 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:32.021947 11464 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.046916 11484 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:32.083756  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:32.037736 11327 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:32.050787 11420 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:32.083105  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.086046  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:32.069545 11162 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:32.110309  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.070150 11422 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:32.109272  7964 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 7, leader changed from <none> to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 7 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.058115 11146 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.128113  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:32.133901  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83387.6us
I20260709 12:22:32.135841  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.143472  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.144246  8066 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:32.144753  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.145459  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.145816  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:32.146136  8064 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:32.148106 11370 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.150681 10774 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:32.151780  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81899.5us
I20260709 12:22:32.152725  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:32.155435 11294 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.133664 11146 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:32.158581 11292 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.161607 10774 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:32.169480  8215 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:32.165594 11386 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:32.171041 11130 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.171736 11130 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.174458 11130 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:32.113920 11401 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:32.184619  8062 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:32.179894  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:32.185761  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:32.182176  7964 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.190491  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:32.195621  8146 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 4.
I20260709 12:22:32.229231  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:32.261454 11488 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:22:31.894913  7965 rpcz_store.cc:269] 0709 12:22:19.406678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.433030 (+ 26352us) service_pool.cc:224] Handling call
0709 12:22:31.843165 (+12410135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:27.533328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:27.534024 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:27.534076 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:22:27.534095 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:27.535262 (+  1167us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:27.535367 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:27.535419 (+    52us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:22:27.795835 (+260416us) tablet.cc:701] Row locks acquired
0709 12:22:27.795908 (+    73us) write_op.cc:260] PREPARE: finished
0709 12:22:27.796118 (+   210us) write_op.cc:270] Start()
0709 12:22:27.796309 (+   191us) write_op.cc:276] Timestamp: P: 1783599747796041 usec, L: 0
0709 12:22:27.796335 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:22:27.797145 (+   810us) log.cc:844] Serialized 4465 byte log entry
0709 12:22:28.777486 (+980341us) op_driver.cc:464] REPLICATION: finished
0709 12:22:28.845689 (+ 68203us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18000cbf20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:28.928315 (+ 82626us) write_op.cc:301] APPLY: starting
0709 12:22:28.928399 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:28.934919 (+  6520us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:28.934954 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:29.025326 (+ 90372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:29.039908 (+ 14582us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:22:29.039974 (+    66us) write_op.cc:312] APPLY: finished
0709 12:22:29.040316 (+   342us) log.cc:844] Serialized 83 byte log entry
0709 12:22:29.045454 (+  5138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:29.066461 (+ 21007us) write_op.cc:454] Released schema lock
0709 12:22:29.075411 (+  8950us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:29.085157 (+  9746us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:29.085202 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16918,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":150502,"apply.run_cpu_time_us":8004,"apply.run_wall_time_us":156785,"num_ops":11,"prepare.queue_time_us":205005,"prepare.run_cpu_time_us":38073,"prepare.run_wall_time_us":549404,"raft.queue_time_us":170233,"raft.run_cpu_time_us":11690,"raft.run_wall_time_us":58329,"replication_time_us":980951,"spinlock_wait_cycles":4655872,"thread_start_us":571601,"threads_started":4,"wal-append.queue_time_us":292719,"wal-append.run_cpu_time_us":44970,"wal-append.run_wall_time_us":1965628}]]}
W20260709 12:22:32.204604 11473 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:22:32.228786  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:32.229873  8219 raft_consensus.cc:2376] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9. Re-sending same reply.
I20260709 12:22:32.261657  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.203940 11417 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:32.203859 11386 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:32.269785  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.227826  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:32.267596  7964 catalog_manager.cc:5697] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 4, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.181635 11420 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.272971  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:32.279206  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 182914us
I20260709 12:22:32.135006 11484 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:32.276307  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 404247us
I20260709 12:22:32.274467  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.274612  8211 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:32.275130  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47393us
I20260709 12:22:32.265196 11130 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:32.290534  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.231401 11401 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:32.305984  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:32.273186 11490 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:22:32.272554 11489 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:22:32.279034 11368 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:32.325542  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.319103  7964 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 5 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.328083  8220 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:32.273854 11417 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.328488  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:32.335906  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.338497  8069 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.339337  8215 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:32.339946  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.285552 11464 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:32.296867 11323 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:32.274035 11386 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:32.294298 11292 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.294803 11420 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:32.374126  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.296900 11333 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.373893  7964 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.397747  7964 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:32.377274  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.336880  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:32.401793  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:32.385143  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.388095  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.389410  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.404930  8211 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:32.391644  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:32.406103  8220 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:32.274569 11436 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.387753  8219 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:32.283128 11146 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.373893 11417 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:32.407523  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43678.4us
I20260709 12:22:32.412464  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:32.414821  7964 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 6, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 6 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:32.424067  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.390116 11386 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:32.431422  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.293956 11452 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.442469  8063 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:32.443073  7964 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 7, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 7 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.454628  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.430747 11249 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:32.456691  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.407124 11323 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.439498 11192 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:32.466598  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.474345  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:32.469508  7964 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.483320  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 533) took 1046 ms. Trace:
I20260709 12:22:32.486018  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:32.426447 11333 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.462369 11292 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.505293  8219 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:22:32.493701 11162 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:32.509683 11493 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:32.510021  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.513092  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:32.514662 11496 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:32.517920 11484 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:32.531693  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 206175us
I20260709 12:22:32.532446  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:32.539295  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.555229  8065 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 4: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:32.499032 11452 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:32.549047  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 396139us
I20260709 12:22:32.483924  8218 rpcz_store.cc:276] 0709 12:22:31.436860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.446298 (+  9438us) service_pool.cc:224] Handling call
0709 12:22:31.470013 (+ 23715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.491353 (+ 21340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.491402 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.524405 (+ 33003us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:31.550988 (+ 26583us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.799974 (+248986us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:31.800036 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.800939 (+   903us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.471745 (+670806us) raft_consensus.cc:1685] finished
0709 12:22:32.471776 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.483226 (+ 11450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":17505,"spinlock_wait_cycles":5600000,"thread_start_us":169467,"threads_started":1,"wal-append.queue_time_us":446160}
I20260709 12:22:32.541112  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.561992  8215 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:32.563199  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.564020  8761 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:22:32.564968  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98944.9us
I20260709 12:22:32.566745  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.567574  8138 raft_consensus.cc:2368] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:32.568240  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.569105  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.570574  8144 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:32.548753 11192 raft_consensus.cc:2764] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:32.580840  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.581678  8760 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:32.582397  8760 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:32.588608  7964 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 7, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 7 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.568768  8139 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:32.569669  8762 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:32.611987  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:32.613351  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.617874  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.619305  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.619489  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.620776  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.622148  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.625427  8214 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:32.627031  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.627826  8760 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:32.616272 11493 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:32.628695  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.631716  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.633302  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:32.634013  8146 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:32.634961  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:32.637406  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:32.644490  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:32.644132  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70571.3us
I20260709 12:22:32.649761  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:32.650651  8066 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.654628  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:32.537237 11401 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.667102  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.557272 11292 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.665426  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:32.675249  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.679909  8214 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:32.675290  8138 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:32.662161 11504 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.682529 11504 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.687299  8139 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:32.690060  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:32.690339  8219 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:32.693724  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81838.9us
I20260709 12:22:32.630582 11497 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:32.714717  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.715981  7964 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 5 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.720741  8764 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:32.722175  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:32.722443  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:32.649026 11464 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.726466  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:32.706907 11348 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:32.733425 11192 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:32.724474 11436 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.731974 10774 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.745184 11506 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:32.748271 11420 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:32.750186 11333 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:32.750981 11514 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:22:32.750629 11466 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:32.750826  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:32.761705  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 491) took 1135 ms. Trace:
I20260709 12:22:32.725421  8138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
W20260709 12:22:32.756395 11422 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.633s	user 0.001s	sys 0.007s
I20260709 12:22:32.713296 11497 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:32.761814 11192 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:32.788460  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:32.791859  7964 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 2 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.797634  8065 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:32.661412 11162 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.813234  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.806582  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:32.775085 11506 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.779064 11323 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.788901  8758 rpcz_store.cc:276] 0709 12:22:31.626716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.626873 (+   157us) service_pool.cc:224] Handling call
0709 12:22:31.647966 (+ 21093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.668496 (+ 20530us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:31.668902 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.054234 (+385332us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.378908 (+324674us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.569134 (+190226us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.630536 (+ 61402us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.630707 (+   171us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:32.630756 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.630830 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.761425 (+130595us) raft_consensus.cc:1685] finished
0709 12:22:32.761448 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.761606 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22781,"prepare.queue_time_us":9690,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":5042,"raft.queue_time_us":74142,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":33470,"thread_start_us":879152,"threads_started":3,"wal-append.queue_time_us":668246}
I20260709 12:22:32.742105 11464 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.830200  7964 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 1 to 2, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.795097 11422 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:32.795260 11497 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:32.802230 11192 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:32.836805 11498 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:32.836701  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:32.837911 11518 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:22:32.840584  8137 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:32.777951 11510 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:22:32.841429  8756 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:32.826231 11436 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:32.845017  8216 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:32.834959  8218 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:32.793035 10774 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.854590  8066 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:32.856019  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.842792 11292 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:32.860601  8142 raft_consensus.cc:2393] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:32.861982 11294 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:32.862278 11323 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:32.877606  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.877439  7964 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 4 to 6, term changed from 4 to 6, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:22:32.878990  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 127322us
I20260709 12:22:32.890265  8219 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:32.891942  8137 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:32.835872 11348 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:32.880162  8146 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:32.881811  8214 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:32.892481  8142 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:32.893476  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:32.882668  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.894611  8217 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:32.895749  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.897107  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.897912  8217 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:32.899027  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:32.884406  8216 pending_rounds.cc:85] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 4
I20260709 12:22:32.901273  8216 pending_rounds.cc:107] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:32.901676  8216 raft_consensus.cc:2889] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:32.832645 11506 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:32.889246  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 190041us
W20260709 12:22:32.915320  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 108864us
I20260709 12:22:32.922341  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:32.923228  8066 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:32.924320  7964 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 5 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.926782  7964 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 5 to 7, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 7 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:32.929733 11348 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:32.933264  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:32.937857  7964 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:32.949220  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.953680  8142 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:32.955916  8142 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:32.960316  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1584) took 1098 ms. Trace:
I20260709 12:22:32.919690 11323 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:32.970793  8141 rpcz_store.cc:276] 0709 12:22:31.861895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.887465 (+ 25570us) service_pool.cc:224] Handling call
0709 12:22:32.959483 (+1072018us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:22:32.959691 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.959894 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.959924 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.959969 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:32.960017 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.960084 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.960217 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10371968}
W20260709 12:22:32.994863  8069 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 12:22:32.995473  8069 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:32.997605  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.005693  8219 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:33.013227  8035 leader_election.cc:336] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.039s (SENT)
I20260709 12:22:33.021179  8065 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:32.900576  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.023849  8217 raft_consensus.cc:2410] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:33.024755  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:33.028954  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:32.979759 11504 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.031334  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.038230  8211 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.039067  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:33.017058 11368 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.005s
I20260709 12:22:33.003557 11130 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.044481  8142 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:33.077100 11525 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:33.060547 11368 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.065763 11323 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:33.070569  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57407.6us
I20260709 12:22:33.072075 11436 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:33.064571 11417 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
W20260709 12:22:33.083148  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58586.9us
W20260709 12:22:33.077667 11519 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:22:33.062335 11386 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 12:22:33.089425  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.058149 11422 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.059213 11498 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:33.099327  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70523us
I20260709 12:22:33.107402  8142 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:22:33.119064  8144 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.003s
I20260709 12:22:33.119673  8144 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:33.118237 11498 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:33.120918  8216 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:33.121829 11498 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.124891 11464 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:33.126209 10774 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:33.108180 11436 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:33.127475 11452 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.001s
I20260709 12:22:33.058895 11130 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.103992 11417 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.129263  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.133477  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:33.157001  8143 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:33.181248  8211 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:33.181802  8214 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:33.118475 11323 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:33.182337 11323 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:33.184056  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.192235  8217 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:33.192529  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.182797 11323 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.194499  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:33.196969  8216 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:33.113828 11386 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.195456  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.202857  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.191382 11130 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.204272  8142 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:33.205435  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 477) took 1087 ms. Trace:
I20260709 12:22:33.185292 11422 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.214423 11506 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.217248 11417 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:33.227797  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 110492us
W20260709 12:22:33.202855 11522 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:22:33.226574  8067 rpcz_store.cc:276] 0709 12:22:32.118221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.123382 (+  5161us) service_pool.cc:224] Handling call
0709 12:22:32.144853 (+ 21471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.445133 (+300280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.445164 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.459504 (+ 14340us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.696161 (+236657us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:32.696212 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.696304 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.205202 (+508898us) raft_consensus.cc:1685] finished
0709 12:22:33.205223 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.205354 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8913,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":486983,"threads_started":2,"wal-append.queue_time_us":330713}
I20260709 12:22:33.232743  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.233055  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.233712  8217 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.234889  8218 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:33.227855 11422 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:33.236238 11422 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.228601  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:33.245267  8216 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:33.252825 11538 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:33.253530 11538 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:33.291126 11538 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.255379 11192 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.295646 11192 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.296459  8138 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.296900  8138 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.272943 11436 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.313422  8217 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
W20260709 12:22:33.314215  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 85675.2us
W20260709 12:22:33.315122  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.317914  8138 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.326807  8146 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 10. Ops: []
I20260709 12:22:33.330214  8064 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:33.318754 11386 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:33.317458 11442 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:33.335207  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.334450  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.337147  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.338373  8064 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.339207  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.339404  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.339826  8069 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:33.340337  8061 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:33.326169 11506 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.341771  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.326135 11323 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.345525  8066 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:33.308221 11497 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.349956  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.353062 11539 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:33.353783  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.354039 11436 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.354642 11323 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.355103 11440 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.355790  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.356093  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:33.366622  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:33.356282  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.356829  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.357342  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.359819  8065 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.369509  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.370308  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.370678  8141 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.367690  8212 raft_consensus.cc:2376] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8. Re-sending same reply.
I20260709 12:22:33.372902  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.373061  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:33.374112  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49201.1us
I20260709 12:22:33.375329  8214 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:33.375303  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:33.375277  8110 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.627s (SENT)
I20260709 12:22:33.376884  8219 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:33.377556  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.379504  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.383329  8220 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:33.342401 11442 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.400024  8217 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:33.401944  8217 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:33.407969  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:33.412952  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:33.415271  8763 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:33.390492  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.383646  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:33.383862  8066 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:33.376722 11323 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.423009  8065 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:33.420866  8064 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:33.421978  8765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 590) took 1968 ms (client timeout 2191 ms). Trace:
I20260709 12:22:33.364337 11436 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.381230 11498 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:33.425463  8765 rpcz_store.cc:269] 0709 12:22:31.433076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.433225 (+   149us) service_pool.cc:224] Handling call
0709 12:22:33.401140 (+1967915us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54005307d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:33.401258 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234213632}
I20260709 12:22:33.374904 11440 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.398448 11541 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.438475  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:33.438798 11541 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:33.439354 11442 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.439900 11541 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.441449 11146 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.448663 11422 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:33.449751 11540 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:33.451277 11422 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.451946 11422 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.452979 11497 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.453400  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 479) took 1326 ms. Trace:
I20260709 12:22:33.453822  8070 rpcz_store.cc:276] 0709 12:22:32.126693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.127019 (+   326us) service_pool.cc:224] Handling call
0709 12:22:32.148891 (+ 21872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.628957 (+480066us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:32.629306 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.859271 (+229965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.859336 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:32.859379 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.453168 (+593789us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540011cbd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:33.453215 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.453342 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":704,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2898,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1103296896,"thread_start_us":229300,"threads_started":1,"wal-append.queue_time_us":425646}
I20260709 12:22:33.455885  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.457283  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.457950  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:33.458245 11503 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:33.459810 11065 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:33.460775  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.461674  8064 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:33.462198 11065 consensus_queue.cc:1243] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:33.462589  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.460032 11503 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:33.463601 11503 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:33.457314  8066 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:33.464613 11503 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.468822 11466 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:33.469477 11503 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.458585  8765 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.470945 11466 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:33.469177  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.480772  8063 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.481935 11356 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:33.482800 11323 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:33.483023 11146 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:33.484535  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.369174 11539 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.485785  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.453018  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:33.488054 11436 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.488734  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.489007  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.407366  8217 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.491775  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.492861  8765 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:33.523339  8142 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:33.526443  8143 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:33.482800 11440 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.531213  8217 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.531648  8146 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:22:33.530510  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 136545us
I20260709 12:22:33.556476  8139 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:33.571731  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.523372 11153 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:22:33.523439 11323 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.579389  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.522182 11510 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:33.586069  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:33.586947  8763 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.551404 11442 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:33.595441  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 220179us
I20260709 12:22:33.597715  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.595681  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.586305 11510 consensus_queue.cc:1243] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:33.594377 11443 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:33.604652  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.581466 11333 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:22:33.580579 11327 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:22:33.590700 11506 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:33.603408  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.607733  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.603454  8217 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:33.615932  8217 pending_rounds.cc:85] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 4
I20260709 12:22:33.616199  8217 pending_rounds.cc:107] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:33.616441  8217 raft_consensus.cc:2889] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:33.603392  8110 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.965s (SENT)
I20260709 12:22:33.612604  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.594494 11368 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.617815  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.619841  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:33.620340  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.618665 11545 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:33.621591 11545 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.602212 11065 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:33.622146 11545 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:33.624123 11541 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:33.635241 11436 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:33.594803 11442 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.651362  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.615698 11146 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:33.639143  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1528) took 1345 ms. Trace:
I20260709 12:22:33.640218 11466 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:33.644145 11440 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:33.648646  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 120400us
I20260709 12:22:33.652737  8137 rpcz_store.cc:276] 0709 12:22:32.293406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.859070 (+565664us) service_pool.cc:224] Handling call
0709 12:22:32.891775 (+ 32705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.904390 (+ 12615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.638947 (+734557us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400052dd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:33.639082 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74412800}
I20260709 12:22:33.658192  8764 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:33.659289 11442 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.659332 11466 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:33.663560 11466 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.664091  8184 leader_election.cc:400] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:33.664539  8184 leader_election.cc:403] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:33.654177  8217 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:22:33.629916 11503 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:33.685000  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:33.676736  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:33.680897 11443 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:33.647987 11538 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.625875 11368 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.688570  8763 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:33.647781 11548 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:33.696457  8186 leader_election.cc:400] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:33.716301  8765 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:33.719990  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:33.720760  8217 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.723263 11497 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:33.723731 11557 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.724323 11557 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.724037 11497 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.724725 11557 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.709306 11538 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:33.720230  8219 pending_rounds.cc:85] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:22:33.727566  8219 pending_rounds.cc:107] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:22:33.727967  8219 raft_consensus.cc:2889] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:33.728909  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61310.3us
I20260709 12:22:33.729970  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.718391 10774 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:33.709012 11442 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:22:33.737890 11538 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.745767 11507 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:33.752364 11292 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.753793 11443 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:33.754132 10774 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.775527  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.728607 11436 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:33.787523  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:33.799845  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 114930us
I20260709 12:22:33.802531  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.728574 11548 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.767665 11507 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:33.809080  8756 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:33.852322  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.816776 11516 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.817453 11452 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.819077  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:33.820897  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.821871  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.824059  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1589) took 1921 ms. Trace:
I20260709 12:22:33.829169  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:33.829694  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2737) took 1652 ms (client timeout 1627 ms). Trace:
I20260709 12:22:33.830160  8137 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:33.830578  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.832058  8142 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:33.833572  8146 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:33.834183  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.854138  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.838737 11162 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:33.803912  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:33.855507  8140 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.855634  8143 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:33.861316  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:33.851058  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.780171 10774 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.854537  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:33.855979  8215 rpcz_store.cc:269] 0709 12:22:32.177833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.191942 (+ 14109us) service_pool.cc:224] Handling call
0709 12:22:33.829465 (+1637523us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54002b4b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:33.829603 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154533120}
I20260709 12:22:33.866444  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:33.871946  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.779904 11348 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:33.872561  8069 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.792819 11153 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:33.874598  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70755.6us
I20260709 12:22:33.857580  8145 rpcz_store.cc:276] 0709 12:22:31.902554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.965809 (+ 63255us) service_pool.cc:224] Handling call
0709 12:22:32.023392 (+ 57583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.027986 (+  4594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.028039 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.040650 (+ 12611us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.456406 (+415756us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:32.456466 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.823683 (+1367217us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b5400254c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:33.823728 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.823768 (+    40us) raft_consensus.cc:1685] finished
0709 12:22:33.823779 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.824003 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27508,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":25057,"spinlock_wait_cycles":8720640,"thread_start_us":350196,"threads_started":1,"wal-append.queue_time_us":497958,"wal-append.run_cpu_time_us":1884,"wal-append.run_wall_time_us":1012600}
I20260709 12:22:33.878080  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.878697  8142 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:33.879019  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.879885  8142 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:33.880151  8217 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:33.885857  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.874607 11411 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.889170 11436 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.890206 11368 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.895153  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.896059  8217 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:33.899569  8138 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.853063 10913 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.852679 10999 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:33.897536  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:33.855731 11401 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:33.923655  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:33.923792 11401 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.780501 11292 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.927500 11231 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.927963 11231 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.928357 11231 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.928494 11292 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.929812 11327 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:33.933827  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:33.934584  8063 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:33.935892  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:33.936772 11503 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.924554 10774 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.937208 11503 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.937625 11503 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.937811  8211 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:33.940982  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:33.941651  8144 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.942044 11323 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.942286 11401 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.944291 11526 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:33.944679 11526 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:33.945443 11526 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.913334  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51464 (request call id 1597) took 1831 ms. Trace:
I20260709 12:22:33.915089 11506 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:33.863823 11539 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.874769 11452 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.893064 11443 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:33.874789 11399 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:33.911603 10913 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.916744 11311 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:22:33.909957 11515 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.863422 11162 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:33.917259 11348 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.888527 11411 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:33.922580  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 121725us
I20260709 12:22:33.869999 11423 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.884402 11333 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:33.947242  8138 rpcz_store.cc:276] 0709 12:22:32.083120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.686407 (+603287us) service_pool.cc:224] Handling call
0709 12:22:33.805125 (+1118718us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540008f2d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca83a3d 00007f4991a53cd0 00007f498afd8254 00007f498afd81e2 00007f498afd8111 00007f498afd808c 00007f498afd7342 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:33.884807 (+ 79682us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b4c0046ee00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498ad58a20 00007f498ad69a29 00007f498ad6a13f 00007f498ad2e2ab 00007f498ad5bf3c 00007f498ad5c3fe 00007f498afe988b 00007f498c9e8495 00007f498ca3930f 00007f498ca83a55 00007f4991a53cd0
0709 12:22:33.900207 (+ 15400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276250880}
I20260709 12:22:33.960295  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:33.974140  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:33.973145  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:33.963378  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 216798us
I20260709 12:22:33.946189 11548 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:33.962617 10913 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.988320  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:33.945978 10774 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:34.006289  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 230876us
I20260709 12:22:34.003748  8144 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:34.006188  8211 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:33.991080  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.001955  8140 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:34.005019  8069 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:34.007998  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.007443  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.013410  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:33.877523 11516 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.025367 11292 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:34.026794 11516 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.027518 11545 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:33.974757 11515 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.022105  8763 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:34.022234 11348 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.022661 11497 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.022444 11411 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.023191 10774 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.024286  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:34.024804 11452 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:33.995904 11333 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:33.981475 11423 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.989748 11507 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:33.961473 10999 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.029886 11555 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:34.031442  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:33.972366 11399 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:33.896823 11153 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:34.036460  8110 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.207s (SENT)
I20260709 12:22:34.038749  8757 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:34.061522  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:34.040194  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:33.995476 11539 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.045759  8765 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:34.046401  8758 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:34.054515  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.058575  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.071648  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:34.079840  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:34.059360 11423 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:34.078508  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.080166  8216 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:34.088567  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52149.4us
I20260709 12:22:34.061532 10774 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:34.086602  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.056433 11497 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:22:34.078238 11555 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:34.096058  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:34.081393 11389 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:34.082758 11507 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.110702  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.111660  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:34.092857 11559 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:34.106782  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 97585us
W20260709 12:22:34.120306  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 112386us
I20260709 12:22:34.118002  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.093099 11417 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:34.100423  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 223815us
I20260709 12:22:34.093925 10774 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:34.097963 11548 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:34.135823  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152593us
I20260709 12:22:34.108912 11249 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:22:34.129264  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.117720 11442 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:34.092442 11564 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:22:34.132368 11389 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:34.100556 11348 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:22:34.156225  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:34.157148  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:34.148398  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:34.137270 11548 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:34.177450  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 79863.6us
I20260709 12:22:34.149243 11417 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:34.181284  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:34.185956  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56798us
W20260709 12:22:34.186761  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46997.4us
W20260709 12:22:34.186910  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51219.8us
W20260709 12:22:34.187695  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.158604 11389 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.170970 11548 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.210614  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:34.211192  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:34.213402  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 79884.1us
I20260709 12:22:34.135596 11333 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.158764 11539 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:22:34.153719 11559 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:22:34.196985 11506 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.209834 11389 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.137995 11399 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.217624  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:34.218612  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:34.216943  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.226181  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:34.281313  8066 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.226938  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.227866  8065 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:34.210322 11292 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:34.236845 11503 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.208458 11515 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.199673 10913 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.279706  8062 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:34.280491  8061 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:34.215752 11545 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.215109 11561 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:34.285897 11292 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.298233 11162 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.299575 11162 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.299760 11503 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.225538 11442 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:34.292867  8062 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:34.199867 11572 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
W20260709 12:22:34.309456  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110246us
I20260709 12:22:34.276511 11323 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.225782 11562 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:34.318106 11565 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:22:34.214306 10774 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.230841 11510 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:22:34.334913  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.336581  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.386690 11574 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:34.366595 11545 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:34.387388 11574 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.298249 11292 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.390184 11590 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:34.390671 11590 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.391026 11590 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.326332  8062 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.392841 11561 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:34.393220  8062 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.393959 11561 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.398314 11442 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:34.409283 11576 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:22:34.410048 11417 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.199750 11555 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:34.416311 11570 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:22:34.417872 10999 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.359939  8066 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:34.373934 11560 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:22:34.301286 11506 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.331895 11153 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.375777 11231 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:34.379351 11538 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:22:34.380822 11323 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.386796  8141 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:34.337003  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:34.434468  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 217299us
I20260709 12:22:34.292001 11348 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:34.435635  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:34.648012  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 212474us
I20260709 12:22:34.441268  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.442451  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.469944  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.468591  8062 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:34.470539  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.542142  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:34.536572  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.659400  8212 raft_consensus.cc:2376] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8. Re-sending same reply.
I20260709 12:22:34.668936  8220 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:34.670594  8145 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:34.500299  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.494196  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.436106 11574 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:34.606804  8035 leader_election.cc:336] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.958s (SENT)
W20260709 12:22:34.612481  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.537290 11443 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:34.646853  8070 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:34.547118 11497 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:34.703176  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.658161 11575 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:22:34.493659 11559 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:34.703150  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:34.716348  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 499413us
I20260709 12:22:34.500799 11583 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.712738  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.717734  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.722592  8217 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:34.698837 11539 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.699193 11545 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:34.700166 11564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.007s
I20260709 12:22:34.700078 11443 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:34.732548  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.746112  8211 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:34.741266  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:34.654620 11162 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:22:34.645139 11538 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.770186  8141 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:34.742653 11564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.008s
W20260709 12:22:34.775969  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 169195us
W20260709 12:22:34.776703  8035 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.990s (SENT)
I20260709 12:22:34.777191  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.775054  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.713490 11153 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:22:34.717530 11348 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:22:34.734252 11545 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:34.780726  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:34.790660  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:34.793869  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:34.732863 11497 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.722468 11559 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.719487 11292 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.767094 10999 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:22:34.796413  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:34.797899  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80293.4us
I20260709 12:22:34.772814 10913 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.746909 11539 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.801780  8140 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:34.793447 11557 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.000s
I20260709 12:22:34.788698 11545 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.803459  8184 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.804095 11443 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.811388 11323 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.813230 11538 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.814939 11292 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.833252  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.798390 11162 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:34.833267  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:34.847283  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:34.836812  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.848204  8061 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.850494  8144 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:34.829592 11557 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.846928  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:34.847664  8070 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:34.849433  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 558) took 1136 ms. Trace:
I20260709 12:22:34.852591 11443 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.857842  8146 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:34.500515 11584 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.522s
I20260709 12:22:34.860953  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:34.865626  8065 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.869591 11600 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:34.870100 11389 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 12:22:34.847410 11162 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:34.870452 11600 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:34.870639 11389 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.857406 11564 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:34.870265  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.840356 11333 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.904440  8756 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:22:34.894568  8140 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:34.860351  8219 rpcz_store.cc:276] 0709 12:22:33.697296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.697491 (+   195us) service_pool.cc:224] Handling call
0709 12:22:33.719967 (+ 22476us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:33.988783 (+268816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.988841 (+    58us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:34.008558 (+ 19717us) log.cc:844] Serialized 78 byte log entry
0709 12:22:34.137486 (+128928us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:34.137529 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.137658 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.833463 (+695805us) raft_consensus.cc:1685] finished
0709 12:22:34.833497 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.833741 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1949,"raft.queue_time_us":107483,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":16908,"thread_start_us":356105,"threads_started":2,"wal-append.queue_time_us":191253}
I20260709 12:22:34.846660 11323 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:34.860026 11585 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:34.854846 11557 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.863003 11231 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.863766 11561 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:34.923411  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.863269 11577 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
I20260709 12:22:34.936658  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:34.938272  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:34.934700  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 210363us
I20260709 12:22:34.849949 11583 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:22:34.911012 11574 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.927657 11595 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.960098  8065 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:34.917416 11562 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:22:34.949965 11153 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.946556 11577 consensus_queue.cc:1243] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:34.940203 11557 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:34.935650 11130 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:22:34.934394 11561 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:34.944514 11587 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.961537 11333 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.969650 11389 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:34.972271 11590 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.002s
I20260709 12:22:34.927969 11323 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:34.977634 11592 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 12:22:34.934305 11585 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.978353 11603 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
W20260709 12:22:34.981348 11596 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:22:34.981455 11583 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.989164 11539 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:34.985519 11545 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:34.990648 11608 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:22:34.968951  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 189028us
I20260709 12:22:35.060592 11614 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.060806  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:35.061211 11614 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:34.991048  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 142908us
I20260709 12:22:35.064551 11613 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:35.064833 11607 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:22:35.065138 11613 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:34.945906 11572 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:35.066141 11613 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.962829 11609 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:35.000545  8061 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:35.010581  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:34.977902 11605 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.068233  8137 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:35.040582  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 132088us
W20260709 12:22:35.005123 11423 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.003s
I20260709 12:22:35.049365  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:35.075525  8145 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.999823 11348 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:35.050944  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 77806.4us
I20260709 12:22:34.976657 11506 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:34.996783 11557 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:35.096460 11557 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:35.098079 11507 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.980s	user 0.010s	sys 0.002s
I20260709 12:22:35.003367 11568 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.099640 11568 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:34.965368 11595 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:35.067678 11555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.008s	sys 0.007s
I20260709 12:22:35.101873  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:35.093538  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54450.7us
I20260709 12:22:35.110411  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.115290  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.116039  8061 raft_consensus.cc:2368] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:35.112564  8757 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:35.057468 11497 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.118161  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:35.082398 11614 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.037221 11590 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.108831 11609 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:35.118261 11555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.007s
I20260709 12:22:35.123284  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:35.141475  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.163807  8757 raft_consensus.cc:2368] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:35.144767  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 505) took 1005 ms. Trace:
I20260709 12:22:35.166458  8758 rpcz_store.cc:276] 0709 12:22:34.139343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.139481 (+   138us) service_pool.cc:224] Handling call
0709 12:22:34.150734 (+ 11253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.155546 (+  4812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:34.155592 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.197145 (+ 41553us) log.cc:844] Serialized 26 byte log entry
0709 12:22:34.424121 (+226976us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:34.424159 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.424227 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.144469 (+720242us) raft_consensus.cc:1685] finished
0709 12:22:35.144498 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.144683 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5947,"raft.queue_time_us":1931,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13514,"thread_start_us":202406,"threads_started":1,"wal-append.queue_time_us":561425}
I20260709 12:22:35.120796 10999 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:35.135788  8184 connection.cc:256] RPC call timeout handler was delayed by -2.5330192719998195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:22:35.120867 11539 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.101962 11423 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.179800  8213 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:35.141541 11548 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.003s
W20260709 12:22:35.175882  8184 connection.cc:256] RPC call timeout handler was delayed by -1.9282192719997511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:22:35.056684 11583 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.183426  8757 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:35.123863 11559 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.147050 11568 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:35.193570 11611 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:22:35.194605 11609 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:35.196175 11616 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:22:35.197149 11422 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:35.197528 11422 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:35.195271 11589 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:35.205168  8110 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.536s (SENT)
I20260709 12:22:35.205706  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:35.198460 11422 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.209403  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.213632 11590 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:35.182726 11539 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.183449 11548 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:35.218411  8110 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.586s (SENT)
I20260709 12:22:35.212387 11422 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.209775 11589 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:35.225175  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.225437 11585 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.226763 11595 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.227841 10913 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:35.230571  8137 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:35.261638  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:35.261940  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:35.263092 11417 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:35.263662 11417 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:35.228302 11583 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:35.264592 11417 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.267714 11591 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:35.268337 11591 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:35.211916 11609 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.461123  8217 pending_rounds.cc:85] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 1
I20260709 12:22:35.397053  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.515980 11595 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:35.409132  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 127220us
I20260709 12:22:35.519394  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:35.474222  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.393671  8758 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.317384  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 589) took 1444 ms. Trace:
I20260709 12:22:35.438146  8140 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
W20260709 12:22:35.438951  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.517973  8217 pending_rounds.cc:107] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:35.522253  8217 raft_consensus.cc:2889] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:35.339773  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:35.315722  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:35.523483  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:35.528322  8145 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:35.317629  8141 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:22:35.530961 11617 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:35.531450 11617 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.531824 11617 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.532783 11423 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:35.532999 11595 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.521303  8146 rpcz_store.cc:276] 0709 12:22:33.872617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.878801 (+  6184us) service_pool.cc:224] Handling call
0709 12:22:35.317042 (+1438241us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400312754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:35.317264 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249353472}
I20260709 12:22:35.521648  8140 pending_rounds.cc:85] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
I20260709 12:22:35.535473  8140 pending_rounds.cc:107] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:35.535780  8140 raft_consensus.cc:2889] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:35.536300 11582 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.151s	user 0.002s	sys 0.014s
I20260709 12:22:35.538038  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:35.415061 11443 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
W20260709 12:22:35.284268 11593 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.898s	user 0.008s	sys 0.000s
I20260709 12:22:35.561841  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:35.399835 10774 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.559635  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.575347  8140 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:35.467137 11631 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.332482 10913 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:35.593600 11631 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.594575 10913 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.595817 10913 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.596030 11631 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:35.586903  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.597487  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.597848  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.598686  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:35.599077 11386 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.599574  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.600684 11348 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:35.601228 11348 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:35.601696 11348 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.604420 11526 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.604986 11466 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:35.585851  8110 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.825s (SENT)
I20260709 12:22:35.606448  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:35.573381 11587 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:35.615768 11587 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.575979 11453 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:35.619364 11453 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:35.620674 11453 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.623193 11595 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.432788 11561 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:35.275908 11557 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:35.579479  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55146us
I20260709 12:22:35.632922  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1586) took 1186 ms. Trace:
I20260709 12:22:35.639889  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:35.640540  8065 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.626093  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 602) took 1527 ms. Trace:
I20260709 12:22:35.636705  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.642664  8068 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:35.641623  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.453307 11600 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.404867 11589 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.649180  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.652837  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.653961  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.654170  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:35.654449  8035 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.013s (SENT)
I20260709 12:22:35.654865  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.637920  8220 rpcz_store.cc:276] 0709 12:22:34.446353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.264023 (+817670us) service_pool.cc:224] Handling call
0709 12:22:35.400040 (+136017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.414676 (+ 14636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.414715 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.426501 (+ 11786us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.516917 (+ 90416us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:35.516961 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.517034 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.632694 (+115660us) raft_consensus.cc:1685] finished
0709 12:22:35.632713 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.632849 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14333,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9969,"thread_start_us":67920,"threads_started":1,"wal-append.queue_time_us":107652}
I20260709 12:22:35.641784  8143 rpcz_store.cc:276] 0709 12:22:34.098383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.098510 (+   127us) service_pool.cc:224] Handling call
0709 12:22:34.098863 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.142305 (+ 43442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:34.142339 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.148728 (+  6389us) log.cc:844] Serialized 26 byte log entry
0709 12:22:34.697454 (+548726us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:34.697519 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.579793 (+882274us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:35.579841 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.579893 (+    52us) raft_consensus.cc:1685] finished
0709 12:22:35.579905 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.625997 (+ 46092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16775,"raft.queue_time_us":18715,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4556,"spinlock_wait_cycles":60380416,"thread_start_us":496553,"threads_started":1,"wal-append.queue_time_us":626520}
I20260709 12:22:35.651099  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.673614  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.673743  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:35.672971  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.675735  8220 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:35.661757  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:35.676438  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1590) took 1229 ms. Trace:
I20260709 12:22:35.676956  8220 rpcz_store.cc:276] 0709 12:22:34.447184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.675174 (+1227990us) service_pool.cc:224] Handling call
0709 12:22:35.675462 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.676214 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.676388 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:35.673290  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.680644  8757 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:35.653491  8070 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:35.685623  8065 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:35.676174  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.686869  8763 raft_consensus.cc:2410] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:35.689496  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:35.644094 11559 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:35.690183  8756 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:35.693599  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1593) took 1223 ms. Trace:
I20260709 12:22:35.697364  8214 rpcz_store.cc:276] 0709 12:22:34.469884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.692725 (+1222841us) service_pool.cc:224] Handling call
0709 12:22:35.693072 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.693270 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.693304 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.693348 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:35.693386 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.693446 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.693545 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:35.651996 11600 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:35.661000 11631 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.699265  8214 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.692236  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1591) took 1222 ms. Trace:
W20260709 12:22:35.703243  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52414.9us
I20260709 12:22:35.703522  8220 rpcz_store.cc:276] 0709 12:22:34.461959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.681776 (+1219817us) service_pool.cc:224] Handling call
0709 12:22:35.683222 (+  1446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.683469 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.683511 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.683571 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:35.683607 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.683680 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.683822 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:35.704319  8762 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:35.644268 11555 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:35.692824 11637 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:22:35.648216 11557 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.690588 11548 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.708127  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1594) took 1209 ms. Trace:
I20260709 12:22:35.712452  8214 rpcz_store.cc:276] 0709 12:22:34.493579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.698280 (+1204701us) service_pool.cc:224] Handling call
0709 12:22:35.699105 (+   825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.703133 (+  4028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.703315 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:35.715220  8110 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.678s (SENT)
I20260709 12:22:35.717162  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:35.720021  8110 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.700s (SENT)
I20260709 12:22:35.706310 11432 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.721544  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49226 (request call id 87) took 1165 ms. Trace:
I20260709 12:22:35.721927  8220 rpcz_store.cc:276] 0709 12:22:34.551633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.704515 (+1152882us) service_pool.cc:224] Handling call
0709 12:22:35.716678 (+ 12163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:35.720474  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:34.658793  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:35.732972 11633 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 12:22:35.735766 11600 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.737325 11600 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.715597 11539 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.719556 11587 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.710112 11555 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.723433 11609 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.760322 11386 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.761569  8762 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:35.761919 11327 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:35.762441 11327 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.769771  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1587) took 1323 ms. Trace:
I20260709 12:22:35.770231  8215 rpcz_store.cc:276] 0709 12:22:34.446569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.265137 (+818568us) service_pool.cc:224] Handling call
0709 12:22:35.265475 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.265702 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:35.338285 (+ 72583us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.463372 (+125087us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.769274 (+305902us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18001376e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:22:35.769429 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.769480 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:35.769524 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.769590 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.769707 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118719,"prepare.queue_time_us":72299,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1587,"raft.queue_time_us":5827,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":30521600,"thread_start_us":121298,"threads_started":1,"wal-append.queue_time_us":186300}
I20260709 12:22:35.777622  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1585) took 1331 ms. Trace:
I20260709 12:22:35.778411 11555 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.753685 11548 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:35.779626 11548 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:35.780563 11548 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:35.780923 11548 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:35.781724 11548 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.784767  8140 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:35.789896  8140 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:35.791465  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:35.794281  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:35.778025  8211 rpcz_store.cc:276] 0709 12:22:34.446067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.200339 (+754272us) service_pool.cc:224] Handling call
0709 12:22:35.210505 (+ 10166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.218787 (+  8282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.218830 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.219429 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.579937 (+360508us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:35.629256 (+ 49319us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.777289 (+148033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.777362 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.777398 (+    36us) raft_consensus.cc:1685] finished
0709 12:22:35.777410 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.777547 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155616,"prepare.queue_time_us":49038,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":7126,"raft.queue_time_us":160010,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"spinlock_wait_cycles":24378112,"thread_start_us":241797,"threads_started":1,"wal-append.queue_time_us":310289}
I20260709 12:22:35.803164  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:35.803800  8214 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.807135  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:35.807799  8215 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:35.807825  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:35.808682  8220 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:35.809242  8035 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.169s (SENT)
I20260709 12:22:35.819640  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:35.820292  8215 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.804098 11548 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.798295 11539 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:22:35.855877  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:35.856801  8211 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.852154  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:35.858942  8144 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 5.
I20260709 12:22:35.858958  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:35.859843  8141 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:35.816581 11609 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.872421  8215 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:35.874629  8214 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:35.885402  8211 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
W20260709 12:22:35.873080 11646 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:22:35.894820  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103427us
W20260709 12:22:35.899094  8035 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.242s (SENT)
I20260709 12:22:35.900789  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:35.878620 11399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.500s	user 0.006s	sys 0.018s
I20260709 12:22:35.830099 11617 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.906661  8066 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:35.947925 11503 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:35.930050 11399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.006s	sys 0.019s
I20260709 12:22:35.947809 11348 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.898814 11417 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:35.925765 11432 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.957995  8220 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:35.961426  8140 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:35.968303 11432 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.975445 11432 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:35.979976 11401 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:35.980458 11401 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:35.981335 11401 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:35.982404 11401 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:35.985908 11648 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:22:35.986166  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.988003 11231 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:35.988091 11617 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.988456 11231 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:35.989007 11231 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.960532 11417 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:35.988534  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:35.990904 11417 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:35.991427 11417 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:35.961180 11557 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:35.960850 11539 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:35.992563 11539 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:35.992993 11539 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.995139 11348 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:35.999940  8145 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:36.003334  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 102688us
W20260709 12:22:35.997119  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.004303  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.006346  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:36.055024  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.055680  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.159050  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 149220us
I20260709 12:22:36.159898  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:36.160145  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 153878us
I20260709 12:22:36.162308  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.164280  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.164928  8220 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:36.165848  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.166440  8064 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.166661  8220 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:36.168525  8220 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:22:36.168860  8220 pending_rounds.cc:85] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 3
I20260709 12:22:36.169087  8220 pending_rounds.cc:107] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:36.169323  8220 raft_consensus.cc:2889] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.164171  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:36.170512  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 161736us
I20260709 12:22:36.171576  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1588) took 1724 ms. Trace:
I20260709 12:22:36.173717  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:36.159221 11417 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:36.175494 11417 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.034005 11555 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:36.177377  8761 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:22:36.177205  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:36.177697 11555 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:36.177933 11580 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.178531  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:36.178426 11580 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.178663 11555 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.179128  8761 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.180534 11580 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:36.163756 11557 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:36.186791  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.184863  8220 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:35.998205 11442 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.196740  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:36.193096  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.190313  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:36.186101  8066 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:36.194609  8145 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:36.195497  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.008510 11443 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.220999  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.221839  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.227324  8761 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:36.228259  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.229326  8214 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:36.192965 11600 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:36.242167  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:36.260213  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:36.261509  8061 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:36.263101  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.260519  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.186420 11557 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.184616 11231 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.275033  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:36.279269  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 328267us
I20260709 12:22:36.283015  8214 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:36.243750 11422 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:36.239588 11600 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:36.281903  8761 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:36.291545  8061 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:36.290584  8035 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.560s (SENT)
I20260709 12:22:36.220263 11442 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.227085 11443 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.296856  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:36.298502  8760 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:36.298942  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.292155 11422 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.299911  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.300689  8214 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.283370 11655 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:36.294602 11600 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:36.299867 11422 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:36.314148  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.315536  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1589) took 1868 ms. Trace:
I20260709 12:22:36.316475 11557 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:36.316071  8218 rpcz_store.cc:276] 0709 12:22:34.446971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.624887 (+1177916us) service_pool.cc:224] Handling call
0709 12:22:35.625333 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:35.776528 (+151195us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:35.776851 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.897526 (+120675us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.897786 (+   260us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:35.932183 (+ 34397us) log.cc:844] Serialized 52 byte log entry
0709 12:22:35.932325 (+   142us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:35.932357 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.932429 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.315196 (+382767us) raft_consensus.cc:1685] finished
0709 12:22:36.315234 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.315455 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166282,"prepare.queue_time_us":2990,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":23990,"raft.queue_time_us":155052,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":35336,"thread_start_us":101638,"threads_started":1,"wal-append.queue_time_us":384300}
I20260709 12:22:36.318352 11561 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:36.318889 11561 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.319672  8138 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:36.320262  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1628) took 1538 ms. Trace:
I20260709 12:22:36.320557  8138 rpcz_store.cc:276] 0709 12:22:34.781505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.981074 (+199569us) service_pool.cc:224] Handling call
0709 12:22:36.319295 (+1338221us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:22:36.319500 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.320052 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.320211 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41087232}
I20260709 12:22:36.302819 10774 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:36.305224 11601 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:36.306667 11555 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:36.311224 11655 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:36.348345  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:36.302345  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:36.361259  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:36.361732  8761 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.350353 11555 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:36.365619  8061 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:36.360960  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:36.372056  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:36.347330 10774 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.360029 11561 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.391345  8763 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:36.354144 11601 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:36.381609 11153 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:36.381953 11401 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:36.407220 11466 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:22:36.419467 11453 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.419922  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.420334 11655 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.425030  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.403522 11601 consensus_queue.cc:1243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:36.426985 10774 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.427816 11442 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.428429 11443 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.429024 11564 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:36.426980  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.430478  8761 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:36.443127  8215 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.426210  8214 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:22:36.382407 11356 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:22:36.449055  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.429679 11348 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:22:36.432065 11401 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.455740  8061 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:36.473021  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.475409  8215 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.431803 11662 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:22:36.479914  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.481484  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.462271 11422 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.452207 11564 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:36.450506 11555 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.462229 11401 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.445086 11453 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.502704  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.451457 11539 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.511493  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.512231  8214 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:36.534502 11630 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.140s	user 0.000s	sys 0.004s
I20260709 12:22:36.536954  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:36.538312  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.539860 11453 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.542326  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.545223  8140 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:36.545955  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.546530  8142 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:36.550128  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1582) took 2105 ms. Trace:
I20260709 12:22:36.550529  8214 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:36.543362  8143 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:22:36.554033 11579 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 2.168s	user 0.004s	sys 0.002s
I20260709 12:22:36.549647 11564 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.555226  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.555522 11564 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.556099  8141 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:36.556643  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1583) took 2111 ms. Trace:
I20260709 12:22:36.556975  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.557765  8145 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:36.557117  8212 rpcz_store.cc:276] 0709 12:22:34.445533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.993275 (+547742us) service_pool.cc:224] Handling call
0709 12:22:34.993633 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.994002 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:35.067447 (+ 73445us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.209796 (+142349us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.210215 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.219843 (+  9628us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.259597 (+ 39754us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.259763 (+   166us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:35.260006 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.260189 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.260264 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.533763 (+1273499us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:36.556447 (+ 22684us) raft_consensus.cc:1685] finished
0709 12:22:36.556468 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.556573 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9121,"prepare.queue_time_us":192290,"prepare.run_cpu_time_us":160,"prepare.run_wall_time_us":1882,"raft.queue_time_us":15005,"raft.run_cpu_time_us":733,"raft.run_wall_time_us":101544,"spinlock_wait_cycles":15929216,"thread_start_us":150664,"threads_started":2,"wal-append.queue_time_us":284378}
I20260709 12:22:36.558923  8138 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:36.559473  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:36.560037 11632 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.166s	user 0.003s	sys 0.000s
I20260709 12:22:36.561278  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.561331 11591 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.562549 11591 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:36.554091 11673 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:36.566799  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.567381  8211 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.568153  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.569335  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.570283  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.571255  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.572218  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.562582  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.574214  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.574550  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.579828  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.579944  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.550551  8219 rpcz_store.cc:276] 0709 12:22:34.445246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.927480 (+482234us) service_pool.cc:224] Handling call
0709 12:22:34.947694 (+ 20214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.128951 (+181257us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:35.129194 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.190229 (+ 61035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.190302 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:35.190370 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.549888 (+1359518us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000e6854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:36.549941 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.550072 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1206,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":574,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9448,"spinlock_wait_cycles":463875584,"thread_start_us":60691,"threads_started":1,"wal-append.queue_time_us":208720}
I20260709 12:22:36.583083  8215 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
W20260709 12:22:36.584384  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 185723us
I20260709 12:22:36.585366  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:36.600487  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.601143  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:36.602367  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.602980  8215 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:36.603276  8214 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:36.579540 11662 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.616945  8211 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:36.617458  8215 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
W20260709 12:22:36.601495 11675 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:22:36.618884  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:36.604368 11676 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:22:36.621806  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.634881  8212 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.622622  8214 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.612231 11684 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:36.626256 11422 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:36.627471 11683 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:36.629194 11674 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:22:36.629925 11679 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:36.620510  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:36.597564 11681 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:36.620569 11662 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.639346 11681 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:36.639775 11641 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.920s	user 0.000s	sys 0.002s
I20260709 12:22:36.639847 11681 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:36.641213  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1632) took 1533 ms. Trace:
I20260709 12:22:36.641748 11662 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:36.643153  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.637214  8211 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:36.641546  8139 rpcz_store.cc:276] 0709 12:22:35.108055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.404702 (+296647us) service_pool.cc:224] Handling call
0709 12:22:35.433315 (+ 28613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.454130 (+ 20815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.454170 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.518935 (+ 64765us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.641597 (+122662us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:35.641650 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.641725 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.639249 (+997524us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:36.640888 (+  1639us) raft_consensus.cc:1685] finished
0709 12:22:36.640909 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.641152 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1871,"raft.queue_time_us":15496,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1916,"spinlock_wait_cycles":38300032,"thread_start_us":122243,"threads_started":1,"wal-append.queue_time_us":175582}
I20260709 12:22:36.597129 11584 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:36.649653 11584 consensus_queue.cc:1243] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:36.650329 11584 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:36.650749 11584 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:36.612047 11577 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:36.654350 11577 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:36.654816 11577 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:36.655829 11577 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.658391  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.658804 11545 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:36.661499  8218 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:36.171926  8217 rpcz_store.cc:276] 0709 12:22:34.446771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.449944 (+1003173us) service_pool.cc:224] Handling call
0709 12:22:35.450435 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:35.774786 (+324351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.774814 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:35.775390 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:22:35.873669 (+ 98279us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:36.010464 (+136795us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.171090 (+160626us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.171290 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.171357 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.171392 (+    35us) raft_consensus.cc:1685] finished
0709 12:22:36.171402 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.171527 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396013,"prepare.queue_time_us":83423,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2216,"raft.queue_time_us":251556,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":66,"spinlock_wait_cycles":26484096,"thread_start_us":177029,"threads_started":2,"wal-append.queue_time_us":206661}
W20260709 12:22:36.665203  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1575) took 2226 ms (client timeout 2560 ms). Trace:
W20260709 12:22:36.665686  8213 rpcz_store.cc:269] 0709 12:22:34.438964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.439285 (+   321us) service_pool.cc:224] Handling call
0709 12:22:36.664962 (+2225677us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b540016a8d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:36.665108 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175210368}
I20260709 12:22:36.666949  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.668556  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.673624 11323 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:36.677179  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.679075 11327 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:36.679139  8214 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:36.680510 11162 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.681452  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.681825 11162 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:36.682016  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.682916  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.683388  8214 raft_consensus.cc:2376] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9. Re-sending same reply.
I20260709 12:22:36.684111  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.685093  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.685377  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 598) took 1500 ms. Trace:
I20260709 12:22:36.685803  8758 rpcz_store.cc:276] 0709 12:22:35.185265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.185472 (+   207us) service_pool.cc:224] Handling call
0709 12:22:35.191408 (+  5936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.520783 (+329375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.685154 (+1164371us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54004c22d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:36.685319 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464529152}
I20260709 12:22:36.651818 11584 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.686998  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.705057  8215 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.691355  8070 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:36.686071  8212 raft_consensus.cc:2368] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
I20260709 12:22:36.696991  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.702937  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.703979  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:36.708855  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.702584  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.711418  8211 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.712234  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.702845  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:36.709860  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.713771  8215 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:36.715664  8217 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:36.717046  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.717923  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:36.717315  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96882.2us
I20260709 12:22:36.719303  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.720695  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.721210  8211 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:36.689893 11584 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:36.704412 11627 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.718488  8759 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:36.723848  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.721707  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:36.725952  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.729096  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.729741  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.687808 11231 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:36.732529  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.725888 11545 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:22:36.732879  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.733690  8066 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:36.734848  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:36.735948  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.737671  8143 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:36.718928 11323 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:36.741089 11323 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:36.723004 11333 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:36.746877  8216 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:36.747231  8216 pending_rounds.cc:85] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 2
I20260709 12:22:36.703043 11422 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:22:36.744009  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.744439  8211 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:36.745193  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:36.701414 11401 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.733618 11545 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:36.747488  8216 pending_rounds.cc:107] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:36.765717  8216 raft_consensus.cc:2889] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.765894  8142 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:36.688755 11600 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.742326  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:36.745837  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.731132 11555 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:36.751376 11634 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.353s	user 0.000s	sys 0.003s
W20260709 12:22:36.753455 11645 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.021s	user 0.002s	sys 0.000s
I20260709 12:22:36.757925 11323 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:36.785758  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.786604  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.790937  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.730350 11627 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.765591 11545 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:36.746794 11333 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.850214 11333 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.775508  8213 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.749629  8214 raft_consensus.cc:2376] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9. Re-sending same reply.
I20260709 12:22:36.772782  8215 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:36.742020 11662 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:36.758409  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.762702  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:36.803244 11348 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.847767 11600 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.849222 11545 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:36.917693  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:36.926833  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.895372  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:36.937855  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.851996  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50973.5us
I20260709 12:22:36.937882  8220 raft_consensus.cc:2376] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:22:36.894436  8065 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:36.937661  8212 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:36.914937  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.945923  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.947355  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.948143  8211 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.948946  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.950369  8211 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:36.945582  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:36.926396 11401 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:36.953963 11683 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:36.945989 11684 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:22:36.955236 11601 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:36.956729 11162 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:36.994678  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:36.956972  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:36.957067  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:36.953269  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:36.832345 11589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.005s	sys 0.015s
I20260709 12:22:36.960244  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.997323  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:36.997740  8213 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:36.937882  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:36.850943 11627 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:36.946089 11348 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:36.937031 11662 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.963914  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:37.022225  8143 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:22:36.964257  8216 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:37.022608  8143 pending_rounds.cc:85] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 7
I20260709 12:22:37.022874  8143 pending_rounds.cc:107] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:22:37.023200  8143 raft_consensus.cc:2889] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.023634  8216 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:36.971601  8756 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:36.973904  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:36.975322  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:37.024899  8211 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:36.962950 11545 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:37.049392  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 92522.8us
I20260709 12:22:37.051311  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:37.020504 11609 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:36.964732 11386 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:37.029778  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:37.030370  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:37.062064  8212 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:37.011404 11589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.011s	sys 0.017s
W20260709 12:22:37.053895  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.025818 11662 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:37.035750 11401 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.055133  8214 pending_rounds.cc:85] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:22:37.078907  8214 pending_rounds.cc:107] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:22:37.079478  8214 raft_consensus.cc:2889] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.064688  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:37.009543  8215 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:37.072392 11683 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:37.043813 11564 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.072908 11348 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:37.060837 11386 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.040350 11591 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.066670 11539 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:37.048974 11422 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:22:37.087486 11683 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.095947 11386 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:37.128399  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 164546us
W20260709 12:22:37.136474  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.609s (SENT)
I20260709 12:22:37.084442  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:37.093497 11562 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.137626  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:37.138705  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 54372.3us
W20260709 12:22:37.138918  8110 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.552s (SENT)
I20260709 12:22:37.139356  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:37.139642  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:37.141721  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 622) took 1379 ms. Trace:
I20260709 12:22:37.142369  8146 rpcz_store.cc:276] 0709 12:22:35.762330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.762438 (+   108us) service_pool.cc:224] Handling call
0709 12:22:35.762694 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.779993 (+ 17299us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:35.780258 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.783217 (+  2959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:35.783269 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:35.783311 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.141374 (+1358063us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:37.141445 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.141638 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2715,"prepare.queue_time_us":1567,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2828,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"spinlock_wait_cycles":39281920}
W20260709 12:22:37.087035  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 89793.3us
I20260709 12:22:37.146064  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:37.150064  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 168415us
I20260709 12:22:37.149116  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:37.122694 11683 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:37.157213  8145 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:37.123311 11564 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.107685 11591 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.148762 11605 raft_consensus.cc:2764] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:22:37.141112 11680 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.181443  8184 leader_election.cc:400] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:37.181042  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.181988  8184 leader_election.cc:403] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:37.180529 11689 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:22:37.181030 11612 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:22:37.234169 11591 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:37.174990 11655 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.236907 11655 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.186093 11684 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:22:37.246065 11670 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:37.174212 11564 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:37.253501 11681 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.003s
I20260709 12:22:37.254127 11681 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.255751  8219 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:37.258625 11327 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:37.260838 11348 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:37.261373 11348 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:37.262512 11348 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.264169 11348 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.268766 11333 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.271286 11333 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:37.272831  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 126855us
I20260709 12:22:37.275231  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:37.281582  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:37.282456  8220 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:37.283171 11612 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.283458  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:37.284016  8220 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.285406  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:37.284170 11612 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:37.252256 11564 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:37.287987  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 278960us
I20260709 12:22:37.292250  8212 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:37.294677  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 113394us
I20260709 12:22:37.295512  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.297669  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.298972  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.293810  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:37.312067  8065 raft_consensus.cc:1217] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:22:37.313024  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:37.313679  8066 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:37.314672  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:37.315377  8066 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:37.317427  8062 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:37.319433  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:37.321125  8065 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:22:37.321357  8220 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:22:37.322125  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.322647  8063 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:37.316367  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:37.330252  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:37.330612  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:37.330183  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:37.350934  8063 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:37.361177  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:37.314714 11584 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
I20260709 12:22:37.365748  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:37.369890  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.290105 11694 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:37.290627 11655 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.314149 11605 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:37.305289 11564 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:37.375394  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44903.6us
I20260709 12:22:37.303853 11680 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:37.304407 11591 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:37.327333 11562 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:37.356155 11162 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:37.395054  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 209478us
I20260709 12:22:37.329659 11327 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:37.389708 11333 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:37.382330 11681 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:37.393273 11584 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.392169 11694 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:37.424702  8218 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:22:37.390962  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 260086us
I20260709 12:22:37.400179 11162 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.420883 11683 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.392541 11655 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.394146 11564 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.562479  8064 raft_consensus.cc:1217] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:22:37.563138  8064 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:37.565253  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:37.569885  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.570451  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.439410 11323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.009s
I20260709 12:22:37.434937 11705 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.441581 11162 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.439742 11605 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:37.442211 11333 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:37.518100 11612 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:37.603211 11323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.013s	sys 0.010s
I20260709 12:22:37.560386 11562 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:37.427798 11584 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.621405  8184 leader_election.cc:400] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:37.629071  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.630470  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.588758 11591 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:37.696718  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 131603us
W20260709 12:22:37.698884  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 263754us
I20260709 12:22:37.626863 11680 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:37.607731 11605 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.710778  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.623739 11700 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.630564 11681 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:37.689440 11555 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:37.738945 11686 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.036s	user 0.018s	sys 0.000s
W20260709 12:22:37.739761 11691 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:22:37.692135 11699 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.743615 11711 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:37.750339  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 526) took 1013 ms. Trace:
I20260709 12:22:37.705837 11323 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.751060  8216 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:37.612119 11705 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.758395  8070 rpcz_store.cc:276] 0709 12:22:36.736954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.737081 (+   127us) service_pool.cc:224] Handling call
0709 12:22:36.737468 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.740991 (+  3523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.741021 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.741553 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.118735 (+377182us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:37.118778 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.118866 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.744261 (+625395us) raft_consensus.cc:1685] finished
0709 12:22:37.744289 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.750135 (+  5846us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7840,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":96,"thread_start_us":181710,"threads_started":1,"wal-append.queue_time_us":573940}
I20260709 12:22:37.766913  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2740) took 1271 ms. Trace:
I20260709 12:22:37.627815 11612 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:37.780936  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 150355us
I20260709 12:22:37.768983  8061 rpcz_store.cc:276] 0709 12:22:36.495660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.539154 (+ 43494us) service_pool.cc:224] Handling call
0709 12:22:36.539500 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:36.545906 (+  6406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.545938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:36.554121 (+  8183us) log.cc:844] Serialized 52 byte log entry
0709 12:22:36.611242 (+ 57121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:36.618593 (+  7351us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.621147 (+  2554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.621248 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.444662 (+823414us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:37.744356 (+299694us) raft_consensus.cc:1685] finished
0709 12:22:37.766689 (+ 22333us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.766853 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5969,"prepare.queue_time_us":7092,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":13140,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":215,"spinlock_wait_cycles":2868480,"thread_start_us":56724,"threads_started":1,"wal-append.queue_time_us":148111}
I20260709 12:22:37.786510  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.635867 11562 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.704100 11591 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:37.799412 11662 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.002s
I20260709 12:22:37.735563 11713 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:22:37.772897 11323 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.822233  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2776) took 1156 ms. Trace:
I20260709 12:22:37.822680  8218 rpcz_store.cc:276] 0709 12:22:36.665554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.696718 (+ 31164us) service_pool.cc:224] Handling call
0709 12:22:37.822039 (+1125321us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:37.822163 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555128704}
I20260709 12:22:37.823812 11323 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:37.827023 11708 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:37.827929  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 626) took 1098 ms. Trace:
I20260709 12:22:37.828368  8139 rpcz_store.cc:276] 0709 12:22:36.729292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.729438 (+   146us) service_pool.cc:224] Handling call
0709 12:22:37.827705 (+1098267us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54002bf7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:37.827854 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211442432}
I20260709 12:22:37.829864 11443 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:37.830574 11443 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:37.831432 11443 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:37.831629 11386 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.000s
I20260709 12:22:37.834312 11612 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:37.703723 11694 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.834257 11729 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:37.832077 11443 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.832029 11386 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.848273  8213 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:22:37.758062 11681 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.735594 11680 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:37.861204  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 155977us
I20260709 12:22:37.757670 11555 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.797957 11720 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.816047 11662 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:37.845875 11729 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:37.848479 11713 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.754204 11333 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.910833  8141 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:37.762458 11699 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.753170 11700 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.869289 11327 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:37.850107 11368 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:22:37.934953 11718 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:22:37.880071 11683 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:37.877174 11720 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:37.937915 11577 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:37.874804 11707 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:22:37.938047 11720 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:37.939705  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60627.3us
I20260709 12:22:37.856231  8213 pending_rounds.cc:85] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:22:37.953714  8213 pending_rounds.cc:107] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:22:37.954274  8213 raft_consensus.cc:2889] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:37.907377 11729 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:37.934011 11348 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
I20260709 12:22:37.931815 11584 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:37.961282  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.013s	sys 0.024s
W20260709 12:22:37.968197  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.014s	sys 0.024s
W20260709 12:22:37.968289  8034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.001s	sys 0.009s
W20260709 12:22:37.968835  8034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.002s	sys 0.009s
I20260709 12:22:37.940075 11368 consensus_queue.cc:1243] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:37.939039 11655 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:37.968837  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 829884us
W20260709 12:22:37.970022  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 694840us
I20260709 12:22:37.963608  8218 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:37.987242  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1616) took 1043 ms. Trace:
W20260709 12:22:37.980413  8110 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.508s (SENT)
I20260709 12:22:37.988183  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:37.990242  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.629s (SENT) [suppressed 38 similar messages]
I20260709 12:22:37.994024  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:37.987742  8214 rpcz_store.cc:276] 0709 12:22:36.943513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.038004 (+ 94491us) service_pool.cc:224] Handling call
0709 12:22:37.054764 (+ 16760us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:37.107220 (+ 52456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.107269 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:37.107916 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 12:22:37.415984 (+308068us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:37.668700 (+252716us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.968021 (+299321us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.986810 (+ 18789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.986889 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.986927 (+    38us) raft_consensus.cc:1685] finished
0709 12:22:37.986938 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.987187 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17770,"prepare.queue_time_us":298053,"prepare.run_cpu_time_us":171,"prepare.run_wall_time_us":6133,"raft.queue_time_us":186348,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":13580,"spinlock_wait_cycles":1533184,"thread_start_us":692216,"threads_started":3,"wal-append.queue_time_us":716835}
I20260709 12:22:37.994897  8064 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:37.962630  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1619) took 1009 ms. Trace:
W20260709 12:22:37.985739  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 199346us
I20260709 12:22:37.991403 11619 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:37.997421  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.996413  8220 rpcz_store.cc:276] 0709 12:22:36.958030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.335390 (+377360us) service_pool.cc:224] Handling call
0709 12:22:37.335770 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.336060 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:37.435755 (+ 99695us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.962041 (+526286us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.962278 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:37.962324 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:37.962368 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.962443 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.962568 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16322,"prepare.queue_time_us":285975,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":75677,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":2996,"thread_start_us":622869,"threads_started":3,"wal-append.queue_time_us":400380}
I20260709 12:22:37.998222 11730 raft_consensus.cc:2764] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:38.002969 11443 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:37.998657  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:38.005740 11443 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:38.009503 11443 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:37.992686 11401 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:22:38.011744  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:37.974212 11683 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:37.978833 11609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.008s
I20260709 12:22:38.015844  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:38.021735  8064 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:37.978899 11605 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.033385  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:38.034127  8220 raft_consensus.cc:2376] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8. Re-sending same reply.
I20260709 12:22:38.035521  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:37.992763 11655 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.035983  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:37.974556 11503 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:22:38.042347  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 282351us
I20260709 12:22:38.053027  8216 raft_consensus.cc:2368] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
W20260709 12:22:38.036589 11545 consensus_meta.cc:287] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.995s	user 0.011s	sys 0.003s
W20260709 12:22:38.036826 11609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.001s	sys 0.008s
I20260709 12:22:38.055970  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:38.012765 11564 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.057789  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:38.030928 11720 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.063583  8061 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:38.034344 11711 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:38.062655  8070 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:38.070384 11564 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:38.071952 11690 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.975s	user 0.001s	sys 0.001s
I20260709 12:22:38.067411 11162 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.076094 11162 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:38.077811  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.060941 11727 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260709 12:22:38.078927 11555 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.085618  8067 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:22:37.989095 11327 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.011871 11734 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:22:38.035692 11683 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.064064 11386 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.054917 11728 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:22:38.106334  8212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.005s	sys 0.035s
W20260709 12:22:38.107026  8212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.035s
I20260709 12:22:38.112051  8138 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:38.116271  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1614) took 1173 ms. Trace:
I20260709 12:22:38.118353  8211 rpcz_store.cc:276] 0709 12:22:36.943042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.026961 (+ 83919us) service_pool.cc:224] Handling call
0709 12:22:37.027259 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.034154 (+  6895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.034202 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.034687 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.743262 (+708575us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180033d060. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:38.039968 (+296706us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:38.041616 (+  1648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.041673 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.115858 (+ 74185us) raft_consensus.cc:1685] finished
0709 12:22:38.115886 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.116188 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6476,"raft.queue_time_us":12350,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":23685,"spinlock_wait_cycles":2891008,"thread_start_us":296490,"threads_started":1,"wal-append.queue_time_us":1058111}
I20260709 12:22:38.101619 11662 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.100252 11681 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.092875 11722 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:38.134871  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1618) took 1186 ms. Trace:
I20260709 12:22:38.136416  8764 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:38.136299  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 146074us
I20260709 12:22:38.135514  8212 rpcz_store.cc:276] 0709 12:22:36.948934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.294381 (+345447us) service_pool.cc:224] Handling call
0709 12:22:37.356698 (+ 62317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.356920 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:38.107576 (+750656us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.134425 (+ 26849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.134496 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:38.134566 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.134654 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.134800 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4344,"prepare.queue_time_us":340233,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":757574,"threads_started":2}
I20260709 12:22:38.138950  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:38.137392  8110 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.564s (SENT)
I20260709 12:22:38.140758  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:38.137739 11739 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:38.143177  8756 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:38.143602  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.144320 11609 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.132932 11680 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.144845 11609 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.145279  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.146450  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.147680 11609 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.148795 11662 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.141103 11699 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.128258 11711 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.144892  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:38.154234  8760 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.156415 11683 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.159502  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.165061  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.168828 11700 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.179922  8760 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:38.165170 11751 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.185901 11744 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:38.190802 11744 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.193799 11356 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:38.194234 11356 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:38.194972 11356 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.205298 11744 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:38.196861 11356 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.187397 11327 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.207784 11327 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.210058 11327 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.216099  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:38.216418  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:38.216843  8216 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:38.217056  8212 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:38.198359 11751 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.219169  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:38.219547 11751 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:38.216948  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:38.220036 11700 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:38.220085  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.223171  8211 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:38.222946  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.226190 11555 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:38.228150  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:38.228420 11555 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:38.228816  8765 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.230082  8212 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:38.244300  8765 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:38.254781  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:38.233853 11702 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.673s	user 0.000s	sys 0.012s
I20260709 12:22:38.255671  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:38.264947  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:38.228935 11146 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:38.266000  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:38.263073 11662 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:38.268266 11153 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:38.271796 11401 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:38.285158 11757 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:22:38.286687 11704 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.709s	user 0.000s	sys 0.010s
I20260709 12:22:38.298879  8217 raft_consensus.cc:2410] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:22:38.313686 11680 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.315444 11680 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.323138 11146 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:38.323575 11146 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:38.324380 11146 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.325724 11146 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:38.325870 11731 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
W20260709 12:22:38.324875 11762 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:22:38.326350  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60458us
W20260709 12:22:38.331806  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.279345 11662 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:38.280908 11153 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:38.296283 11401 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.331341  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 839) took 1373 ms. Trace:
I20260709 12:22:38.334648 11401 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:38.334649  8759 rpcz_store.cc:276] 0709 12:22:36.958335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.958495 (+   160us) service_pool.cc:224] Handling call
0709 12:22:36.961540 (+  3045us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:36.962053 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.962086 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:37.020243 (+ 58157us) log.cc:844] Serialized 52 byte log entry
0709 12:22:37.315229 (+294986us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:37.315264 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.315325 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.221642 (+906317us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:38.328941 (+107299us) raft_consensus.cc:1685] finished
0709 12:22:38.328965 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.331270 (+  2305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":669,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1949,"spinlock_wait_cycles":54436224,"thread_start_us":259038,"threads_started":1,"wal-append.queue_time_us":375584}
I20260709 12:22:38.328446 11348 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:38.351461 11735 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.352128  8145 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:38.353411  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.354616  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.355243  8142 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.349838  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.361691  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.351495  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.369460  8137 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:38.368193  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:38.362157  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.371675  8139 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:38.373364  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.342425 11153 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.367597  8140 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:38.375830  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.348196  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.378199  8143 raft_consensus.cc:2410] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:38.376477  8140 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:38.380290  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.380997  8140 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
W20260709 12:22:38.385185 11761 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:38.350286 11539 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:38.386689 11539 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.387120  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.387826  8145 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:38.292922 11555 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.392371  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:38.358240 11693 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.181s	user 0.002s	sys 0.002s
I20260709 12:22:38.395735  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:38.419035  8063 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:22:38.422427 11760 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:22:38.409606  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:38.356294 11562 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.399403  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:38.438686  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56799.3us
I20260709 12:22:38.438927  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.439733  8139 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.401206  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:38.445210  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44141.8us
I20260709 12:22:38.403301  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:38.404189  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:38.405171 11754 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:22:38.405313 11577 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:38.405211  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:38.406059  8061 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:38.406682  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.454677  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1646) took 1667 ms. Trace:
W20260709 12:22:38.409804 11765 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:22:38.410279 11323 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:38.410945 11545 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:38.352085 11735 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.413388 11729 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.363416 11662 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:38.409698 11767 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:22:38.368832 11348 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:38.418308 11619 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:38.396870  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.426618  8145 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:38.395001  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:38.397706  8142 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:38.471868  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:38.446183  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.457326 11153 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.457975 11401 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.461308 11743 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:38.461792 11764 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:38.461982 11539 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:38.461889 11600 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:38.470454  8067 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:38.645567  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:38.512706  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.573094  8213 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:38.478960  8215 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:38.632262  8064 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:22:38.569021  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2782) took 1898 ms (client timeout 1609 ms). Trace:
W20260709 12:22:38.487478  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.648823  8219 rpcz_store.cc:269] 0709 12:22:36.670238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.676821 (+  6583us) service_pool.cc:224] Handling call
0709 12:22:38.568665 (+1891844us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400373554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:38.568907 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328016128}
I20260709 12:22:38.438686 11584 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.650225 11584 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.600328 11748 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:38.633208  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 238563us
W20260709 12:22:38.479810  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.599826  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 195680us
I20260709 12:22:38.659884  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:38.500458  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60639.7us
I20260709 12:22:38.635422 11619 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:38.635129  8140 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:38.451534  8137 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:38.678329  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1563) took 1736 ms (client timeout 2137 ms). Trace:
W20260709 12:22:38.678884  8137 rpcz_store.cc:269] 0709 12:22:36.941565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.345103 (+1403538us) service_pool.cc:224] Handling call
0709 12:22:38.678243 (+333140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:38.636207  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:38.681069  8218 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:38.640200  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 194132us
I20260709 12:22:38.641306  8139 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:38.683898  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.685117 11422 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:38.646343  8142 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:38.685904 11422 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.686390  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.455217  8144 rpcz_store.cc:276] 0709 12:22:36.787499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.406415 (+1618916us) service_pool.cc:224] Handling call
0709 12:22:38.454583 (+ 48168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:38.642205  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.633977  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.685178  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:38.691414  8064 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:38.680212  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:38.691769  8139 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.694527  8137 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:38.683508  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.697373  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.646384 11562 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:38.703486  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:38.688426 11422 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.737358  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:38.656435 11555 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.771216  8146 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:38.652251 11539 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:38.771210  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.776183  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.704728 11162 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.732061 11733 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:38.781637  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 119275us
I20260709 12:22:38.783255  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:38.795871  8218 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:38.797991  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:38.737859 11768 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:22:38.790752  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.670423 11670 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:22:38.734910 11562 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:38.806247  8139 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:38.738246 11744 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:38.775141 11356 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.653714 11743 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.774755 11770 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:38.774106 11327 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:38.822326  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:38.736896 11748 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:38.812846 11562 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.833781  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:38.788297 11733 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:38.837808 11702 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:22:38.776492 11555 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.787834 11683 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:22:38.829831 11723 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:38.836783 11684 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:38.828859 11770 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.819965 11584 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:38.836889 10999 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:38.785812 11539 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.776969 11348 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:38.846283 11733 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.842954 11612 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:38.845072 11323 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:38.862952  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 159595us
I20260709 12:22:38.815488 11744 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:38.935750  8142 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:22:38.891928  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:38.841487 11327 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.857299 11779 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:38.864835 11584 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:38.958181  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 146778us
I20260709 12:22:38.933416 11744 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:38.896912 11735 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:38.979645  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 145971us
W20260709 12:22:38.960557 11702 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:22:38.952853 11779 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.897094 11612 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:38.992412  8062 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:38.954880 11729 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:38.957842 11584 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:38.896579 11783 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:22:38.898963 11723 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:38.933912 11323 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.013653 11705 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:39.021505 11730 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:39.022567  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.048050  8061 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:22:39.025566 11782 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:22:39.030297 11777 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:22:39.032189 11555 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.007419 11584 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.995637 11779 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:39.053076  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:39.059218  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 167393us
I20260709 12:22:38.945781 11748 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.032474 11655 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:39.040457 11729 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:39.060647 11771 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:22:39.115213  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:39.122094  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 324214us
W20260709 12:22:39.126945 11788 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:22:39.129673 11539 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:39.130870  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2792) took 2432 ms (client timeout 1958 ms). Trace:
W20260709 12:22:39.131300  8217 rpcz_store.cc:269] 0709 12:22:36.698141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.716463 (+ 18322us) service_pool.cc:224] Handling call
0709 12:22:39.130620 (+2414157us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540017ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:39.130770 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3635959680}
I20260709 12:22:39.133112 11786 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:39.133670 11786 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:39.134092 11786 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:39.135210 11775 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:22:39.139362 11612 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.140792 11770 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:39.143333 11773 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:22:39.160144  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.046448 11601 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.158710  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:39.157107  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.801s (SENT)
I20260709 12:22:39.117933 11655 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:39.178819  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.178781  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:39.177373  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 352657us
I20260709 12:22:39.181845  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31800511c940e48a418a30b32976fd"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:39.185259  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:39.185529  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:39.187273  8140 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.186254  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:39.189749  8137 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:39.191593  8212 raft_consensus.cc:606] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.192231  8212 raft_consensus.cc:614] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:39.201143  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44096.8us
I20260709 12:22:39.201743  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:39.201896  8110 leader_election.cc:336] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.852s (SENT)
W20260709 12:22:39.205407  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.205505  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:39.205904  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:39.206873  8765 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:39.207336  8142 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:39.060027 11730 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:39.213477  8110 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.998s (SENT)
W20260709 12:22:39.171306 11774 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:22:39.168277 11729 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.212742  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:39.114277 11789 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
W20260709 12:22:39.218356  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.221457  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:39.249933  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 256438us
I20260709 12:22:39.219645 11539 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:39.253525  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:39.254333  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88633.7us
W20260709 12:22:39.256019  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 77928.9us
I20260709 12:22:39.258596  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:39.202486 11601 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.261286  8140 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:39.242442 11734 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.270750  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.277259  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:39.280150 11231 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:39.281076  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:39.222811 11729 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.313494  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.319521 11729 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.320218 11729 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:39.301566 11805 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.320921 11778 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:39.321228 11805 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.323896 11805 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.329285 11794 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.329977 11794 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.330546 11730 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.332752 11577 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:39.332993 11601 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.333379 11577 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:39.334444 11577 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.336848 11698 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.337443 11591 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.337574 11698 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.338608 11401 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:39.340171 11743 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:39.341241 11781 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:22:39.341598 11323 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.342546 11680 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.342820 11799 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:39.343253  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:39.343379 11799 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.343897  8218 raft_consensus.cc:606] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.344342  8218 raft_consensus.cc:614] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.286900 11734 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.345590 11584 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.347487 11734 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.347913 11584 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.328394 11153 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:39.348865 11798 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:22:39.301050 11146 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.350597 11146 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.354383  8757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:39.355175  8757 raft_consensus.cc:606] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:39.203868 11723 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.291769 11327 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.362870  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:39.364457 11146 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:39.365453 11801 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:39.365612 11562 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 12:22:39.366204 11562 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.251206 11655 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.370843 11655 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.355816 11733 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.312680 11700 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:39.373128 11800 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:39.448879  8215 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:39.332526 11794 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.374118 11729 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.343922 11799 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:39.415416 11584 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.444479 11562 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.507599  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:39.471735 11729 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.444197 11744 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.513796 11803 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:39.517966 11619 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.000s
W20260709 12:22:39.521157 11760 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:39.451364 11698 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.555780 11803 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.545300 11797 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:39.535398  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 320611us
W20260709 12:22:39.560506  8110 connection.cc:256] RPC call timeout handler was delayed by -1.811765196000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 12:22:39.560057 11797 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:39.560911  8110 connection.cc:256] RPC call timeout handler was delayed by -1.7768520200002058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 12:22:39.561249  8110 connection.cc:256] RPC call timeout handler was delayed by -1.7029445960001794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 12:22:39.500874 11779 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:39.561766  8110 connection.cc:256] RPC call timeout handler was delayed by -1.6661520200000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 12:22:39.538018  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.002s	sys 0.001s
W20260709 12:22:39.562420  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.002s	sys 0.002s
I20260709 12:22:39.563987  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.565981  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.567775  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:39.569489  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.471172 11800 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:39.509694  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1666) took 1101 ms. Trace:
W20260709 12:22:39.552225  8138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 629) took 2812 ms (client timeout 1673 ms). Trace:
I20260709 12:22:39.560352 11803 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.570307  8063 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:39.576107  8138 rpcz_store.cc:269] 0709 12:22:36.739442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.739596 (+   154us) service_pool.cc:224] Handling call
0709 12:22:39.551981 (+2812385us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001c34d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:39.552150 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583436672}
I20260709 12:22:39.512581  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2742) took 1490 ms. Trace:
I20260709 12:22:39.572701  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.571694  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.574846  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.579161  8069 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:39.574781 11422 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:39.578543  8110 connection.cc:256] RPC call timeout handler was delayed by -1.6517251770001167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:22:39.584311 11422 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.588589 11422 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.578292  8061 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:39.581885  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.509508 11584 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.576948 11466 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.591886  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:39.593763  8110 connection.cc:256] RPC call timeout handler was delayed by -1.5580445960004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:22:39.594225  8110 connection.cc:256] RPC call timeout handler was delayed by -1.51865557300016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 12:22:39.579763  8068 rpcz_store.cc:276] 0709 12:22:38.022403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.022525 (+   122us) service_pool.cc:224] Handling call
0709 12:22:38.022810 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.117572 (+ 94762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.117634 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.117691 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:38.117736 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.512289 (+1394553us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b5400345b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:39.512351 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.512511 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217339776}
W20260709 12:22:39.594686  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4035824770003273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2978s for a response
W20260709 12:22:39.595197  8110 connection.cc:256] RPC call timeout handler was delayed by -1.3282648379999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:22:39.595717  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1737445960002333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24710000000000001s for a response
W20260709 12:22:39.596050  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1378581990002203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33590000000000003s for a response
I20260709 12:22:39.596060  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:39.596498  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1336465160002263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 12:22:39.596967  8110 connection.cc:256] RPC call timeout handler was delayed by -1.0751465160001317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:22:39.597364  8110 connection.cc:256] RPC call timeout handler was delayed by -1.028346516000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:22:39.599414  8061 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:22:39.602753  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 344243us
I20260709 12:22:39.591279  8146 rpcz_store.cc:276] 0709 12:22:38.407935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.843563 (+435628us) service_pool.cc:224] Handling call
0709 12:22:38.850079 (+  6516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.934524 (+ 84445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.934570 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:38.934616 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:38.934655 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.509369 (+574714us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b54002f0654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:39.509431 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.509612 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108700416}
I20260709 12:22:39.590024 11700 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.614720  8140 raft_consensus.cc:1217] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[7.6-11.8]   Dedup: 7.6->[9.7-11.8]
W20260709 12:22:39.617345  8141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 633) took 2606 ms (client timeout 2323 ms). Trace:
I20260709 12:22:39.618896  8140 pending_rounds.cc:85] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:22:39.619306  8140 pending_rounds.cc:107] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 8.7
W20260709 12:22:39.618945  8141 rpcz_store.cc:269] 0709 12:22:37.010682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.010855 (+   173us) service_pool.cc:224] Handling call
0709 12:22:39.617112 (+2606257us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400256054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:39.617270 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953230208}
I20260709 12:22:39.619722  8140 raft_consensus.cc:2889] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:39.617645  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:39.603947 11323 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:39.627223  8218 raft_consensus.cc:606] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.627662  8218 raft_consensus.cc:614] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.628492  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 610) took 1161 ms. Trace:
I20260709 12:22:39.630328  8214 rpcz_store.cc:276] 0709 12:22:38.467215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.479622 (+ 12407us) service_pool.cc:224] Handling call
0709 12:22:39.133774 (+654152us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:22:39.133979 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.134185 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:39.134476 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.627016 (+492540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:39.627065 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:39.627108 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.628313 (+  1205us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.628436 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2481,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":48421,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":85421824,"thread_start_us":490002,"threads_started":2,"wal-append.queue_time_us":303132}
I20260709 12:22:39.641053  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:39.641932  8142 raft_consensus.cc:2376] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8. Re-sending same reply.
I20260709 12:22:39.600764 11422 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:39.556607 11619 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.646958  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:39.647219  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:39.616308 11789 consensus_queue.cc:1243] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:39.598804 11698 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:22:39.688917  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.693436  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:39.661723  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:39.684180  8211 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:39.694162  8219 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.661923  8142 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:22:39.681277  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 173912us
I20260709 12:22:39.688337  8216 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:39.686424  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 539234us
W20260709 12:22:39.674968  8067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2751) took 1280 ms (client timeout 1673 ms). Trace:
I20260709 12:22:39.697472  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.662048  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.647783  8146 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:39.732302  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:39.715332  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:39.704825  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:39.697501  8067 rpcz_store.cc:269] 0709 12:22:38.394298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.395034 (+   736us) service_pool.cc:224] Handling call
0709 12:22:39.674706 (+1279672us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b540011dfd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:39.674856 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71973120}
I20260709 12:22:39.703648  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.601212 11466 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.771636 11584 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.773294 11779 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:39.773761  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:39.775130  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:39.743753 11824 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:39.777209 11824 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.779683 11824 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.604110 11786 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.638934 11577 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:39.763864  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 101869us
I20260709 12:22:39.670466 11619 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:39.766158  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.768934 11789 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.769161 11733 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:39.770445  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:39.764559  8068 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:39.780586  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:39.673333 11810 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:22:39.783388  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 87923.1us
I20260709 12:22:39.872092  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:39.766001  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:39.660797 11800 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:39.626223 11700 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.656610 11609 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.210s
I20260709 12:22:39.658005 11783 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.298s
I20260709 12:22:39.661012 11793 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.420s
I20260709 12:22:39.643431 11422 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:40.097615  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.326531  8140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.027s	sys 0.043s
I20260709 12:22:39.745261 11748 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:40.324659  8137 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.060s
W20260709 12:22:40.405303  8137 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.012s	sys 0.060s
I20260709 12:22:40.065838  8070 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:40.400302  8069 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:39.903203  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:40.411406  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 539414us
I20260709 12:22:40.412340  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:40.333971  8219 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.001s
I20260709 12:22:39.956094  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:40.399788  8140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.028s	sys 0.045s
I20260709 12:22:40.047662  8215 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:40.301510 11830 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:22:40.187021 11818 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:22:40.413328  8219 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:40.130674  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58375.3us
I20260709 12:22:40.417523  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.452225  8211 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:40.410787 11327 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.454423 11783 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:40.454361 11327 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:39.959740 11146 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.185496 11814 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.434084  8143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.009s	sys 0.010s
W20260709 12:22:40.147608 11767 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:22:39.903759 11698 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.301244 11770 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:40.142206 11734 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.123306 11680 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.913378 11584 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.000998 11695 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.183454 11821 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.122987 11562 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.241843 11824 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:40.458866  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.047719 11803 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.144878 11333 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:40.459649  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:39.956422 11577 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.405117 11748 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:39.995900 11779 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.503s
I20260709 12:22:40.414657  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.455214 11783 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:40.456941 11146 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.466609 11770 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:40.486552  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 619) took 1321 ms. Trace:
I20260709 12:22:40.476572 11821 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.459698 11327 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.488147  8217 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:40.467250 11794 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:22:40.490146  8214 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:40.459690  8143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.009s	sys 0.011s
I20260709 12:22:40.466531 11698 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.494338  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.498685  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.500344  8068 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:40.468377 11680 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:40.484735 11655 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.111s	user 0.015s	sys 0.000s
I20260709 12:22:40.517803  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:40.476648 11824 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.482653  8211 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.517931  8220 rpcz_store.cc:276] 0709 12:22:39.165447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.166349 (+   902us) service_pool.cc:224] Handling call
0709 12:22:39.166608 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.171793 (+  5185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.171841 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.183609 (+ 11768us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.594044 (+410435us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:39.594084 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.594156 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.486260 (+892104us) raft_consensus.cc:1685] finished
0709 12:22:40.486288 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.486463 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10515,"raft.queue_time_us":88505,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":25227,"thread_start_us":345481,"threads_started":1,"wal-append.queue_time_us":439883}
I20260709 12:22:40.528779  8214 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:40.477061 11803 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.530704 11577 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.477545 11695 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.470124 11734 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.464373 11814 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:40.517915 11627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.022s	sys 0.009s
I20260709 12:22:40.473922 11584 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.483804 11562 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.549081  8062 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:40.550575  8214 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:40.485543 11333 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.552279  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:40.540576 11545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.027s	sys 0.072s
I20260709 12:22:40.562811  8214 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:40.540814 11153 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.016s	sys 0.025s
I20260709 12:22:40.591130  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:40.599788  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:40.592401 11545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.028s	sys 0.072s
I20260709 12:22:40.608528  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:40.563309 11723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.003s	sys 0.024s
W20260709 12:22:40.593689 11153 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.016s	sys 0.026s
I20260709 12:22:40.553131 11577 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:40.558174 11796 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.590644 11803 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.595680 11733 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:40.546443 11748 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:40.560204 11627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.022s	sys 0.009s
I20260709 12:22:40.607967 11619 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:40.612195 11723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.003s	sys 0.025s
I20260709 12:22:40.605504 11698 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.558815 11770 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.637908  8211 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:40.626850 11700 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.632972 11803 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.661299 11680 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.661871 11680 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.662307 11680 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.664198 11680 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.619913 11577 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.664566  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46948 (request call id 16) took 1302 ms. Trace:
I20260709 12:22:40.670302  8218 rpcz_store.cc:276] 0709 12:22:39.362555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.362713 (+   158us) service_pool.cc:224] Handling call
0709 12:22:40.664270 (+1301557us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca86853 00007f4991a5460a 00007f498afda7d4 00007f498afda762 00007f498afda691 00007f498afda60c 00007f498afd98c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:40.664437 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606483712}
I20260709 12:22:40.669731  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.673405  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:40.667081 11577 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.665511 11146 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:40.677384  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.021s	sys 0.025s
I20260709 12:22:40.619628 11796 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.643771 11619 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.647969 11748 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:40.682350  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.021s	sys 0.026s
I20260709 12:22:40.646726 11695 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.650151 11733 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:40.689256  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.683719 11729 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.110s	user 0.014s	sys 0.000s
I20260709 12:22:40.681116 11770 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:40.660403 11803 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.686287 11619 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.704854  8218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c14c286147e549768b521ff92a61fec9"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:46948
I20260709 12:22:40.700512 11733 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:40.745010  8218 raft_consensus.cc:606] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.705567 11422 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.715340 11466 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.716044  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.718067 11796 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:40.719101 11835 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:22:40.725557 11809 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.248s	user 0.005s	sys 0.005s
W20260709 12:22:40.727538  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.689512 11821 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.688992 11577 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.764088  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 654) took 1108 ms. Trace:
I20260709 12:22:40.730033 11333 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:40.731516 11824 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.732275 11562 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.732916 11842 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.733368 11734 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:40.733682 11814 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:40.703883 11803 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.736788 10999 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.701807 11729 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:40.740037 11799 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.217s	user 0.004s	sys 0.008s
I20260709 12:22:40.745398  8218 raft_consensus.cc:614] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.768123 11778 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:40.747726  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 335443us
I20260709 12:22:40.757687  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.829928  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.830341  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.831621  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.832198  8139 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:40.763718  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.729156 11584 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:40.748356 11348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.002s	sys 0.014s
I20260709 12:22:40.834681  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.836702  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.839669  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.842067  8212 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:40.844254  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:40.845901  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:40.837018 11348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.002s	sys 0.014s
I20260709 12:22:40.850437  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:40.860770  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.768204  8137 rpcz_store.cc:276] 0709 12:22:39.655943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.663776 (+  7833us) service_pool.cc:224] Handling call
0709 12:22:39.664067 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.664281 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:40.405972 (+741691us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.763742 (+357770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.763802 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.763847 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.763912 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.764029 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":478,"prepare.queue_time_us":525083,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"thread_start_us":1098168,"threads_started":2}
I20260709 12:22:40.774659  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.766563 11577 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.765411 11422 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.869060  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 643) took 1267 ms. Trace:
I20260709 12:22:40.840040 11609 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:40.867183  8064 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:22:40.745520 11733 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.851284 11700 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:40.849332 11735 raft_consensus.cc:2764] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:22:40.849129 11784 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:40.874687  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:40.869596  8140 rpcz_store.cc:276] 0709 12:22:39.601926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.602053 (+   127us) service_pool.cc:224] Handling call
0709 12:22:39.602458 (+   405us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:39.638617 (+ 36159us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:39.638651 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:39.647177 (+  8526us) log.cc:844] Serialized 52 byte log entry
0709 12:22:40.417499 (+770322us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:40.417542 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.417631 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.718521 (+300890us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:40.860457 (+141936us) raft_consensus.cc:1685] finished
0709 12:22:40.860482 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.868987 (+  8505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12496,"raft.queue_time_us":12655,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":28332,"spinlock_wait_cycles":70022016,"thread_start_us":746423,"threads_started":1,"wal-append.queue_time_us":855462}
W20260709 12:22:40.874662  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 266162us
I20260709 12:22:40.890906  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:40.881958  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.882902  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.826247 11799 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.827445 10999 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.866052 11842 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.892939  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.893404  8218 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:40.898030  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 849) took 1481 ms. Trace:
I20260709 12:22:40.839461 11778 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.906785  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:40.914201  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:40.915215  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.916334  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:40.918784  8110 leader_election.cc:400] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:40.919332  8110 leader_election.cc:403] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:40.916213  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:40.922966  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.937544  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.938584  8068 raft_consensus.cc:2410] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:22:40.940384 11750 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:40.941183 11846 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:22:40.941075 11750 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.942581  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.943845  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.943961 11792 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:40.944787 11784 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:40.948944  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.949746  8218 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:40.950786  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.951730  8218 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:40.952760 11824 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.953405 11824 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.955257  8146 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:40.957031  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 560107us
I20260709 12:22:40.958640  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2759) took 1998 ms. Trace:
I20260709 12:22:40.959023  8064 rpcz_store.cc:276] 0709 12:22:38.960304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.961114 (+   810us) service_pool.cc:224] Handling call
0709 12:22:38.961439 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.873387 (+1911948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.958413 (+ 85026us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400106dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:40.958583 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4382270336}
I20260709 12:22:40.917459 11562 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:40.960203  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.960263 11562 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:40.961633 11804 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:40.962697 11789 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:40.963259  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 430258us
I20260709 12:22:40.973387  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1627) took 2988 ms. Trace:
I20260709 12:22:40.963157 11609 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:40.964573  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.978199  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.979099  8067 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:40.903432 11584 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:40.966431 11577 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.964897  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1654) took 1193 ms. Trace:
I20260709 12:22:40.981817  8217 rpcz_store.cc:276] 0709 12:22:39.771791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.774884 (+  3093us) service_pool.cc:224] Handling call
0709 12:22:40.964735 (+1189851us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:40.964841 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638434560}
I20260709 12:22:40.983259  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.983963  8217 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:40.985625  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:40.968116  8064 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:40.969430  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:40.987660  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.988595  8064 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:40.989718  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:40.910292 11735 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:40.971715  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.997994  8218 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:40.973850  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.868850 11422 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:40.973851  8213 rpcz_store.cc:276] 0709 12:22:37.985035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.989497 (+  4462us) service_pool.cc:224] Handling call
0709 12:22:38.572801 (+583304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.652248 (+ 79447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.973193 (+2320945us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400373550. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:40.973324 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340584832}
I20260709 12:22:41.003242  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.003854  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:40.909943 11814 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:41.004135  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.991592  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.007670  8213 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:40.992759  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.970996  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.008752  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:40.998634  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.010020  8758 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:41.010082  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.010524 11562 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:40.990459 11821 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.011404 11821 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.011916  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 641) took 1412 ms. Trace:
I20260709 12:22:41.013554 11821 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.013727 11744 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.011423  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.014931 11804 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.015189  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.012288  8143 rpcz_store.cc:276] 0709 12:22:39.600012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.601195 (+  1183us) service_pool.cc:224] Handling call
0709 12:22:39.617484 (+ 16289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.618000 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:40.531700 (+913700us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.863656 (+331956us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.866399 (+  2743us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.866973 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:22:40.867092 (+   119us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:40.867122 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.867186 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.011710 (+144524us) raft_consensus.cc:1685] finished
0709 12:22:41.011730 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.011861 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37934,"prepare.queue_time_us":421780,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":100,"raft.queue_time_us":8473,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":7121,"thread_start_us":1213832,"threads_started":2,"wal-append.queue_time_us":447874}
I20260709 12:22:41.015305 11804 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:41.016556 11804 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.017839 10999 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.018441  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.019016  8213 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:41.019769  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.020304  8213 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:41.020713 11619 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.021121  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.021193  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:41.021869  8213 raft_consensus.cc:2368] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:41.022214  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:41.022607  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.022719 11803 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.023238  8213 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:41.024024  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:40.976377 11750 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:40.989718 11845 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.166s	user 0.004s	sys 0.000s
I20260709 12:22:40.956501 11824 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.026811  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:40.978039 11789 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:41.008876  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.060319  8218 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:41.066823  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.069876  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:41.005474 11577 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:41.000245  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:40.981261 11584 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:41.032302  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.032778  8217 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:41.034762  8211 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:41.058853  8139 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:41.059059  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:40.996673 11784 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:41.095260  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.098512  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:41.100672  8218 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:41.109783  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.032493 11153 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:41.114686  8061 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:41.106921  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.102430  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.102141  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.128618  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.129539  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.130641  8218 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:22:41.041867 11721 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:41.112402  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:40.944541 11792 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.096732 11577 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.135530  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:41.146245  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.156653  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.102548 11584 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.100201 11843 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:41.044405 11162 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:22:41.132274 11356 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:41.140139 11545 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.131701 11784 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.109680 11824 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.143330 11721 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.200543 11721 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:41.205528  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:41.204969  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 179665us
I20260709 12:22:41.219278  8758 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:41.208117  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:41.223269  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:41.225044  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.127854 11466 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:22:41.128258 11805 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:22:41.150153 11729 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.153910 11153 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:41.155184 11577 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.131983 11841 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:22:41.224831 11824 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.227308 11356 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:41.306565 11356 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:41.287665  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.308533  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 196081us
I20260709 12:22:41.309782  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:41.310576  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 293948us
I20260709 12:22:41.311993 11466 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:41.312619 11466 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:41.299952 11153 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.235677 11411 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:41.314245 11411 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:41.315387 11333 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:41.315989 11333 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.316764  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:41.296875  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.299336 11422 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.316408 11333 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.318792 11422 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:41.319555 11422 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.313060 11466 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.321549 10999 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:41.321966 10999 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.322341 10999 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.320355 11422 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:41.326089  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 165122us
I20260709 12:22:41.329015  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:41.337409  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.338379 11411 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:41.338976 11411 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.339390 11411 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.339783  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:41.294449  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71124.8us
W20260709 12:22:41.341954  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.346638  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:41.349298  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.353401 11619 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.354329 11619 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:41.354559 11729 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:41.231137 11750 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:41.248351 11847 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 12:22:41.251372 11852 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:22:41.251466 11853 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:41.420296 11824 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:41.422107  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55060.1us
I20260709 12:22:41.255997 11842 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.243703 11799 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.395541 11735 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:41.398303 11770 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.003s
I20260709 12:22:41.399075 11700 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:41.438736  8141 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:22:41.439318  8141 pending_rounds.cc:85] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:41.439664  8141 pending_rounds.cc:107] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:22:41.439989  8141 raft_consensus.cc:2889] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:41.365671 11422 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.398902 11589 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:41.436296 11735 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:41.442806  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 644) took 1840 ms. Trace:
I20260709 12:22:41.443187 11735 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.403337 11577 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.394425  8110 leader_election.cc:400] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7.
I20260709 12:22:41.393651 11466 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.415305 11792 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.415961 11609 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:41.443384  8144 rpcz_store.cc:276] 0709 12:22:39.602261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.625461 (+ 23200us) service_pool.cc:224] Handling call
0709 12:22:39.655878 (+ 30417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.451722 (+795844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.451755 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.451800 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.451834 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.442272 (+990438us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400254254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.442361 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.442585 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829832320}
I20260709 12:22:41.398888 11545 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:41.409373 11333 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.471936  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 629) took 2019 ms. Trace:
W20260709 12:22:41.518366  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103268us
I20260709 12:22:41.470172  8140 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:41.473687  8217 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:41.478621  8220 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:41.463168  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 640) took 1863 ms. Trace:
I20260709 12:22:41.473227  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1636) took 1843 ms. Trace:
W20260709 12:22:41.521755  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 181731us
I20260709 12:22:41.519817  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:41.521479  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 103310us
I20260709 12:22:41.504846  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1641) took 1811 ms. Trace:
I20260709 12:22:41.472954  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.535841  8212 rpcz_store.cc:276] 0709 12:22:39.452709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.453799 (+  1090us) service_pool.cc:224] Handling call
0709 12:22:39.454259 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.842627 (+1388368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.471219 (+628592us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002256d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.471652 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3191108864}
W20260709 12:22:41.474470  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 608) took 3007 ms (client timeout 2146 ms). Trace:
I20260709 12:22:41.551949  8219 rpcz_store.cc:276] 0709 12:22:39.693337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.475701 (+782364us) service_pool.cc:224] Handling call
0709 12:22:40.476069 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.559033 (+ 82964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.559067 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.559109 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:40.559137 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.504209 (+945072us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54003a6e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.504296 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.504614 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190284544}
I20260709 12:22:41.473148 11577 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.551366  8215 rpcz_store.cc:276] 0709 12:22:39.629853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.631459 (+  1606us) service_pool.cc:224] Handling call
0709 12:22:39.631789 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.452230 (+820441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.472706 (+1020476us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540017d4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.473057 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955917696}
W20260709 12:22:41.553133  8216 rpcz_store.cc:269] 0709 12:22:38.466683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.471613 (+  4930us) service_pool.cc:224] Handling call
0709 12:22:41.473774 (+3002161us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000e7254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:41.474185 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430764800}
I20260709 12:22:41.477833  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.476563  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.464476 11466 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.503443  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.516831 11698 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.481524  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.509941 11348 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:41.478504  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.465865 11700 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.515787 11694 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.566095  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.440012 10999 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.486219  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.575309  8139 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:41.575186 11799 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:41.570075  8146 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:41.576691  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.505645 11735 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.584332 11791 raft_consensus.cc:993] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:41.585245 11728 raft_consensus.cc:1081] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:22:41.585776  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.586347  8215 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:41.586668  8137 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.578891  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:41.589293  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 126542us
I20260709 12:22:41.590092  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.590963  8140 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.567205 11411 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.504096 11721 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.593009 11799 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:41.594517 11411 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.594324 11799 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.595057  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:41.594786 11721 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.573822 11348 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:41.475245 11584 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.569828 11698 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:41.602771  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.603513  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.606179  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:41.605898 11348 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.604439  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.577594 11694 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:41.594120 11797 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.617353  8068 raft_consensus.cc:1813] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Handling vote request from an unknown peer 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:41.617911  8064 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:41.618160  8068 raft_consensus.cc:2368] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:41.619096  8061 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.619495 11778 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.620551 11348 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:41.617475  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 269028us
I20260709 12:22:41.539559  8138 rpcz_store.cc:276] 0709 12:22:39.599647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.599784 (+   137us) service_pool.cc:224] Handling call
0709 12:22:39.600228 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.458541 (+858313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.458579 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.463410 (+  4831us) log.cc:844] Serialized 26 byte log entry
0709 12:22:40.756605 (+293195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:40.756687 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.440270 (+683583us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400312c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.440335 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.440385 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:41.440409 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.462456 (+ 22047us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18038,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8572,"spinlock_wait_cycles":1973012736,"thread_start_us":288164,"threads_started":1,"wal-append.queue_time_us":436812}
I20260709 12:22:41.624745  8213 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:41.629206  8143 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:41.612766 11784 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:41.628455  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.630066  8142 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:41.644937  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.637086  8144 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:41.646452  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:40.903004  8757 rpcz_store.cc:276] 0709 12:22:39.416594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.527581 (+110987us) service_pool.cc:224] Handling call
0709 12:22:39.532275 (+  4694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.532564 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:39.694861 (+162297us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.784223 (+ 89362us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.897455 (+1113232us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b180009e1a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:22:40.897663 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.897720 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:40.897772 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.897839 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.897966 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1200542,"prepare.queue_time_us":150968,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5126,"raft.queue_time_us":1206266,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":214818944,"thread_start_us":138878,"threads_started":1}
I20260709 12:22:41.651037  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.644766 11797 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:41.662170  8061 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:41.661028  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.669556 11789 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.677443 11842 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.678205 11842 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.678876  8216 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:41.673099  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.682044  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.624500 11694 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.681865  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.688004 11503 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:41.688988 11503 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.690667 11146 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:41.691502 11146 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.693715 11803 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.694204 11146 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.696112 11146 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:41.672619  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.671202 11789 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.693159 11503 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.702251  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.707007  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.713330 11231 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:41.713711 11791 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:41.715721 11832 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.089s	user 0.004s	sys 0.004s
I20260709 12:22:41.676662 10999 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.640245 11700 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.688489 11786 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.705360 11333 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.684260 11842 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.740921  8139 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:41.798372  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.799340  8139 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:41.741755  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.744801 11698 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.802147 11698 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.802332  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.746413  8144 raft_consensus.cc:2410] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:41.740772  8142 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:41.806087  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.807044  8142 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:41.807536  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.808189  8144 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:41.746928 11584 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:41.808801 11778 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:41.745273  8061 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:22:41.809976  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.810681  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.811062 11778 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:41.747330 11804 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.811602  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.811777 11778 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.748750 11728 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:22:41.813218  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.804329  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.814406 11723 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:41.749096 11649 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:41.750793  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.815308 11649 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:41.753727  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.816161  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.753192  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.817256  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.754343  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.814651  8145 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:41.755980 11803 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.755641  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1653) took 2185 ms. Trace:
I20260709 12:22:41.757925  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.816437 11649 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.755770  8064 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:41.761552  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 115799us
I20260709 12:22:41.760943 11797 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:22:41.821668  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.821928  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.822291 11797 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:41.821120 11649 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.823001 11797 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:41.823493  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.824834  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.824453 11797 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.825511  8064 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:41.826043 11784 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:41.826234 11545 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:41.827507 11545 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:41.772147  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1651) took 2001 ms. Trace:
I20260709 12:22:41.757028  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.828361  8220 rpcz_store.cc:276] 0709 12:22:39.771042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.542792 (+771750us) service_pool.cc:224] Handling call
0709 12:22:41.478070 (+935278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.556524 (+ 78454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.771863 (+215339us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54000e7250. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:41.772059 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150050688}
I20260709 12:22:41.829005  8141 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:41.772830  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:41.830073  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.830914  8141 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:41.830971  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.832085  8065 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:41.831997  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.800583  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.819964  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.773852  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.776031  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.834486  8069 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:41.834960  8138 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:41.835491  8068 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:41.761552  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:41.836932  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.776500 11869 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 12:22:41.838172  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.838999 11869 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.777284 11721 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.776796  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.840059 11721 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:41.776360  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 74396us
I20260709 12:22:41.787199 11503 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:41.841952 11503 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.748900 11734 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:41.842968 11734 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.843689  8140 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:41.778748 11843 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:41.844358 11843 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.822510  8145 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.845042 11503 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:41.845597  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.833405  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.846757  8143 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:41.847278 11803 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:41.848362  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.755892  8219 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:41.848915  8184 leader_election.cc:400] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:41.849287  8184 leader_election.cc:403] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:41.849586  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.842320 11721 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.849969 11584 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:41.814826 11723 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:41.851315  8143 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:41.852018 11584 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:41.851893 11723 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.808230  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.827953 11545 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:41.787627  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.853958 11803 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:41.756271  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.753810  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:41.854776 11545 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.814814  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.793036  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.856932 11545 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.746955 11700 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.853415 11784 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:41.853981  8143 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:41.826072 11797 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.861439 11784 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:41.862494  8137 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:41.864063 11784 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.772105 11735 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:41.855749  8146 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:41.773029 11694 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.865016  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:41.833441  8139 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.773182 11146 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:41.896397  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:41.896718  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.897063 11789 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:41.897809  8217 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:41.898159 11784 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:41.898486 11146 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:41.869092 11803 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:41.899351 11803 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:41.870666  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 109282us
W20260709 12:22:41.766480  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.839387 11869 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:41.874125  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:41.875245  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.877842  8219 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:41.878731  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.882189 11584 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8.
I20260709 12:22:41.883476  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.884781  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:41.886998  8758 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:41.887554  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.887669  8759 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:41.887902  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.888196  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.888551  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:41.869093  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.888896  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:41.820257  8063 rpcz_store.cc:276] 0709 12:22:39.570557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.576576 (+  6019us) service_pool.cc:224] Handling call
0709 12:22:39.576913 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.577232 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.577262 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.581979 (+  4717us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.782445 (+200466us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:39.782495 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.782590 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.696166 (+1913576us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:41.755125 (+ 58959us) raft_consensus.cc:1685] finished
0709 12:22:41.755145 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.755444 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47607,"raft.queue_time_us":89,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6123,"spinlock_wait_cycles":3027328,"thread_start_us":200030,"threads_started":1,"wal-append.queue_time_us":1023568}
I20260709 12:22:41.896070  8061 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:41.867317  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:41.898607 11784 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:41.871366 11735 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:41.833647  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.091490  8064 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
W20260709 12:22:41.794535  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.090004  7966 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:42.092787  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 152257us
I20260709 12:22:42.057739  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:41.866269  8137 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:42.019950  8145 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:42.094856  8140 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:41.903321  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:41.841977  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.098394  8765 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:42.096551  8764 raft_consensus.cc:2410] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:42.097842  8139 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:41.839354  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:41.900544 11803 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.013288  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:42.111076  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:42.116084  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.105346  8144 raft_consensus.cc:2376] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10. Re-sending same reply.
I20260709 12:22:42.115625  8070 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:42.124871  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:42.094832 11609 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.131990  8220 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:42.132998  8069 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.131775  8756 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:42.131852  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:42.135870  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:42.132776  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:42.136083  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 239769us
I20260709 12:22:42.137539  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:42.142395  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:42.142481  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:42.115237 11789 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:42.145738  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:42.122462 11700 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.141073  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:42.155459  8758 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:41.905916 11778 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.150007  8759 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:42.158670  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:42.173710  8765 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:42.176896  8762 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:42.184122 11778 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.185307  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2760) took 3065 ms. Trace:
I20260709 12:22:42.216828 11869 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.217231  8066 rpcz_store.cc:276] 0709 12:22:38.985850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.986012 (+   162us) service_pool.cc:224] Handling call
0709 12:22:38.986408 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.361587 (+375179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.361635 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.629841 (+2268206us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b2c000014c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:41.632616 (+  2775us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.729859 (+ 97243us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:41.729902 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.814100 (+ 84198us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54003953d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:41.814150 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.012886 (+198736us) raft_consensus.cc:1685] finished
0709 12:22:42.012913 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.051435 (+ 38522us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2205,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":892421760,"thread_start_us":32945,"threads_started":1,"wal-append.queue_time_us":130027}
I20260709 12:22:42.219334  8064 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:22:42.219408  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.152076 11786 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:42.167024 11843 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.221043 11786 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.221781 11789 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:42.201643  7966 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.223687 11786 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:42.223883 11843 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.141173 11348 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:22:42.164984 11700 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.225868 11348 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:42.226428 11348 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:42.228749  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.229228  7966 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.189064  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.230974 11721 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:42.231381  8036 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:42.174536 11545 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.168692 11824 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:42.233359 11824 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:42.233901 11824 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:42.233170 11784 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.234270  8757 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:42.235100 11784 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.187404 11842 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:42.236904 11842 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.239290 11842 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:42.142946 11609 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.220278  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:42.194052  8067 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:42.240785  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:42.221038 11577 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:42.241829 11577 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.244910 11735 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:42.207443  8143 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:42.244323 11577 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:42.236377  7964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 267) took 15380 ms (client timeout 15000 ms). Trace:
I20260709 12:22:42.245955  7966 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:42.227852 11700 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.252766 11778 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:42.233186 11545 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.227692 11348 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.255463  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:42.256232 10999 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:42.266258  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:42.254801  7966 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:22:42.288471  8069 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:22:42.287556 11799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.042s	sys 0.114s
I20260709 12:22:42.318504  7966 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.292162 11778 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:42.307924 11799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.043s	sys 0.115s
I20260709 12:22:42.325393  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:42.331235 11348 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.332556  8062 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:42.334380  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.293896 11734 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.336413  7966 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.343713  7966 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 9, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.328091 11778 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:42.365649 11612 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:42.366232 11612 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.366672 11612 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:42.377029  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 121641us
I20260709 12:22:42.378242  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:42.379108 11843 raft_consensus.cc:2764] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:22:42.386260 11545 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:42.387907 11698 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.006s
I20260709 12:22:42.389504  8065 raft_consensus.cc:2410] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:22:42.248126  7964 rpcz_store.cc:269] 0709 12:22:26.861922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.862186 (+   264us) service_pool.cc:224] Handling call
0709 12:22:42.236100 (+15373914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:33.220940 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:33.221721 (+   781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:33.221774 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:22:33.221803 (+    29us) tablet.cc:662] Decoding operations
0709 12:22:33.267801 (+ 45998us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:33.269267 (+  1466us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:33.269315 (+    48us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:22:33.271545 (+  2230us) tablet.cc:701] Row locks acquired
0709 12:22:33.271587 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:22:33.271781 (+   194us) write_op.cc:270] Start()
0709 12:22:33.271946 (+   165us) write_op.cc:276] Timestamp: P: 1783599753271702 usec, L: 0
0709 12:22:33.271961 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:22:33.309217 (+ 37256us) log.cc:844] Serialized 7932 byte log entry
0709 12:22:33.614224 (+305007us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b1800107ce0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:33.892158 (+277934us) op_driver.cc:464] REPLICATION: finished
0709 12:22:34.174864 (+282706us) write_op.cc:301] APPLY: starting
0709 12:22:34.174981 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:34.175460 (+   479us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:34.175507 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:34.235712 (+ 60205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:34.236089 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:22:34.236132 (+    43us) write_op.cc:312] APPLY: finished
0709 12:22:34.236683 (+   551us) log.cc:844] Serialized 139 byte log entry
0709 12:22:34.236910 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:34.237113 (+   203us) write_op.cc:454] Released schema lock
0709 12:22:34.237194 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:34.297252 (+ 60058us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:34.297284 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24849,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":251546,"apply.run_cpu_time_us":5763,"apply.run_wall_time_us":121640,"num_ops":20,"prepare.queue_time_us":135736,"prepare.run_cpu_time_us":39708,"prepare.run_wall_time_us":177483,"raft.queue_time_us":256978,"raft.run_cpu_time_us":25079,"raft.run_wall_time_us":217188,"replication_time_us":620011,"spinlock_wait_cycles":52707072,"thread_start_us":444926,"threads_started":4,"wal-append.queue_time_us":94818,"wal-append.run_cpu_time_us":31892,"wal-append.run_wall_time_us":1623392}]]}
I20260709 12:22:42.391494  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.364142  7966 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 7, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.401926  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:42.362866 11778 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:42.419001  8066 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:22:42.421267  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:42.402618 11791 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:22:42.426380 11875 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:42.438424  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:42.424538 11804 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:42.439896  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:42.446081  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 492721us
I20260709 12:22:42.456966  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:42.472859  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 297637us
I20260709 12:22:42.470882  7966 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 6, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:42.476812  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:42.480598  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.461141 11843 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:22:42.502384  7966 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 5, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 5 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:42.482525 11723 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.505330  7966 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.513679  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.514387  8137 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:42.485281 11589 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:22:42.531447  8144 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:42.534119  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.531703  7966 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:42.536754  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 79866.8us
W20260709 12:22:42.532931  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 204359us
I20260709 12:22:42.554780  8062 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:42.524371 11333 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.553133  7966 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 2 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:42.559475  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 546262us
I20260709 12:22:42.560985  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:42.561175 11885 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:42.562124 11885 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.568143 11356 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:42.570608  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 112713us
W20260709 12:22:42.601570  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 127462us
I20260709 12:22:42.637671  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:42.640671  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2828) took 1502 ms. Trace:
I20260709 12:22:42.643908  8140 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:42.630008 11609 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:42.612254 11333 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:42.645625 11880 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 12:22:42.652390  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91711.7us
I20260709 12:22:42.619110 11804 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:42.664729 11883 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:42.665411 11883 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.665973 11700 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.666574 11700 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.667748 11883 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.622793 11888 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:42.641117  8214 rpcz_store.cc:276] 0709 12:22:40.998932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.495723 (+496791us) service_pool.cc:224] Handling call
0709 12:22:41.496409 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.579817 (+ 83408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.579846 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.615417 (+ 35571us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.941536 (+326119us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:42.061565 (+120029us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.487268 (+425703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.501337 (+ 14069us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.501384 (+    47us) raft_consensus.cc:1685] finished
0709 12:22:42.501396 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.501537 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87284,"prepare.queue_time_us":84147,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":101961,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":5518,"thread_start_us":620654,"threads_started":2,"wal-append.queue_time_us":677131}
W20260709 12:22:42.669371  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55675us
I20260709 12:22:42.674312  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:42.658955 11884 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.681143  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:42.683869  8144 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.682363  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.685420  8145 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:42.672454 11878 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:22:42.688153  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.668305 11899 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:42.725983  8144 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:42.699962  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.701406  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:42.679684 11356 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:42.713146  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.713882  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:42.669325 11885 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:42.715816  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:42.728364  8220 raft_consensus.cc:2410] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:42.681360 11892 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:22:42.717949  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.718645 11700 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:42.719411  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.731990  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.721007  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:42.721271  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:42.691836 11882 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.722659 11333 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:42.722759  8070 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:22:42.724162  8064 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:42.699375  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.675745  8140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:34716
I20260709 12:22:42.731773  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:42.696360 11884 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.720059 11824 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.759866  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.774869  8143 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:42.733189  8217 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:42.722046  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:42.797330  8140 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.796900  8070 pending_rounds.cc:85] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 8
I20260709 12:22:42.766820  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.798009  8140 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.798283  8070 pending_rounds.cc:107] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:22:42.798466  8068 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:42.798619  8070 raft_consensus.cc:2889] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.727927  8141 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:42.762382  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:42.799788  8219 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:42.688196 11888 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.797736  8214 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:42.795089  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:42.812781  8141 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 4
I20260709 12:22:42.796370  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.813156  8141 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:22:42.813473  8141 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:42.767786 11890 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 12:22:42.773571 11694 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.908s	user 0.013s	sys 0.000s
I20260709 12:22:42.827400  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:42.827848  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 144110us
I20260709 12:22:42.851730  8213 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:42.768533 11584 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:42.853470  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:42.867596  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:42.822762 11356 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:42.868305  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:42.855645 11577 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:42.874152  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:42.873677  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 218553us
I20260709 12:22:42.876578  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:42.770668 11905 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:22:42.864208 11899 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.884469  8140 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:42.896032  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 169671us
I20260709 12:22:42.897136  8068 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:42.850747 11612 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.897706  8068 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:42.822880 11888 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.870411 11348 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:42.822489 11882 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.885666 11694 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:42.862519 11778 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:42.906257  8140 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:42.897469 11843 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:42.979409  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69976.9us
I20260709 12:22:42.980481  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:42.893159 11333 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:22:42.984561  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 98896.2us
I20260709 12:22:42.984920  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:42.986773  8069 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:42.990006  8144 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:42.992009  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 113983us
I20260709 12:22:42.989467 11609 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:22:42.903290 11896 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
W20260709 12:22:42.988472  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 127415us
I20260709 12:22:42.911561 11694 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.002293  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2829) took 1125 ms. Trace:
I20260709 12:22:42.998039 11902 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.957693 11146 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:43.000905  8035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.519s (SENT) [suppressed 21 similar messages]
W20260709 12:22:42.993866 11872 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:42.898610 11899 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:42.920465 11914 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:42.989255 11700 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.033807 11884 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.033579 11356 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.034621  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 169654us
I20260709 12:22:43.034972  8220 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.002882  8212 rpcz_store.cc:276] 0709 12:22:41.876656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.886363 (+  9707us) service_pool.cc:224] Handling call
0709 12:22:41.886727 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.128772 (+242045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.128810 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:42.152900 (+ 24090us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.470533 (+317633us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:42.480642 (+ 10109us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.480877 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.480947 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.001992 (+521045us) raft_consensus.cc:1685] finished
0709 12:22:43.002022 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.002207 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166039,"prepare.queue_time_us":9818,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":15098,"raft.queue_time_us":181059,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":9769,"thread_start_us":290645,"threads_started":1,"wal-append.queue_time_us":436788}
W20260709 12:22:43.026995  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47236.6us
I20260709 12:22:42.993379 11721 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:43.040220  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 150543us
I20260709 12:22:42.987802 11910 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:43.016240 11894 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.009269 11694 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.070504  8214 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:43.078467  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.043663 11589 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:43.015403 11913 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:43.094774  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.041664 11914 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.100046  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.101759  8137 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:22:43.104158  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103828us
I20260709 12:22:43.116884  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.044195 11146 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.015256 11902 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.043890 11886 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.253s
I20260709 12:22:43.099116 11784 raft_consensus.cc:2764] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:22:43.089468 11589 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.118100 11735 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.101025 11913 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.039901 11577 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:43.048933 11843 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.070292 11700 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.134814  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.136229 11888 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.105657 11914 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:43.090559 11896 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:22:43.148841  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 121358us
I20260709 12:22:43.088253 11721 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.152590  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.157992  8138 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:43.086632 11894 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.131165 11584 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.180678  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.208490  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.181818 11882 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.181931 11577 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.183378 11928 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.185710 11146 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.151705 11913 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.188155 11778 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.110383 11903 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:22:43.179152 11921 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.233604 11902 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.134184 11931 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.207119  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:43.216135  8213 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:43.219493  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.238294  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.225495  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 108727us
W20260709 12:22:43.225596  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 91470.5us
I20260709 12:22:43.242684  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:43.201004 11888 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:43.232134 11919 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:22:43.233390 11921 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.258857 11921 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:43.204581  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52086.4us
I20260709 12:22:43.260003  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.262343  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:43.252225 11922 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:22:43.266244  8141 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.269416 11899 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.270599 11589 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:43.272683 11929 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:22:43.274973  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.276021  8066 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:43.240363 11886 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.250706  8219 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:43.253552  8143 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:43.253901 11915 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
I20260709 12:22:43.254698  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.226248 11735 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.282522 11939 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:43.283322  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:43.308748  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 100368us
I20260709 12:22:43.309703  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.283535 11909 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.284060 11824 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.237155 11903 consensus_queue.cc:1243] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:43.262467 11894 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.230634 11612 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.311510  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.236886 11884 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:43.252305 11876 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.746s	user 0.000s	sys 0.005s
W20260709 12:22:43.314821  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 294935us
I20260709 12:22:43.290740 11146 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.319661  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:43.323124  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 137449us
I20260709 12:22:43.313028 11921 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.313885 11885 raft_consensus.cc:2764] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:43.335594  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.335687 11824 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.336954  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.339190  8219 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:43.338052  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.339401  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.336341  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:43.341361  8220 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:43.341835  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 87252.4us
I20260709 12:22:43.317306 11899 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:43.225747 11928 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.343542  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.344293 11609 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.344563  8218 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:43.345008  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:43.350708  8186 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.356294  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:43.359577  8757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 621) took 1603 ms (client timeout 1734 ms). Trace:
W20260709 12:22:43.359935  8757 rpcz_store.cc:269] 0709 12:22:41.749459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.753268 (+  3809us) service_pool.cc:224] Handling call
0709 12:22:43.352950 (+1599682us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54005b0754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:43.353049 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500365184}
I20260709 12:22:43.340545 11735 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:43.363440  8213 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:43.363991  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:43.339902 11903 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.398190  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:43.348752 11778 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:22:43.393734  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.407349  8137 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:43.407116  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.349357 11885 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.352046 11348 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.408746  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.411947  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.365396 11921 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.415958 11778 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.416431 11778 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.416808 11778 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:43.422782  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.406858 11914 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.425365 11905 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:43.426052 11905 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.427385 11914 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.427593 11778 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.359041 11609 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.429325 11843 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.430706  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.353681 11900 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.437680  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:43.438344  8137 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:43.436517  8068 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.365525 11888 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:22:43.444464  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.420543 11941 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:43.450577  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.452276  8068 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.452376 11946 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.368105 11824 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.446312 11903 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:43.445851 11721 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.448482 11900 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.454088 11928 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.441325 11803 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.461285  8213 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:43.429911 11921 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.427098 11905 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.469765 11778 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.469439 11612 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.470002 11789 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:43.470398 11946 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.553403 11789 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:43.554556 11789 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.555624 11946 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.472139 11913 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.472945 11947 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:22:43.473646  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.559583  8066 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:43.482896  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73717.4us
W20260709 12:22:43.484565  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70959.5us
I20260709 12:22:43.561128  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.490212  8220 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:43.497432  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.498543  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.499087  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:43.499641  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:43.499830  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.485684 11903 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.502287  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:43.505102 11942 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 12:22:43.514387 11944 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.519052 11792 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.525169  8064 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:43.526345  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:43.526486  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 565) took 1263 ms. Trace:
I20260709 12:22:43.528687 11700 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.528983 11907 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:43.531474  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.532251  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 555) took 1358 ms. Trace:
I20260709 12:22:43.574116  8069 rpcz_store.cc:276] 0709 12:22:42.263099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.313101 (+ 50002us) service_pool.cc:224] Handling call
0709 12:22:43.526187 (+1213086us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:43.526374 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513362176}
I20260709 12:22:43.534643  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:43.539465  8139 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:22:43.596228  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:43.597251  8140 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:22:43.551167  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.557050  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.557430  8145 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:43.456965 11941 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.558418  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:43.608896  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50574.7us
I20260709 12:22:43.563282  8756 raft_consensus.cc:2376] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6. Re-sending same reply.
W20260709 12:22:43.572551  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 214542us
I20260709 12:22:43.594969  8070 rpcz_store.cc:276] 0709 12:22:42.174056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.197624 (+ 23568us) service_pool.cc:224] Handling call
0709 12:22:42.722366 (+524742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.813949 (+ 91583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.532022 (+718073us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400202bd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:43.532159 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205783808}
I20260709 12:22:43.610658  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.583750  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:43.549266 11921 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.550097  8216 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.500593  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:43.614250  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.617623  8213 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:43.618782  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.593703 11612 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.626684  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.627038 11612 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.638952 11700 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:43.639679 11700 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.640273 11700 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.617805 11941 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:43.571830 11903 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.652504  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:43.655059  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44539.3us
I20260709 12:22:43.657052 11735 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:43.583755 11146 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:43.594031 11907 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.678053  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:43.663501  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 102455us
I20260709 12:22:43.678795  8212 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:43.665833  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51710.2us
I20260709 12:22:43.679255  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:43.679522  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.680140  8213 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:43.674960  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.680809  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.660171  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:43.648864 11888 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:43.689502  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:43.690511  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 95679.2us
W20260709 12:22:43.691695  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 281678us
I20260709 12:22:43.573122 11899 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:43.690924  8758 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:43.662799 11803 raft_consensus.cc:2764] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:43.659808 11784 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.663288 11609 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.677909 11902 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:43.699684  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.703848  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.707790  8211 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:22:43.610215 11792 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.696710 11799 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.693648 11888 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.713542 11950 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 12:22:43.714371 11694 consensus_meta.cc:287] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.003s
I20260709 12:22:43.714617 11803 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.714888 11609 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.696894 11721 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.594099 11944 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.720321  8213 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:43.722741  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.707149 11886 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.748088  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.753115 11899 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.754415 11792 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.755087 11792 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:43.722299 11888 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:43.731745 11902 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:43.760591 11146 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.756487 11886 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.765187  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.765959 11886 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.761037 11612 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.773741 11897 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:22:43.770273 11934 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:43.775605 11934 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.776027 11789 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:43.776672 11934 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.779990 11901 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:43.780483 11901 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.781554 11901 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.747515 11694 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.762533  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 110159us
I20260709 12:22:43.789350  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.792003  8216 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:43.798158 11900 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.800338  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:43.800819 11146 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.803040  8061 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:43.804127 11589 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.793447 11907 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.808897 11824 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.809187 11411 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:43.809643 11411 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:43.808961 11964 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:43.810279 11964 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.810658 11411 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.811684 11694 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.758024 11804 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:43.810688 11964 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.813047 11804 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.813505 11804 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.811764 11411 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:43.823720  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:43.826970  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 107983us
I20260709 12:22:43.828068  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.828240  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.829717  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.781191 11902 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.836061 11584 raft_consensus.cc:2764] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:22:43.839713  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 74616.1us
I20260709 12:22:43.835634 11146 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.840518  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.823284 11778 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.718856 11735 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.878062  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 49897.9us
I20260709 12:22:43.878942  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:43.880851 11928 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:43.881081 11884 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.001s
I20260709 12:22:43.881281 11928 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:43.881554 11884 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.881731 11928 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.885528 11784 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.886077 11784 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.886512  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46070.8us
I20260709 12:22:43.888274 11784 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.893122 11903 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.893790 11941 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.836483 11803 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.891135 11826 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:43.892449 11721 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.894126  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.888667 11778 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.878564 11921 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:43.888541  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.895903 11903 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.784615 11700 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:43.897996  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.838092 11956 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.839475 11886 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:43.840691 11900 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:43.910995 11584 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:43.914124  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:43.915007  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 203790us
I20260709 12:22:43.923997  8214 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:43.915755  8761 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:43.924880  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:43.922329  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 215190us
I20260709 12:22:43.909091 11824 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.928361  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.944717 11700 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:43.944841 11694 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:43.949286 11944 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.949766 11941 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.951776  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:43.917900 11956 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:43.922029 11886 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.924662 11888 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.954205  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.955155  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.955367  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.956672  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:43.958698  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:43.963510 11901 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:43.987162  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.925547 11900 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:43.964931 11824 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:43.996158  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.996948  8216 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:43.997736 11824 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:43.997929  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:43.967165  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:43.998639  8216 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:43.998842  8217 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 7: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:43.999260  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:43.928901  8143 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:43.999776  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:43.917429 11146 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:44.000341  8217 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.000563 11146 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:43.985597 11956 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.001019 11146 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.001745 11909 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:44.002203 11909 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.002539 11909 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.972888  8141 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:43.974447  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50546us
W20260709 12:22:44.005880  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.924800 11584 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:44.007035 11584 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.008476  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:44.009209 11900 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.011175  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:44.013216  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.013850  8214 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:44.014449 11888 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:44.016762 11826 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:44.017393 11826 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.019161 11928 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.019563 11826 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:43.986510 11886 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.022720  8211 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:44.023888  8211 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:43.958645 11921 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:43.982816  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56387.3us
I20260709 12:22:44.025177  8065 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:22:44.025991  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:44.026639  8137 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:44.026795  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:44.027184 11892 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:44.027567 11892 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:44.028995  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.029469 11937 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:44.029855 11937 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:44.030251 11934 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.031764 11584 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.033703  8219 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.033912 11584 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:44.034566  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.035159  8068 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:43.981070 11965 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.980113 11972 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:44.036370  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:44.028370 11892 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.037400 11892 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:43.986075  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72023.6us
I20260709 12:22:43.986830  8061 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:44.038311  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:43.963676 11804 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.040390 11804 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.040868 11723 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:44.041280 11723 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:44.041668  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:43.993078  8212 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:43.979238 11694 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:43.994936  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.042999 11694 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:44.043371  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.044234  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.966010  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:43.967440 11778 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.047861 11649 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.049259 11649 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.051323 11649 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:43.960213 11964 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:44.025185  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.047516  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:44.019488  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.051306 11694 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.042107 11723 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.054939  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:44.060598  8217 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.061233  8141 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:44.039570  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:43.999625  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.070147  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.071642 11545 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:44.072335 11545 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.075244 11545 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:44.075882 11545 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:44.076195  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51081.4us
I20260709 12:22:44.079465  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.080216 11778 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:44.080742 11778 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.081585 11778 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.076324 11545 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.092617  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:44.094497  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.086143  8215 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:44.098930  8217 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:44.100353  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:44.030254 11937 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.099572  8216 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:44.105243  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:44.108960 11545 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.046736 11965 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:44.111207  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71721.8us
I20260709 12:22:44.053869 11964 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:44.111503  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.111248  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:44.112874  8069 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:22:44.114041  8144 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:44.115739  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:44.122093  8145 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.123905  8062 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:44.120920  8061 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:44.119935  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.129781  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.130158  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:44.132718  8068 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.103271 11799 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:44.139019  8062 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.139549  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.142364  8062 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:22:44.143723  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.115664 11723 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:44.150794  8137 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:44.119201 11584 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:44.159418  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.160099  8061 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:44.154100 11609 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:44.161396 11609 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.161818 11609 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.162101 11584 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:44.162354  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.163122  8063 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.163882  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:44.164104 11694 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:44.164940 11612 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:44.165578 11921 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:44.165995 11913 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.166114 11921 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:44.167040 11921 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.172319  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.163064  8145 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:44.174655  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.175499 11888 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:44.176250  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.180501 11545 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.186251  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.189112  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.188228 11609 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.193480 11545 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.195500  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.196483  8212 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.196799 11609 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.197748 11928 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:44.214607  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:44.215760  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.217020  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:44.163087 11584 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.218204  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:44.220000  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56193.6us
W20260709 12:22:44.221000  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45105.6us
I20260709 12:22:44.223179  8068 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.170890  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:44.224310  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.225217  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:44.225379  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65170us
W20260709 12:22:44.227664  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 74789.4us
I20260709 12:22:44.228768  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.228438  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:44.237042  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:44.240239 11721 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.240386 11956 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.241210 11411 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:44.243530 11694 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:44.244056 11965 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:22:44.244726 11694 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:44.245082 11694 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:44.230222 11888 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:44.240741 11721 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:44.245936 11694 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.246901 11721 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.248044 11956 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.233129 11824 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:22:44.250325  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.251062  8062 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 4.
I20260709 12:22:44.204057 11909 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.144577 11735 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:44.247291 11694 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.252715  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.263797  8214 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:44.265118  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 211439us
I20260709 12:22:44.252014  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:44.268900  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.256326  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:44.253192 11949 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.260352  8216 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:44.269687  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.296842 11914 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:44.297916 11914 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:44.300524  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.212360 11146 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.253232 11941 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:44.249405 11913 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:44.253415 11964 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:44.301074  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:44.259968 11735 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:44.328034  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 99664us
I20260709 12:22:44.292049 11956 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:44.288921 11892 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:44.306695 11972 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:44.332142  8070 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:44.332644  8757 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:44.341914  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.334877  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:44.301316 11545 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:44.329648  8214 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:44.357873  8212 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:44.341671  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.330308 11899 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:44.341400  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 49033.3us
I20260709 12:22:44.363598  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:44.331542 11735 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:44.360952  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.372195  8062 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.301406 11949 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.369298  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.354094  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:44.375561  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.338167 11941 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:44.385749  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 299025us
I20260709 12:22:44.388347  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.391162  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:44.394704  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.348551 11956 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.342720 11902 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:22:44.385895  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.402375  8067 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.371840 11723 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:44.404562  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:44.409729  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47598.8us
I20260709 12:22:44.392737 11824 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:44.398687 11950 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:44.401013 11843 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:44.439544 11843 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.440459 11843 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.397223 11924 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:44.442656 11924 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.435427 11950 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.436496 11909 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.438443 11721 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:44.453399  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.467401  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.469383  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.470748  8068 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:44.471226  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:44.471593  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67121.2us
I20260709 12:22:44.471926  8069 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:44.472314  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:44.474725  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.475363  8069 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.454118  8062 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.365536 11886 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.458897 11869 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.460738 11907 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:44.480091  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.505738  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.506386  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.443079 11924 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.485750 11941 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.491755 11882 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.495555 11503 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:22:44.508208  8070 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:44.485340 11949 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.511312  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:44.408546 11545 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.516455  8762 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:44.518186  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.412781 11824 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:44.418853 11931 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:44.558691  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 86437.3us
I20260709 12:22:44.561937  8070 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:44.561887  8212 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 5.
I20260709 12:22:44.550626  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.566542  8069 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.569489  8217 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:44.570886  8213 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:44.572492 11900 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:44.573458 11900 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:44.574637 11903 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:44.575178 11903 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.573419 11545 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.576081  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.577358  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.580381  8218 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:44.582130 11888 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:44.583835  8215 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:44.590140  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:44.564241  8070 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.592998  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.593704  8220 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.519845 11700 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:44.562969 11824 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:44.604379  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 94663.1us
I20260709 12:22:44.611670  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:44.560454 11803 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:44.609519  8217 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.606871  8070 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:44.609915  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.618880  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:44.619794  8063 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:22:44.620976  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.631788  8067 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:44.638525  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 246461us
I20260709 12:22:44.520569 11934 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:22:44.648475  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.649475  8218 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:44.649595 11903 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.650555  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.650811  8219 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:44.651065 11903 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.651851  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.652014  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.652886  8218 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
I20260709 12:22:44.653977  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:44.644973  8220 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:44.667371  8212 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:44.674229  8217 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:44.688393  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.690096  8220 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.591306 11882 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.692934  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.655709 11146 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:44.764073  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62068.7us
W20260709 12:22:44.772724  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.803638  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:44.803956  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.787076  8220 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:44.801484  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:44.801930  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.655507 11803 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:44.674821 11826 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:44.689013 11937 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.001s
I20260709 12:22:44.618047 11911 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:22:44.810788  8218 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:44.814457  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:44.621752 11700 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:44.813309  8035 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.517s (SENT)
I20260709 12:22:44.610339 11956 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.838619  8212 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:44.847502 11843 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:44.849326 11886 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:44.850150 11886 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:44.850777 11886 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.858573  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 870) took 1186 ms. Trace:
I20260709 12:22:44.859041  8763 rpcz_store.cc:276] 0709 12:22:43.671765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.051104 (+379339us) service_pool.cc:224] Handling call
0709 12:22:44.051487 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.051871 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.051902 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.052385 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.361111 (+308726us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:44.361151 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.361214 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.858272 (+497058us) raft_consensus.cc:1685] finished
0709 12:22:44.858305 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.858485 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":269,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":286308,"threads_started":1,"wal-append.queue_time_us":593531}
I20260709 12:22:44.868453 11700 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:44.869589 11803 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:44.819274 11946 raft_consensus.cc:2764] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:44.823925 11913 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:44.890141  8218 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:44.688578 11950 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.811285 11734 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:22:44.884905 11826 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:44.926088  8064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.033s	sys 0.038s
I20260709 12:22:44.890753 11913 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:44.827601 11937 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:44.928071  8064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.033s	sys 0.038s
W20260709 12:22:44.934803  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 323251us
I20260709 12:22:44.937458  8212 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:44.938242  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:44.934501 11892 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:44.956439  8217 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:44.964612  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.965653  8217 raft_consensus.cc:2368] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10.
W20260709 12:22:44.956352 11778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.015s	sys 0.028s
I20260709 12:22:44.976523  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:45.003064 11778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.015s	sys 0.029s
I20260709 12:22:45.002789  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:44.985463  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.003755  8217 raft_consensus.cc:2376] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10. Re-sending same reply.
I20260709 12:22:45.000382  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:44.955875 11983 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:45.022760  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.937029 11826 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:44.956297 11892 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:45.033386  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.034740  8217 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
W20260709 12:22:45.033178  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 465543us
I20260709 12:22:45.038918  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.039703  8218 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:45.045400  8763 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.051560 11886 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.053190 11937 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.024188 11983 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:45.034557 11892 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:45.068748 11700 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.069360 11700 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.071693 11700 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.072497 11826 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:45.075134 11694 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.782s	user 0.013s	sys 0.001s
W20260709 12:22:45.054652 11735 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.004s
I20260709 12:22:45.076100 11735 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.078765 11735 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.026417 11913 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.080724  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.080668 11983 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.041232 11545 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:45.082075 11983 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.082183  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:45.083303 11721 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.004s
I20260709 12:22:45.083438  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.085235  8218 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:45.086340  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:45.087546  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:45.094775  8218 raft_consensus.cc:2376] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9. Re-sending same reply.
I20260709 12:22:45.095790  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.097378  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.098656  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:45.099341  8213 raft_consensus.cc:2368] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
W20260709 12:22:45.099687 11907 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:22:45.103310 11503 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:45.103838 11503 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:45.061874  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:45.033303 11778 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.106035 11778 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.107816 11824 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.109126  8216 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:45.111183  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.112048  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.100471  8213 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:45.084614  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.121277  8063 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:45.122893  8070 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:45.124708  8763 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:45.096576  8218 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:45.120522 11902 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:45.114363 11924 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 12:22:45.108595 11778 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:45.125279 11899 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.008s
W20260709 12:22:45.160297  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.174234  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:45.172348 11921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.001s
I20260709 12:22:45.156071 11999 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:45.159268 11888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.016s
I20260709 12:22:45.156368 11649 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.175815 11899 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:45.187774 11931 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
I20260709 12:22:45.178613 11907 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.155822 11902 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:45.194626  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.013s
I20260709 12:22:45.181464 11735 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.158429 11924 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:45.192440 11888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.007s	sys 0.017s
W20260709 12:22:45.216589  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 375929us
I20260709 12:22:45.223991  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.226756  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:45.186812 11921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.013s	sys 0.001s
I20260709 12:22:45.143366 11503 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.262032  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:45.258211  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:45.214463  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.013s
W20260709 12:22:45.263919  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 657285us
I20260709 12:22:45.263903  8065 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:45.266150  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:45.221158 11931 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:45.270092  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.186395 11778 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:22:45.229852  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.216658 11999 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:45.275120  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.011s
W20260709 12:22:45.275805  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.003s	sys 0.011s
I20260709 12:22:45.230655 11734 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:45.281957  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52154.3us
I20260709 12:22:45.231065 11721 raft_consensus.cc:2764] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:45.285138  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.286201  8062 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:22:45.268181 12004 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.292053  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.293256  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.293751  8145 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:45.292793  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.294521  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.294687  8137 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:45.224351 11907 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.297559  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.215662 11649 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.300999  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:45.298790  8141 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:45.227172 11735 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.276065 12002 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.301074  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.285939 11734 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.287197 11694 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:45.338325  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.341148  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:45.314637  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.314728  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:45.315546  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.331611  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.344755  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.345801  8138 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:45.347672  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.349130  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.349506  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:45.350219  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.350728  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.351015  8139 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:45.359179  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 421007us
I20260709 12:22:45.305819 11899 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.361896  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.314776 11996 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.339213 11734 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.378357  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.379155  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.396772  8138 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.379273  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:45.381687  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.314016 12003 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.340844 11824 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.351658 11931 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:45.424055  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62279.8us
W20260709 12:22:45.434798  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.435600  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56405.8us
I20260709 12:22:45.359225 11999 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.357863 11694 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:45.440965  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:45.460322  8065 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 7: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:45.313038 12004 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:45.463359  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 214204us
W20260709 12:22:45.463940  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.464789  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:45.466507  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.472285  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.446652  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.447949  8069 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:45.367203 11545 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.460595 12007 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:45.449347 11999 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.369377 12002 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.477669 11694 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.527974  8145 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:22:45.384707 11899 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.505959  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.474583  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.425781 12009 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:45.471096 11998 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:22:45.439785 11931 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:45.507069  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:45.579335  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.480726  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:45.521791 12017 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:45.522253 11997 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:22:45.544286 11902 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:45.545965  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 99395.9us
I20260709 12:22:45.509394 12015 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:45.549850  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.563297  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:45.544991 11992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.021s	sys 0.037s
I20260709 12:22:45.531940 11924 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.574576  8138 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:45.580428  8213 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:45.580468  8145 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:45.433385 12003 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.572896 11999 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.569952 11784 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.570508 11824 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:45.580740  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 106275us
I20260709 12:22:45.588214  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.589324  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.535907  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet aa46cdee469046e0a85f4a03d2e03f92 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49226
I20260709 12:22:45.547740 11545 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.419447 11996 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.598467  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.605196  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.605432  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.588150 11907 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:45.599562  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.582798 11931 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:45.588958 11992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.022s	sys 0.037s
I20260709 12:22:45.581995 11909 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:45.602806  8140 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:45.584827  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.592005 12009 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.619663 12009 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:45.620432  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.607039 11649 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.622677 12009 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:45.622898 12019 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:22:45.598829  8217 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:22:45.590376 12010 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.607138 12008 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:45.623572 12010 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.617666 12014 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:45.625033 12014 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:45.625897 12010 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.591779 11826 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:22:45.614687  8139 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.629689  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.610707 11612 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:45.613181 11735 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.620345 12003 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.626874  8145 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.611474  8218 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:45.599293 12015 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:45.615008 11907 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:45.586932 12017 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.600385 11784 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.630650  8138 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:45.646754 11545 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.629222 11824 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:45.649899  8218 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:45.662742  8145 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:45.666224  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 668) took 1148 ms. Trace:
I20260709 12:22:45.638890 11612 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:45.666745  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.667773  8220 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:22:45.677568  8139 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:45.671021  8214 rpcz_store.cc:276] 0709 12:22:44.518124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.519433 (+  1309us) service_pool.cc:224] Handling call
0709 12:22:44.578656 (+ 59223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.579116 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:44.579427 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 12:22:45.427786 (+848359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.451177 (+ 23391us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.451380 (+   203us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:45.451445 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.451543 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.666014 (+214471us) raft_consensus.cc:1685] finished
0709 12:22:45.666033 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.666166 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3356,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":312324,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":17260,"thread_start_us":846557,"threads_started":2,"wal-append.queue_time_us":546631}
I20260709 12:22:45.679713 12006 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.654912 11907 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.688853 12006 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.690275 12017 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:45.626255 12014 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.691228 12006 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:45.681743 11892 consensus_meta.cc:287] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.006s
I20260709 12:22:45.692036 11892 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.693485 11996 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.694085 11892 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.682719  8218 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:45.656981 12004 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.697989 11914 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:45.698254 12012 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:22:45.700508 12027 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:45.708037 11899 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.708848 12015 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.681216 11612 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.713833 12002 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:45.719800  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.698446 11914 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:45.690322 11907 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.729410 12030 tablet_replica.cc:333] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:22:45.729413 11784 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:45.750734 11983 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.006s
I20260709 12:22:45.752103  8070 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:22:45.752615  8070 pending_rounds.cc:85] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 5
I20260709 12:22:45.752956  8070 pending_rounds.cc:107] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:22:45.753276  8070 raft_consensus.cc:2889] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:45.754426 11914 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.759536 11882 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.761602  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 672) took 1211 ms. Trace:
I20260709 12:22:45.764424  8211 rpcz_store.cc:276] 0709 12:22:44.550152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.550313 (+   161us) service_pool.cc:224] Handling call
0709 12:22:45.761264 (+1210951us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540016add4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:45.761466 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008309120}
I20260709 12:22:45.766111  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1670) took 1116 ms. Trace:
I20260709 12:22:45.766533  8220 rpcz_store.cc:276] 0709 12:22:44.649902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.817795 (+167893us) service_pool.cc:224] Handling call
0709 12:22:45.667415 (+849620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:45.676889 (+  9474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.765914 (+ 89025us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400133b50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:45.766050 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952451968}
I20260709 12:22:45.768185  8138 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:45.772020  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.771884  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 869) took 2100 ms (client timeout 1577 ms). Trace:
W20260709 12:22:45.773350  8762 rpcz_store.cc:269] 0709 12:22:43.671404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.800044 (+128640us) service_pool.cc:224] Handling call
0709 12:22:45.771631 (+1971587us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54007170d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:45.771785 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465692544}
I20260709 12:22:45.782073  8145 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:45.786790  8145 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:45.788923  8145 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:22:45.775274 11950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.001s	sys 0.012s
I20260709 12:22:45.805739  8144 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:45.807969  8144 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:45.810305 11886 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:45.810746 11886 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:45.792073 12002 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:45.798276 11950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.001s	sys 0.013s
I20260709 12:22:45.799242 11914 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.821947 11980 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.824247 11734 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.833640 11612 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.841905  8143 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:45.842267 12002 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.848181 11612 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.848276 11980 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:45.850746  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.851208  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.850121 11792 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.852599 11792 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.853077 12002 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.857721 11792 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:45.858058 11734 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.832604 11931 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:45.865612  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.870136 11913 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.865147 11999 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.874763 11999 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:45.875952 11990 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.951s	user 0.000s	sys 0.010s
I20260709 12:22:45.877790  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 555) took 1661 ms. Trace:
I20260709 12:22:45.878140  8756 rpcz_store.cc:276] 0709 12:22:44.216493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.216676 (+   183us) service_pool.cc:224] Handling call
0709 12:22:44.217190 (+   514us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:44.217764 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.217807 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:44.218884 (+  1077us) log.cc:844] Serialized 52 byte log entry
0709 12:22:44.353248 (+134364us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:44.374985 (+ 21737us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.375256 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.375351 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.875333 (+1499982us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:45.877460 (+  2127us) raft_consensus.cc:1685] finished
0709 12:22:45.877562 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.877712 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32209,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":29954,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7976,"spinlock_wait_cycles":5586176,"thread_start_us":133907,"threads_started":1,"wal-append.queue_time_us":610342}
I20260709 12:22:45.882038 11931 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:45.883041 11980 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:45.885329  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 288102us
I20260709 12:22:45.887820 12010 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:45.888882 12011 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.889510 12011 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.890792 12010 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.891292 12010 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.891963 12011 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.892545  8137 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:45.892784 11909 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:45.893739 11909 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.895704 11886 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.896881 11886 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:45.898285  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.898384  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.902014  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.902194  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:45.903558  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:45.905452  8144 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:45.909701  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.910610  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.910905  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.911230  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.910614  8070 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:45.912364  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.913172  8070 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:45.915004  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:45.917155  8065 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:45.917551  8065 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:45.918949  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:45.920264  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:45.919888 11882 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.924266 12010 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:45.924173 11882 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:45.925685 11993 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.875s	user 0.002s	sys 0.007s
I20260709 12:22:45.916039 12003 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.929420  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.930650 11584 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:22:45.931273 11972 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:45.931726 11972 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:45.930372  8145 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:45.905261 11734 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.914562 11902 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.937081  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 594) took 1561 ms. Trace:
I20260709 12:22:45.927518  8065 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.935920  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.938475  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.943368  8065 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.943217  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.944185  8145 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:45.918536 11999 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:45.921270 12002 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:45.918004 11931 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:45.958043  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.941816  8064 rpcz_store.cc:276] 0709 12:22:44.375699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.375868 (+   169us) service_pool.cc:224] Handling call
0709 12:22:44.376217 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.376540 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.376565 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.377054 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.931164 (+554110us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:44.931216 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.931297 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.925010 (+993713us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:45.933526 (+  8516us) raft_consensus.cc:1685] finished
0709 12:22:45.933549 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.937012 (+  3463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1208,"raft.queue_time_us":29910,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3875,"spinlock_wait_cycles":106712832,"thread_start_us":521932,"threads_started":1,"wal-append.queue_time_us":652116}
I20260709 12:22:45.961869  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.922443 12014 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:22:45.964756  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.933344 11965 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.971180 11965 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.967947 11804 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:45.972927 11804 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.934424 11913 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:45.975437 11804 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:45.968269 11700 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.967826 11792 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:45.969393  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:45.976666 11792 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.977260 11792 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.976660 11700 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.948553 11734 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.939157 11972 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.985117  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 669) took 1466 ms. Trace:
I20260709 12:22:45.985530  8216 rpcz_store.cc:276] 0709 12:22:44.518459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.564040 (+ 45581us) service_pool.cc:224] Handling call
0709 12:22:44.580195 (+ 16155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.111068 (+530873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.984878 (+873810us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54000cdfd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:45.985053 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215986432}
I20260709 12:22:45.988929  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.990985 12002 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:45.938027 12003 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.992082 12002 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.948918 11902 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:45.958840 11826 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:45.994927 11826 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:45.996979 11882 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:45.967803 11950 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:45.989602  8141 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:46.001027  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:46.001624  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:46.002492  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.966593 12037 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:46.003595 12037 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.006387  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:46.007329 11965 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.007627 11931 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:46.008733 12003 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.008795 11931 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:45.972949  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:46.004346  8144 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:46.008081 11965 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:46.010246  8061 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:45.984536  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:45.980347 11700 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.005894 12037 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.053511  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:45.951376 11728 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:45.932873 11907 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:22:46.057305  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:46.059705  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53411.8us
I20260709 12:22:45.997435 11826 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.054548  8145 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:45.995916 11902 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.068430  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:45.966620 11999 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:46.087546  8212 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:46.088055  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.087675 11999 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.090646  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.091578  8217 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.061725 11728 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.092491 11728 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.051311 11612 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:46.098627 11612 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:46.099571 11612 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.100778 11612 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:46.102918 11792 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:46.069051  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.009469 11931 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:46.068960  8145 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:46.077428 12030 raft_consensus.cc:2243] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.079638 11826 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:46.080699 11584 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.052606 11734 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.112609  8066 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:46.140264  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.134708  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:46.116554  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.124099  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.125602  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:46.130507  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.024379 11965 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:46.122180  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.121205  8065 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:22:46.138537  8070 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:46.134816  8062 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:46.139603  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.149956  8068 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:46.138062  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 126327us
I20260709 12:22:46.142863  8064 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:46.141873  8213 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:46.144426  8215 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:46.146654  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:46.152022  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.152294  8145 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.147408  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.153524  8219 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:46.154441  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.156394  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.121603 11934 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:46.158979  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.159124  8070 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:46.160293  8140 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:46.169486  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.188246  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:46.192729  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.163440  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:46.197389  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.155004  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2867410580001888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 12:22:46.140349 11584 consensus_queue.cc:1243] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:22:46.202657  8035 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.519s (SENT)
I20260709 12:22:46.208487  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.205844  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:46.203140  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.133832 12014 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.210225  8763 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:46.206529  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.203892  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:46.214893  8756 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:46.204965  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.205178  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.133303 11792 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.206511  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.147081 11886 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.207275  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.217240  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.217876 11886 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.218585  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.219151  8219 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:46.219146  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.220109 11886 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:46.222620  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.223434  8035 connection.cc:256] RPC call timeout handler was delayed by -1.1532050860000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:22:46.224875 11946 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:46.226866 11946 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:46.227591 11946 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.228870 11983 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:46.229710 11983 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.231551 11728 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.232713 11931 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.233935 11931 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.155947 11924 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:22:46.156118 11734 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:46.238186 12030 raft_consensus.cc:2272] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.156910 11914 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.239590 11914 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.241604 11804 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:46.241998 11804 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:46.242807 11804 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.243975 11804 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.244957 12029 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:46.245782 12029 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.248778 12014 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.250909 12014 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.137867 11826 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:46.251549 11826 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:46.253064  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:46.253898  8764 raft_consensus.cc:2376] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8. Re-sending same reply.
I20260709 12:22:46.255263  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.257658  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:46.258569  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.260251  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.261538  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.262101  8218 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.227600 11980 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:46.265381  8067 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:46.216439  8213 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:46.149466 11723 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.151166 11965 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.269093  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.278127  8145 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:46.280113  8145 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:46.164394  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.162228  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.285804  8217 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:46.290608  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.291460  8211 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:46.292017  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.292804  8763 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:46.294790  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.297163  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.297380  8763 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:46.297740  8759 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:46.298442  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.298507  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.299629  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.300484  8762 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:46.302803  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.304231  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:22:46.306092  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.307840  8757 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:46.310011  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.310678  8220 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.152441 11928 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:46.206560 12008 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:22:46.206938 11934 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.360087  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:46.324263  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.330391  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1740) took 1027 ms. Trace:
I20260709 12:22:46.361832  8211 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:46.361730  8138 rpcz_store.cc:276] 0709 12:22:45.302664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.674825 (+372161us) service_pool.cc:224] Handling call
0709 12:22:45.767967 (+ 93142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.768616 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.330210 (+561594us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b54002f1050. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:46.330333 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213473024}
I20260709 12:22:46.333937  8144 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:46.343113 11503 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.345587  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1738) took 1043 ms. Trace:
I20260709 12:22:46.346535 12030 ts_tablet_manager.cc:1916] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:46.301607 11886 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.349493  8065 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:46.354740  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.378104  8216 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:46.356839  8764 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:46.299213 11734 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:46.302613 12015 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.365715  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:46.369061  8218 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:46.369786  8142 rpcz_store.cc:276] 0709 12:22:45.302117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.313062 (+ 10945us) service_pool.cc:224] Handling call
0709 12:22:45.941712 (+628650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.941906 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.941931 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:45.941976 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:45.942011 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.942064 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.345391 (+403327us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400254c50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:46.345523 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353165056}
I20260709 12:22:46.351008 12029 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.271798 11980 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.406595  8211 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:46.411103  8144 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:46.393007  8220 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:46.325289 11928 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.376425 11983 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.407959 12008 consensus_queue.cc:1243] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:46.418367 11723 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:46.453045 11723 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.453526 11723 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:46.458287  8220 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:46.466635 11723 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.469880  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:46.470569  8063 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.472360  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.472961  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:46.473325  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.417809 12014 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.473884  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.474699  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.477061  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.482597  8062 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:46.482991  8764 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:46.479727  8069 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:46.480135  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.408699 11886 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.491233  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.489545  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.490510  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:46.493607  8220 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:46.492511  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:46.412925 12015 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.504772  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.508580  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.509903  8218 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:46.508195  8220 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.506182  8063 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 6.
I20260709 12:22:46.513863  8214 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:22:46.453061 12029 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:46.451391 12013 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:22:46.516238  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.525558  7956 maintenance_manager.cc:419] P d9f88eae4422483fae5be30b0540c616: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033383
I20260709 12:22:46.505478 11728 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.527673  8220 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
W20260709 12:22:46.528411  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81169.5us
I20260709 12:22:46.487555 12014 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.558022  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:46.559437  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:46.560305  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.561054 11723 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.561766 11723 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:46.561982 11972 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:46.562281 11723 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:46.563265 11723 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.564577 11914 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.565228 11914 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:46.565596 11914 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.565956 11914 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.568045 11901 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.568910  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.568704 11901 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.569551  8219 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:46.571189 11901 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.526515 12029 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.575201 11946 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.575750 11946 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:46.581419 11869 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.582012 11869 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.583130  8765 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:46.560487  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:46.586995 11792 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:46.587538 11792 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:46.588465 11792 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.526508 12046 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:22:46.590296 12046 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:46.590687 12046 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:46.591579 12046 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.522893 11734 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 12:22:46.593652  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.523875 11934 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.598130 12015 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.504021 11694 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:46.603258  8756 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:22:46.523597 11983 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:22:46.618499 11826 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.619742  8061 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:46.621447 11694 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:46.621873 11694 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:46.621975 12008 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:46.622457 12008 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:46.599462  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:46.596333 11965 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.623430 12014 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.684419 11934 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:46.622700 11694 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.731325 11934 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.731974 12013 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:46.725852 11980 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.623791  8064 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:46.668851  8213 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:22:46.746730  8213 pending_rounds.cc:85] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 9
I20260709 12:22:46.747539  8213 pending_rounds.cc:107] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:22:46.748463  8213 raft_consensus.cc:2889] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:46.730479  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 137829us
I20260709 12:22:46.741688 11804 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:46.750825 11804 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:46.751770 11804 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.757807 11892 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:46.758131 11965 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.758261 11892 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:46.728879 12046 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.759171 11892 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:46.760941 11928 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.729700 11826 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:46.725668  8761 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:46.623376 12008 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:46.766913  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.767863  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.767360  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.769363  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1631) took 1460 ms. Trace:
W20260709 12:22:46.772215  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 252545us
I20260709 12:22:46.769833  8139 rpcz_store.cc:276] 0709 12:22:45.309190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.768167 (+458977us) service_pool.cc:224] Handling call
0709 12:22:45.768491 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:45.895518 (+127027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.895552 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.896062 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.942889 (+ 46827us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:45.957986 (+ 15097us) log.cc:844] Serialized 14 byte log entry
0709 12:22:46.548192 (+590206us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b180045d120. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:46.768923 (+220731us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b180045d120. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:22:46.769077 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.769143 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.769180 (+    37us) raft_consensus.cc:1685] finished
0709 12:22:46.769193 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.769308 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137322,"prepare.queue_time_us":15486,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":127747,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":249,"spinlock_wait_cycles":130416896,"thread_start_us":46456,"threads_started":1,"wal-append.queue_time_us":71401}
W20260709 12:22:46.780323  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 810951us
I20260709 12:22:46.781147  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:46.782307  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:46.784255  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55855.3us
I20260709 12:22:46.774328 11892 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.784924  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.833562  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:46.834311  8212 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:46.772497 12055 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:46.838161  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:46.773020 11728 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.838883  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59595.4us
W20260709 12:22:46.839655  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 711282us
W20260709 12:22:46.831621  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46774.9us
I20260709 12:22:46.777084 12008 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.851999  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:46.853081  8139 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:46.855022  8035 leader_election.cc:400] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10.
I20260709 12:22:46.855479  8035 leader_election.cc:403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:46.858796  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:46.878955  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.887035 11956 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:46.890273 11983 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:46.891320 12049 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10.
I20260709 12:22:46.895622 11869 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.897205 11728 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.900234 11728 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:46.785377 11900 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:46.778149 11913 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:46.833326 12010 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:46.776263 11931 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:46.847662  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1622) took 1548 ms. Trace:
I20260709 12:22:47.009794  8212 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:46.907750 11950 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.841298  8214 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:46.913805 11934 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.991405 11609 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:46.837302 12014 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:22:46.921841 12055 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.772215 11914 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:46.926362 11999 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:46.931146  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88735us
I20260709 12:22:46.974327  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:47.027292  8143 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.975184  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:46.975482  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96609.6us
I20260709 12:22:47.028100  8138 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:47.028319  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:46.978524 12016 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:22:46.927788 12059 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.247s	user 0.002s	sys 0.002s
I20260709 12:22:46.998469  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.005566  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:46.907055  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 124819us
I20260709 12:22:47.037115  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:47.008683  8146 rpcz_store.cc:276] 0709 12:22:45.299532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.299666 (+   134us) service_pool.cc:224] Handling call
0709 12:22:45.743067 (+443401us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:22:45.743268 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:45.893894 (+150626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.893930 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:45.894550 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.961834 (+ 67284us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:46.064308 (+102474us) log.cc:844] Serialized 14 byte log entry
0709 12:22:46.832044 (+767736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.832118 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:46.832160 (+    42us) raft_consensus.cc:1685] finished
0709 12:22:46.847449 (+ 15289us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:46.847600 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":927052,"prepare.queue_time_us":28224,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":919149,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":88941,"spinlock_wait_cycles":3537152,"thread_start_us":157464,"threads_started":2,"wal-append.queue_time_us":313143}
I20260709 12:22:47.035967  8219 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:47.060165 12058 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:22:47.048837 11799 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:47.060823 11799 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.061275 11799 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.061439 12000 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.061990 12000 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.064103 12000 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:46.979202 12049 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:46.986014 11900 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.979141  8142 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:47.032869  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:47.072058  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.034054 12055 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.035223  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.035251  8217 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:47.048585 12022 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:47.066356  8143 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
W20260709 12:22:47.076476  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.080670  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45536.8us
I20260709 12:22:47.082437  8035 leader_election.cc:400] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
W20260709 12:22:47.087929  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.020754 11931 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.048964 11921 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:22:47.092876  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:47.104240  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.104759  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.105650  8143 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:47.107472  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.108210  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:47.101174  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.032s	sys 0.029s
W20260709 12:22:47.108927  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.032s	sys 0.030s
I20260709 12:22:47.109331  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.106809  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.111999  8142 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:22:47.101482  8070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.023s	sys 0.032s
W20260709 12:22:47.112942  8070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.023s	sys 0.032s
I20260709 12:22:47.093693  8035 leader_election.cc:403] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.970871  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.115782  8139 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:47.118257  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:47.021494  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 505257us
I20260709 12:22:47.120503  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.120913  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.121944  8139 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:47.123157  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.123983  8063 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:47.129927  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.133677  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.134924  8065 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:22:47.109362  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 573730us
I20260709 12:22:47.141884  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:47.142649  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60392.4us
I20260709 12:22:47.143316  8066 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:22:47.143406  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:47.119894  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:47.144774  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:47.150296  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.145401  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.080821 11900 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.156865  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.157200  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.157692  8067 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:47.081643 11909 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.161911  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:47.164965  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.165746  8139 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:47.090355 12056 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:47.167970  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45143.3us
I20260709 12:22:47.169685  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.171756  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.093216 12000 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.099753 11931 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.070830 11956 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:22:47.141538 11921 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.149058 12022 raft_consensus.cc:2764] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:22:47.093995 12060 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:47.094626 11609 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:22:47.187363  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.156767 11728 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:47.159369 11972 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:47.198148  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.201140  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.091012 12003 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:22:47.173437 12014 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.172923 12013 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
I20260709 12:22:47.199549 11735 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.189855 12011 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.158690 11934 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:22:47.227898  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 54181.2us
I20260709 12:22:47.235373  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:47.222656  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72928.3us
I20260709 12:22:47.206422 12000 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:47.096799 11913 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:47.238867  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.191653 11931 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.180884 11980 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:47.211601 11972 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.245177  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:47.253940  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.255591  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.178014 11928 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:47.185385 11826 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:22:47.192438 11700 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:22:47.174425 11909 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.243840 12049 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.231791 11728 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:47.262482  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:47.307117  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 49524.4us
I20260709 12:22:47.234378 12060 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:47.257128 12046 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.236938 12030 ts_tablet_manager.cc:1929] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:22:47.258159 11972 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.260830 11983 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.233142 11799 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.237794 12011 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.306728 12014 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:47.342880 11735 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.256860 11931 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.344240 11843 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:47.362900  8139 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:22:47.261297 11792 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 12:22:47.306614 12061 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.402084 11694 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.338611 12055 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:22:47.396914 11784 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:47.394587 12030 log.cc:1199] T aa46cdee469046e0a85f4a03d2e03f92 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/aa46cdee469046e0a85f4a03d2e03f92
W20260709 12:22:47.418687  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 342142us
I20260709 12:22:47.350665 12049 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.403141 12003 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:47.436575  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 261313us
I20260709 12:22:47.365329 12046 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.461062  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:47.513309  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52403.7us
I20260709 12:22:47.417675 11964 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.403147 11886 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.515129  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:47.547616  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 375915us
I20260709 12:22:47.551282  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:47.549571  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.409241 11735 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:47.433449 11928 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.568948  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.572995 12066 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.573190 12013 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.573593 12066 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.574086 12013 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.575990 12066 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.576610 12022 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.576910 12013 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.577205 12022 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.579550 12022 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.438468 11728 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.566808 12000 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:22:47.586692  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 709) took 1488 ms. Trace:
I20260709 12:22:47.589383  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.593762  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.596741  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:47.587229  8145 rpcz_store.cc:276] 0709 12:22:46.098409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.293638 (+195229us) service_pool.cc:224] Handling call
0709 12:22:46.293890 (+   252us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:46.970707 (+676817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.970741 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:47.006893 (+ 36152us) log.cc:844] Serialized 52 byte log entry
0709 12:22:47.230777 (+223884us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:47.230831 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.230922 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.586333 (+355411us) raft_consensus.cc:1685] finished
0709 12:22:47.586375 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.586581 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554823,"raft.queue_time_us":594609,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":175761,"threads_started":1,"wal-append.queue_time_us":523685}
I20260709 12:22:47.537366 11999 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.538909 11869 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:47.603315  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:47.607151  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 406072us
I20260709 12:22:47.609452  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.609776  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.613265  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.567028 11723 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:47.618643  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.569947 11864 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:47.516523 12003 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.633088 11612 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:47.633595 11612 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:47.633814 12030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49226 (request call id 88) took 2440 ms. Trace:
I20260709 12:22:47.549012 11964 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.605927 11886 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:47.579586 12066 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.605747 12013 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.616376 11891 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:47.649143 11891 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.649554 11891 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.618643 11869 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.650878 11869 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.651825  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1751) took 1702 ms. Trace:
I20260709 12:22:47.624840 11723 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.652583 11723 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:47.652967 12013 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.652707 11612 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.654382 11612 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.652235  8140 rpcz_store.cc:276] 0709 12:22:45.949149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.195662 (+246513us) service_pool.cc:224] Handling call
0709 12:22:46.195968 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:46.971693 (+775725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.971742 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:46.987191 (+ 15449us) log.cc:844] Serialized 26 byte log entry
0709 12:22:47.238725 (+251534us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:47.238764 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.238828 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.651605 (+412777us) raft_consensus.cc:1685] finished
0709 12:22:47.651629 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.651767 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":787984,"raft.queue_time_us":775939,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16717,"thread_start_us":194505,"threads_started":1,"wal-append.queue_time_us":549306}
I20260709 12:22:47.660830 11609 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:47.661556 11609 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:47.661899 11609 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:47.662230 11609 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.665782  8146 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:47.666620 11931 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.668207 11964 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.625538 11864 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.570379 11735 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.677222 11735 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.673074 12056 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.677912 12056 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.680236 12056 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.682942  8760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "767edb8a304f440591a33aae36a36252"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:47.684696 12049 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.636766 12030 rpcz_store.cc:276] 0709 12:22:45.281779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.359012 (+ 77233us) service_pool.cc:224] Handling call
0709 12:22:45.728985 (+369973us) ts_tablet_manager.cc:1151] Deleting tablet aa46cdee469046e0a85f4a03d2e03f92
0709 12:22:45.729090 (+   105us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:46.760995 (+1031905us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:47.227998 (+467003us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:47.633722 (+405724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":325785,"tablet-delete.queue_time_us":124020,"thread_start_us":109109,"threads_started":1}
W20260709 12:22:47.688517 12067 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:47.630844 12072 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:22:47.555234 12060 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.693513  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1727) took 1434 ms. Trace:
I20260709 12:22:47.694026  8070 rpcz_store.cc:276] 0709 12:22:46.258809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.293462 (+ 34653us) service_pool.cc:224] Handling call
0709 12:22:46.293716 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.311870 (+ 18154us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:46.474416 (+162546us) log.cc:844] Serialized 14 byte log entry
0709 12:22:47.113922 (+639506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.113976 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:47.114039 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.693189 (+579150us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400348354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:47.693255 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.693424 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54686,"prepare.queue_time_us":205812,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":28578,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7478,"spinlock_wait_cycles":41325824,"thread_start_us":788150,"threads_started":2,"wal-append.queue_time_us":712046}
I20260709 12:22:47.696841 12000 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:47.697124 11799 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.699162 12003 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.700295 12011 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.692986 11864 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.645156 11843 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.704167 11843 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.706425 11843 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.708781 12046 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:47.711337 11892 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.864s	user 0.007s	sys 0.002s
I20260709 12:22:47.713917 12013 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.595362 11928 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.715054 11869 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.717483 11928 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:47.622305 11999 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.718335 11891 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.720021 11999 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:47.721974 12008 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.000s
W20260709 12:22:47.722091 12062 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.955s	user 0.005s	sys 0.009s
I20260709 12:22:47.723719  8068 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:47.723892 11869 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:47.724502 11609 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.725770 11864 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.726706 11609 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:47.731271 11950 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.003s
I20260709 12:22:47.717159 11723 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:47.728228 11900 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:22:47.728644 11784 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:47.727895 11864 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:47.738689  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 145004us
I20260709 12:22:47.739326  8145 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:47.731812 11950 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:47.742064 12066 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.748982  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.751585  8145 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:47.750571  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.753975  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:47.756559  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:47.759150  8760 raft_consensus.cc:606] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.759560  8760 raft_consensus.cc:614] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:47.760872  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.756160 11999 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.746930 11900 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.771982 11900 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.769129  8219 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:47.774025 11999 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:47.747675 11784 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.776666 12008 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:47.777093 12008 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.777447 12008 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.778092 12066 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.780748 11584 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:47.781332 11584 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:47.782301 11584 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.785779  8144 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:22:47.788069  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.788750 11928 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:47.789611 11928 consensus_queue.cc:1243] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:47.790292 11999 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:47.790697 11999 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:47.791628 11999 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.795334  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.795951  8144 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:47.797555  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.798094  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.798715  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.800734  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:47.793403 11999 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.802173  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:47.810823  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.021s	sys 0.017s
I20260709 12:22:47.805064  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:47.817955  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.039s	sys 0.042s
W20260709 12:22:47.818434  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.039s	sys 0.042s
I20260709 12:22:47.819000  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:47.815014  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.021s	sys 0.017s
I20260709 12:22:47.820158  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:47.819144  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 563626us
I20260709 12:22:47.827565  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.824333 11891 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.817842 12066 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:47.832589  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 214021us
I20260709 12:22:47.802879 11972 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.861481  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:47.865675  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.870703  8219 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
W20260709 12:22:47.876178  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 441758us
I20260709 12:22:47.868170  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:47.852685 11965 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.877480  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:47.882740  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.853055 11864 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:47.853353 11898 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:47.911022  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.898375  8219 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:22:47.914279  8219 pending_rounds.cc:85] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:22:47.914774  8219 pending_rounds.cc:107] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:22:47.915192  8219 raft_consensus.cc:2889] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:47.869695 12066 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.917354 12066 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.908010  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:47.909180  8217 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:47.920784  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.883294 12015 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:47.864926 11924 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.915961  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43490.3us
I20260709 12:22:47.928679  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:47.929278 12068 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 12:22:47.929912 11972 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:47.907121 11900 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:22:47.910390 12037 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:22:47.932524  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.966485  8756 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:47.967809  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.870991 12013 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:47.937772  8214 raft_consensus.cc:2376] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8. Re-sending same reply.
I20260709 12:22:47.932580 12011 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:47.980311  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.981232  8217 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:22:47.970912 11826 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.939330  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:47.955968  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.940028  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:47.938421  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 206175us
I20260709 12:22:47.989754  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:47.911710 11891 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.996459  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:47.967902 12014 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.006726  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.007623  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:47.969378  8756 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:47.971624  8219 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:47.924371  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:47.938112 12002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.015s	sys 0.028s
I20260709 12:22:48.014456  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:47.932765 11898 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:47.976861  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.977770  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.978330  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.978790  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:47.982312  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:47.983491  8141 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:47.882391 11950 raft_consensus.cc:2764] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:47.988440  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.988502  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:47.989400  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.990506  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:47.981805 12082 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:47.980520 12011 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:47.962148  8763 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:47.997145  8068 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.962028  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:48.042938  8216 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:47.991127 12013 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:47.967175 12055 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.011544  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:48.088407 11964 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:47.974924  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.977596  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:47.983765 11609 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:48.015475  8065 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:48.093741  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.094627  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.095467  8065 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:48.031471  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:48.037139  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 81411.4us
I20260709 12:22:48.036433  8064 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:48.037381  8062 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.933714 11965 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:47.985823 12060 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.926403 11864 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.043912  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.104089  8759 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:48.029847 12002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.015s	sys 0.029s
I20260709 12:22:48.046584  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:47.968779 11924 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.047226  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.109997  8067 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.053309  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:48.013891 11892 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.114264  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.114445 11892 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:48.086583  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1643) took 2152 ms. Trace:
I20260709 12:22:48.114976  8759 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
W20260709 12:22:48.115518 12092 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:48.116042  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.089895  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.116401  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.117273  8063 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:48.117507  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.118140  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.118450 11965 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:48.118758  8063 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:48.090456  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.091815  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:48.101210  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:48.009795 11972 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 12:22:48.046569 12011 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.997448 11826 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.106621 12060 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.145416 11898 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.104202  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:48.105255  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.013705 12046 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:22:48.107405  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.108250  8764 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:48.149550  8064 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:48.108798  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:48.112782  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:48.115077 11892 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.031811 12014 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.163246 12014 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.134831  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:48.121896  8213 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:48.163806 12008 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.100400  8068 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:48.168346  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.138087  8062 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:48.169006  8068 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:48.138866  8757 raft_consensus.cc:2368] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
I20260709 12:22:48.139078  8063 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:48.139863  8756 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:48.029603 11891 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:48.140540  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53966.4us
I20260709 12:22:48.115437  8137 rpcz_store.cc:276] 0709 12:22:45.934029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.085880 (+151851us) service_pool.cc:224] Handling call
0709 12:22:46.086408 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:46.838931 (+752523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.838979 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:46.847251 (+  8272us) log.cc:844] Serialized 26 byte log entry
0709 12:22:47.393753 (+546502us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:47.393814 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.393924 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.817542 (+423618us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:48.043101 (+225559us) raft_consensus.cc:1685] finished
0709 12:22:48.043132 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.086500 (+ 43368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":761794,"raft.queue_time_us":724402,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":78122,"spinlock_wait_cycles":7457536,"thread_start_us":492606,"threads_started":1,"wal-append.queue_time_us":686790}
I20260709 12:22:48.142138 12037 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:48.143507 12003 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:48.144003 12083 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:22:48.108057 12080 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:22:48.175161 12013 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.185122  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:48.189564  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.150671  8217 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:48.193120  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:48.151777  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:48.201679  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:48.156034 11898 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:48.161170 11864 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:48.165637  8213 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:48.155009  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.212602  8064 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:48.136018  8763 raft_consensus.cc:2368] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9.
I20260709 12:22:48.169552  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.172812  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:48.103036 12055 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.150295  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.203434  8758 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:22:48.204734  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53057.1us
I20260709 12:22:48.204463  8137 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:48.159219  8067 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:48.214502  8068 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:48.218200  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:48.219712  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.221397  8137 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:48.220486  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.220173  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.222079  8068 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:48.218080  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:48.217130  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:48.220085  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.223779  8063 raft_consensus.cc:2368] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
I20260709 12:22:48.223694  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:48.225078  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52374us
I20260709 12:22:48.175137 12037 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:48.178328 11826 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.206561 12096 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:48.241015 12055 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:48.207088 11612 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.242340 12008 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:48.230028 12002 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:48.242898 12060 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.244722  8067 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:48.236588 11694 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.245265  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:48.219156 12046 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:48.245324 11898 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:48.330885  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:48.261649  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:48.202733 11784 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.231901 12014 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:48.178277 12003 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.233122 11937 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:48.320003  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.335186  8067 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:48.336292  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.337057  8067 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:48.317144 11891 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.322202  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:48.340344  8143 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:48.253358 11612 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:48.227298 11864 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
W20260709 12:22:48.325466 11999 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 12:22:48.328011 11694 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:49.045383  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 714539us
I20260709 12:22:49.045997  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:48.716218 12093 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:22:49.046806  8061 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:48.739671  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1771) took 1304 ms. Trace:
I20260709 12:22:49.048110  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:48.341137 11907 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.708s
I20260709 12:22:49.049044 12118 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.497394 12100 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:22:48.503612  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
W20260709 12:22:49.049243  8729 connection.cc:256] RPC call timeout handler was delayed by -1.0609161630000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 12:22:49.051304  8758 raft_consensus.cc:606] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:49.051487 11792 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.491480 12014 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:49.052122 11792 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.052304 12014 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.680300 11700 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.053469 11700 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:49.054634  8729 connection.cc:256] RPC call timeout handler was delayed by -1.0523433530001967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:22:49.055263  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.504s (SENT) [suppressed 14 similar messages]
I20260709 12:22:49.055454 12014 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.084406 11792 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.062929 11694 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.088536 11909 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.048352  8140 rpcz_store.cc:276] 0709 12:22:47.434959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.660822 (+225863us) service_pool.cc:224] Handling call
0709 12:22:47.661086 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.671975 (+ 10889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.672034 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.672085 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:47.672123 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.739343 (+1067220us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400254c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:48.739412 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.739591 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24513280}
I20260709 12:22:49.096949  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:49.098874  8220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.003s	sys 0.008s
W20260709 12:22:49.099269  8220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.003s	sys 0.008s
I20260709 12:22:49.101821  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.102586  8140 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:49.103699  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.055763 11700 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.056418  8219 raft_consensus.cc:2410] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:22:48.759073 11902 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.680858 11914 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.056797 11723 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.113260  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:48.976792  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.740639 12003 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:48.455112  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:48.411954 12011 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.059007  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1781) took 1262 ms. Trace:
W20260709 12:22:49.043617 12066 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.083s	user 0.011s	sys 0.000s
I20260709 12:22:48.803016 11735 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:48.378381  8142 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:48.436458  8143 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:49.118566  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:49.056444 11784 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:48.475958 11609 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:48.381887  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
W20260709 12:22:49.122144  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66910.2us
I20260709 12:22:49.123292  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.123740  8137 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:48.803673  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:48.504455 11892 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.062155  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2862) took 1067 ms. Trace:
I20260709 12:22:48.477345  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.122148  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:48.371980 12095 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:49.119947 11999 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.129817 12095 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:49.130066 11964 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.130033 11999 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.130793 11964 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:48.390663 11612 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.135870 11964 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.049978 12118 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:49.136914  8138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1655) took 2007 ms (client timeout 1924 ms). Trace:
W20260709 12:22:49.137421  8138 rpcz_store.cc:269] 0709 12:22:47.129452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.153785 (+ 24333us) service_pool.cc:224] Handling call
0709 12:22:48.477076 (+1323291us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:49.136827 (+659751us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623744}
I20260709 12:22:49.138999 12118 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.139124  8138 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:48.794016  8139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1766) took 1550 ms (client timeout 1868 ms). Trace:
I20260709 12:22:49.065332  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:49.140740  8146 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:49.140300  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.065088  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.141803  8061 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:49.132385 11999 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:49.139717  8139 rpcz_store.cc:269] 0709 12:22:47.242699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.262159 (+ 19460us) service_pool.cc:224] Handling call
0709 12:22:48.790539 (+1528380us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:48.790729 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45933824}
W20260709 12:22:49.127753 12123 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:22:49.158241 11924 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.160409 11924 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:49.168260 11924 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:49.171093 12003 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:49.171895 12003 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.175089 12003 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.176350 11924 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.192437  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1638) took 3292 ms. Trace:
I20260709 12:22:49.193089  8141 rpcz_store.cc:276] 0709 12:22:45.899844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.002578 (+102734us) service_pool.cc:224] Handling call
0709 12:22:46.002864 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.033459 (+2030595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.192119 (+1158660us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540008edd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:49.192333 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4554597760}
I20260709 12:22:47.774354  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet aa46cdee469046e0a85f4a03d2e03f92 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
W20260709 12:22:49.199815  7953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.44092e+06us
I20260709 12:22:49.199968  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1718) took 1264 ms. Trace:
I20260709 12:22:49.200577  8215 rpcz_store.cc:276] 0709 12:22:47.935191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.935396 (+   205us) service_pool.cc:224] Handling call
0709 12:22:47.935805 (+   409us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:47.936311 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.936344 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:47.971410 (+ 35066us) log.cc:844] Serialized 78 byte log entry
0709 12:22:48.215536 (+244126us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:48.277913 (+ 62377us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.302486 (+ 24573us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.302896 (+   410us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.318291 (+ 15395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.318531 (+   240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.741440 (+422909us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b1800156880. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49919b5328 00007f49919ac901 00007f49919ac8a7 00007f4991aa4288 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508
0709 12:22:48.982357 (+240917us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800156880. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:49.166324 (+183967us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b1800156880. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:49.189692 (+ 23368us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800156880. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:49.193034 (+  3342us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b1800156880. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:22:49.199629 (+  6595us) raft_consensus.cc:1685] finished
0709 12:22:49.199667 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.199882 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21248,"prepare.queue_time_us":212190,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":121,"raft.queue_time_us":21215,"raft.run_cpu_time_us":10734,"raft.run_wall_time_us":449286,"spinlock_wait_cycles":127867904,"thread_start_us":218775,"threads_started":1,"wal-append.queue_time_us":342639}
I20260709 12:22:49.206053  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2908) took 1195 ms. Trace:
I20260709 12:22:49.206632  8219 rpcz_store.cc:276] 0709 12:22:48.010722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.014190 (+  3468us) service_pool.cc:224] Handling call
0709 12:22:49.205770 (+1191580us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540017ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:49.205961 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394105088}
I20260709 12:22:49.207221 11892 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:48.390679 11950 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:49.230298  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.231046  8061 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:49.231129  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.231753  8139 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:49.234454  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:48.376272 12029 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:49.028885 12109 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 12:22:49.060245 12013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.004s	sys 0.007s
I20260709 12:22:48.999056 12055 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.045435  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 800196us
W20260709 12:22:49.059978  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 809970us
I20260709 12:22:48.372287  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:49.107358  8062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.013s
I20260709 12:22:49.119367  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.092097  7967 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 6 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.116700  8144 rpcz_store.cc:276] 0709 12:22:47.796148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.987424 (+191276us) service_pool.cc:224] Handling call
0709 12:22:47.987730 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.088088 (+100358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.088122 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.088714 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.377913 (+289199us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:48.377990 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.378081 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.058817 (+680736us) raft_consensus.cc:1685] finished
0709 12:22:49.058837 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.058955 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60962,"raft.queue_time_us":145328,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9280,"thread_start_us":346264,"threads_started":2,"wal-append.queue_time_us":968454}
I20260709 12:22:49.119273  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.124459  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.125543  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.128538  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.127070  8064 rpcz_store.cc:276] 0709 12:22:47.994603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.225757 (+231154us) service_pool.cc:224] Handling call
0709 12:22:48.226041 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.230894 (+  4853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.230925 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.231372 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.332799 (+101427us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:48.332857 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.333061 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.061964 (+728903us) raft_consensus.cc:1685] finished
0709 12:22:49.061983 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.062101 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4491,"raft.queue_time_us":10728,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":100939,"threads_started":1,"wal-append.queue_time_us":829182}
I20260709 12:22:48.338994 12002 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:48.372197 12008 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:48.525511 12060 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.139655 11784 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:49.126863 11609 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:49.127275 11735 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.140877 12095 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:49.150854 12011 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:48.373689 12037 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.226833  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.236122  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.242933  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:48.461750 12046 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.250792  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:49.251978  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 147012us
I20260709 12:22:49.120692 11902 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.255025  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:49.126502 12066 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:49.192517 12111 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.680s	user 0.001s	sys 0.007s
I20260709 12:22:49.292781  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:49.375650  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:49.320281  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:49.402853  8062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.000s	sys 0.021s
I20260709 12:22:49.404309  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:49.425717  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:49.336468  8216 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:49.485141  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1738) took 1247 ms. Trace:
I20260709 12:22:49.486029  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.486785  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1746) took 1192 ms. Trace:
I20260709 12:22:49.294234  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:49.403414  8061 raft_consensus.cc:2368] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11.
I20260709 12:22:49.269353  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:49.260957  8214 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:49.413563  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 285047us
I20260709 12:22:49.255808  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:49.329013  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:49.490666  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:49.490471  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234722us
I20260709 12:22:49.426549  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:49.491724  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.491887  8212 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.489467  8219 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:49.486248  8069 rpcz_store.cc:276] 0709 12:22:48.237877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.250467 (+1012590us) service_pool.cc:224] Handling call
0709 12:22:49.485064 (+234597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.403414  8137 raft_consensus.cc:2410] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:49.403359  8067 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
W20260709 12:22:49.494894  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51304.6us
I20260709 12:22:49.328190  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:49.430172  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2903) took 1421 ms. Trace:
W20260709 12:22:49.425736  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 133114us
I20260709 12:22:49.495980  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:49.498224  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 262176us
I20260709 12:22:49.486739  8144 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:49.520892  8137 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:22:49.487429  8070 rpcz_store.cc:276] 0709 12:22:48.294058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.116398 (+822340us) service_pool.cc:224] Handling call
0709 12:22:49.486577 (+370179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.488718  8143 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:49.524559  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1745) took 1284 ms. Trace:
W20260709 12:22:49.499511  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 74026.8us
I20260709 12:22:49.329526  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2858) took 1336 ms. Trace:
I20260709 12:22:49.529350  8220 rpcz_store.cc:276] 0709 12:22:48.009172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.166738 (+157566us) service_pool.cc:224] Handling call
0709 12:22:48.167099 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.167548 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.167588 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.174042 (+  6454us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.099658 (+925616us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:49.099705 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.099776 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.429840 (+330064us) raft_consensus.cc:1685] finished
0709 12:22:49.429870 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.430089 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3638,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2728,"thread_start_us":848437,"threads_started":1,"wal-append.queue_time_us":933888}
I20260709 12:22:49.510440  8034 leader_election.cc:400] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9.
I20260709 12:22:49.527691  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2865) took 1498 ms. Trace:
I20260709 12:22:49.532027  8034 leader_election.cc:403] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:49.506126  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2863) took 1511 ms. Trace:
I20260709 12:22:49.532094  8069 rpcz_store.cc:276] 0709 12:22:48.030713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.526884 (+1496171us) service_pool.cc:224] Handling call
0709 12:22:49.527197 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.527386 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.527413 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.527456 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:49.527488 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.527540 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.527636 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.528784  8211 raft_consensus.cc:2410] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:49.525189  8067 rpcz_store.cc:276] 0709 12:22:48.240516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.371951 (+131435us) service_pool.cc:224] Handling call
0709 12:22:49.524477 (+1152526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.528487  8065 rpcz_store.cc:276] 0709 12:22:47.993504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.222808 (+229304us) service_pool.cc:224] Handling call
0709 12:22:48.223094 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.246117 (+ 23023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.246155 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.246656 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.514406 (+267750us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:48.514475 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.514594 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.329238 (+814644us) raft_consensus.cc:1685] finished
0709 12:22:49.329270 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.329444 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24402,"raft.queue_time_us":23557,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":29209,"spinlock_wait_cycles":1920,"thread_start_us":184835,"threads_started":1,"wal-append.queue_time_us":774286}
I20260709 12:22:49.533001  8062 rpcz_store.cc:276] 0709 12:22:47.994881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.226583 (+231702us) service_pool.cc:224] Handling call
0709 12:22:48.226877 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.227228 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.227258 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.247630 (+ 20372us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.486180 (+1238550us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:49.486225 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.486298 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.486345 (+    47us) raft_consensus.cc:1685] finished
0709 12:22:49.486356 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.506063 (+ 19707us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2886,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":13021,"thread_start_us":1176180,"threads_started":1,"wal-append.queue_time_us":828193}
I20260709 12:22:49.522837  8137 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:49.528105  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:22:49.542290  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.543035 11909 raft_consensus.cc:2764] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:49.256348 11999 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.346192 11723 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:49.289382 12029 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.553071  8066 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:49.321950 12013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.004s	sys 0.008s
W20260709 12:22:49.566121  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 75518.9us
I20260709 12:22:49.347890 11928 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.547701  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.529023 11784 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.527735 11700 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:49.559382  8062 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:49.289940 11964 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.291915 11892 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:49.487385 11864 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:49.561715  8217 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:22:49.528793 11913 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:49.486239 12008 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:49.573050 11928 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.581715 12013 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.527516 11934 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:49.528115 11946 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.575629  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1737) took 1338 ms. Trace:
I20260709 12:22:49.620666  8062 rpcz_store.cc:276] 0709 12:22:48.237456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.552644 (+1315188us) service_pool.cc:224] Handling call
0709 12:22:49.553029 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.575351 (+ 22322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.575566 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.621989  8062 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:22:49.622573  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1741) took 1383 ms. Trace:
I20260709 12:22:49.622898  8062 rpcz_store.cc:276] 0709 12:22:48.239027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.621476 (+1382449us) service_pool.cc:224] Handling call
0709 12:22:49.621765 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:49.622305 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.622522 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.624217  8062 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:49.528189 12014 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.564985  8212 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:49.577630  8068 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:49.578543  8109 leader_election.cc:400] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
W20260709 12:22:49.579559  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 613) took 1602 ms (client timeout 1550 ms). Trace:
I20260709 12:22:49.254725 11950 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:49.582581  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.552899 11804 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:49.549335 12077 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:49.584408  7967 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 1 to 6, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.573457 11909 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:49.488215 12046 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.556721 11723 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:49.573698 11999 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.527822 12079 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:22:49.609134  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1719) took 1670 ms. Trace:
I20260709 12:22:49.580838 11965 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:49.528925 12055 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.625639  8109 leader_election.cc:403] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:49.693153  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 118092us
I20260709 12:22:49.692863  7967 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 7 to 9, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 9 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.694141 12055 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.548617 12037 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:49.625787  8066 rpcz_store.cc:269] 0709 12:22:47.976797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.977339 (+   542us) service_pool.cc:224] Handling call
0709 12:22:49.579300 (+1601961us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:49.579472 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3333914880}
I20260709 12:22:49.696961 12011 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
I20260709 12:22:49.697518  8066 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:49.698201  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1747) took 1369 ms. Trace:
I20260709 12:22:49.698549  8066 rpcz_store.cc:276] 0709 12:22:48.329005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.696995 (+1367990us) service_pool.cc:224] Handling call
0709 12:22:49.697325 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.697946 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.698141 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.699568  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.609707 11843 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.630527 12013 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.700882 11843 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.701783  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.702551 12013 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.703009 11843 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.703405  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.643157  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1742) took 1387 ms. Trace:
I20260709 12:22:49.704380  8062 rpcz_store.cc:276] 0709 12:22:48.239374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.623789 (+1384415us) service_pool.cc:224] Handling call
0709 12:22:49.624071 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.624579 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.626241 (+  1662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.529225 12060 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.648751  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2860) took 1654 ms. Trace:
I20260709 12:22:49.602363 11913 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:49.614905 12008 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:49.569638 12029 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.600894  8145 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:49.654688 11924 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:49.616873 11864 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:49.674281  7966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 253) took 17382 ms (client timeout 15000 ms). Trace:
I20260709 12:22:49.583115 12130 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:22:49.586966 11964 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.676906  8218 rpcz_store.cc:276] 0709 12:22:47.938843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.965673 (+ 26830us) service_pool.cc:224] Handling call
0709 12:22:47.966067 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.972591 (+  6524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.972654 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.982188 (+  9534us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.207611 (+225423us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:48.207694 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.207883 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.608849 (+1400966us) raft_consensus.cc:1685] finished
0709 12:22:49.608881 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.609055 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14591,"raft.queue_time_us":6194,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":18378,"thread_start_us":167765,"threads_started":1,"wal-append.queue_time_us":482840}
I20260709 12:22:49.685843 11902 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.647318 12014 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.648528 12118 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:49.616195 11972 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:22:49.691388 11784 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:49.691325 11928 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.693529 11950 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.582482 12126 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:49.707592  8146 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 12:22:49.811578  8146 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:49.812160  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1787) took 1007 ms. Trace:
I20260709 12:22:49.812467  8146 rpcz_store.cc:276] 0709 12:22:48.804505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.065082 (+260577us) service_pool.cc:224] Handling call
0709 12:22:49.812102 (+747020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:49.648437 11909 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:49.705591  7967 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.680678 11965 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:49.675880 11804 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:49.704306 11999 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.748323 12003 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:49.749007 11924 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.708546  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:49.708731  8062 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:49.750586  8068 rpcz_store.cc:276] 0709 12:22:47.994029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.223091 (+229062us) service_pool.cc:224] Handling call
0709 12:22:48.255285 (+ 32194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.625328 (+1370043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.648468 (+ 23140us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000fcdd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:49.648690 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3040548608}
W20260709 12:22:49.760553  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 222862us
W20260709 12:22:49.744335  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 258475us
W20260709 12:22:49.765260  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 270914us
I20260709 12:22:49.643281 11946 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.801250 12157 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.708387 12079 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9.
I20260709 12:22:49.731935 11913 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:49.810755  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 555768us
I20260709 12:22:49.753398 12060 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.811496 12126 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.794308 12118 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.826151 12013 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:49.832029  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.832357  8763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:22:49.799990 11843 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:49.747401  7966 rpcz_store.cc:269] 0709 12:22:32.269534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.285187 (+ 15653us) service_pool.cc:224] Handling call
0709 12:22:49.644182 (+17358995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:43.445207 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:43.465842 (+ 20635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:43.465905 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:22:43.465923 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:43.467266 (+  1343us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:43.467362 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:43.467391 (+    29us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:22:43.468574 (+  1183us) tablet.cc:701] Row locks acquired
0709 12:22:43.471338 (+  2764us) write_op.cc:260] PREPARE: finished
0709 12:22:43.471563 (+   225us) write_op.cc:270] Start()
0709 12:22:43.471714 (+   151us) write_op.cc:276] Timestamp: P: 1783599763471472 usec, L: 0
0709 12:22:43.471732 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:22:43.472556 (+   824us) log.cc:844] Serialized 5619 byte log entry
0709 12:22:43.991262 (+518706us) op_driver.cc:464] REPLICATION: finished
0709 12:22:44.141441 (+150179us) write_op.cc:301] APPLY: starting
0709 12:22:44.141543 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:44.141822 (+   279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:44.141965 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:44.143773 (+  1808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:44.144177 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:22:44.144220 (+    43us) write_op.cc:312] APPLY: finished
0709 12:22:44.144615 (+   395us) log.cc:844] Serialized 101 byte log entry
0709 12:22:44.254235 (+109620us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.294023 (+ 39788us) write_op.cc:454] Released schema lock
0709 12:22:44.314362 (+ 20339us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:44.397933 (+ 83571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.400242 (+  2309us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":265073,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":149840,"apply.run_cpu_time_us":4588,"apply.run_wall_time_us":219913,"num_ops":14,"prepare.queue_time_us":258129,"prepare.run_cpu_time_us":32445,"prepare.run_wall_time_us":199337,"raft.queue_time_us":179872,"raft.run_cpu_time_us":54146,"raft.run_wall_time_us":163700,"replication_time_us":519252,"thread_start_us":398936,"threads_started":4,"wal-append.queue_time_us":310064,"wal-append.run_cpu_time_us":38713,"wal-append.run_wall_time_us":1479490}]]}
W20260709 12:22:49.836349  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 253847us
I20260709 12:22:49.835359  7967 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 6, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.861044  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.863772  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:49.864313  8761 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:49.865046  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:49.838862  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:49.669804 12077 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.866218  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.867363  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.868474  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:49.834172 11924 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:49.840354  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 316646us
I20260709 12:22:49.871698  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:49.834668 11999 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.873310  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.873991  8066 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:49.874945  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:49.875622  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:49.877362  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1735) took 1666 ms. Trace:
I20260709 12:22:49.871717  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:49.878219  8067 rpcz_store.cc:276] 0709 12:22:48.211193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.538456 (+1327263us) service_pool.cc:224] Handling call
0709 12:22:49.538757 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.876861 (+338104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.876905 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.876972 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:49.877024 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.877120 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.877286 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":221097,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4786,"thread_start_us":337690,"threads_started":1}
I20260709 12:22:49.826304 11909 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:49.829044 11965 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.891929  8212 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:49.838052 12066 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.838589  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2872) took 1646 ms. Trace:
I20260709 12:22:49.842669 11934 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:49.881379  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:49.885164  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46386.1us
I20260709 12:22:49.908908  8035 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:49.823575 11928 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:49.886245  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.890586  8218 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:49.844595 12002 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:49.881249  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:49.869987 12149 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 12:22:49.901875  8761 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:49.857743 12118 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:49.855043 12126 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:49.859501 12013 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:49.913842  8066 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:49.914041  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:49.917395  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:49.908118 11735 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:49.837062 12127 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:22:49.920930  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:49.837333 12003 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.923729  7967 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 7, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 7 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.943770  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:49.899053 11999 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.837474 12157 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.955217 12002 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.826895 11723 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.953382 11934 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:49.953610  8763 raft_consensus.cc:606] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:49.990988  8763 raft_consensus.cc:614] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:49.965858  8217 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:49.956995  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126870us
I20260709 12:22:49.873606 11843 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.917227 12060 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:49.969882  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 94332.7us
W20260709 12:22:49.972446  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58492.5us
I20260709 12:22:49.921765 12079 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.977998  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:50.005628  8066 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:50.006600  8066 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:49.981396  8067 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:22:49.966560  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 101469us
I20260709 12:22:49.996474  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:50.007957  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:50.001358  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.002758  7967 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.008055  8068 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:50.009594  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:50.002791  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.010641  8217 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:49.973104 12055 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:50.019158  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:50.012553  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:50.020503  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.013846  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:50.021546  8137 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:49.969256 12158 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:50.021996  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:50.023264  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.012740  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 131475us
I20260709 12:22:50.024518  8137 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:50.024562  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:50.027489  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.028509  8146 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:50.028872  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.029691  8143 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:50.027717  7967 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.024271  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:50.036813  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.037662  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.999456 11735 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.912791 11864 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.015579 11902 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:50.068229 12162 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:22:50.018963 12046 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.018373 12079 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.015739 11700 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:49.968715 11804 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.017046 12142 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.042354 12107 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:50.028131 11784 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.029122 12158 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:50.014576 12060 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:49.999825 12002 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.152983  8219 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:49.894452  8070 rpcz_store.cc:276] 0709 12:22:48.192659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.535240 (+1342581us) service_pool.cc:224] Handling call
0709 12:22:49.535628 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.535907 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:49.655239 (+119332us) log.cc:844] Serialized 14 byte log entry
0709 12:22:49.838262 (+183023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.838309 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:49.838353 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.838427 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.838535 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7176,"prepare.queue_time_us":169635,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":11414,"raft.queue_time_us":38454,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":20421,"thread_start_us":294309,"threads_started":2}
I20260709 12:22:50.291148  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:50.291813  8220 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:50.152518  8217 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:50.293017  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.293836  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:50.093540  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:50.295011  8217 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 7.
I20260709 12:22:50.295392  8212 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:50.027505 12013 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:50.308017  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 283523us
I20260709 12:22:50.095026  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:50.097048  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.096616  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:50.287452  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 286153us
I20260709 12:22:50.324128  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.084728  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.329952  8143 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:50.056668 12014 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.325917  8213 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:50.331198 12014 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.331802 12014 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:50.288865  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.333338  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.057081 11735 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:50.238545 12155 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:22:50.343698  8217 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:50.042505 12141 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:50.338522 12046 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:50.393669 12141 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.185101 11972 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.163630 12029 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:50.379290  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46058.6us
I20260709 12:22:50.245644 12077 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.357391  8214 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.227692 11946 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:50.305469 11609 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.784s	user 0.005s	sys 0.009s
W20260709 12:22:50.285465 11694 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.198s	user 0.013s	sys 0.000s
I20260709 12:22:50.095635 12140 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.358816 12037 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.000s
W20260709 12:22:50.357084 12008 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
W20260709 12:22:50.152426 11612 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.002s
I20260709 12:22:50.307307 12132 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:50.359880 11928 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:50.352140 12139 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:50.306869 12147 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:50.305997 11843 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:50.419943  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 398005us
I20260709 12:22:50.345295 12003 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.386900 11964 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.339999 12079 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.439769  8137 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:22:50.489162  8137 pending_rounds.cc:85] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 3
I20260709 12:22:50.489465  8137 pending_rounds.cc:107] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:50.489725  8137 raft_consensus.cc:2889] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:50.441740  8065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.007s
I20260709 12:22:50.417119 12046 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.394845 12158 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:50.505587 12156 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.369s	user 0.003s	sys 0.000s
I20260709 12:22:50.506917 12167 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:50.507876 12167 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.526873 12002 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:50.530802 12160 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
I20260709 12:22:50.540309 11735 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:50.541201  8069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.018s	sys 0.022s
W20260709 12:22:50.543192  8069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.018s	sys 0.023s
I20260709 12:22:50.400030 11972 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.406980 12013 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:50.325945 11909 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.450654  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:22:50.414773 11609 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.354300 11924 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:50.554557  8218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.021s
W20260709 12:22:50.559057  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 108538us
I20260709 12:22:50.570869  8109 leader_election.cc:400] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
W20260709 12:22:50.491184  8065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.007s
W20260709 12:22:50.560648  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.572108  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:50.575003  8218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.009s	sys 0.021s
I20260709 12:22:50.307353 12142 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:50.553284 11965 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.006s
W20260709 12:22:50.568950  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.018s	sys 0.027s
W20260709 12:22:50.586822  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.018s	sys 0.027s
W20260709 12:22:50.587208  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 541145us
I20260709 12:22:50.464752 12139 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:50.498065 12132 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:50.584380  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:50.551357 12126 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:22:50.568665 11735 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:50.590041  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:50.590858  8763 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:50.452262 11612 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.446894 12008 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.543957 12147 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:50.496665 12174 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:50.422658 11694 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.604426  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:50.438464 12140 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.612159  8757 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:50.613606  8138 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:50.601966  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.487540 12163 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:22:50.614903  8211 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:50.600196 12095 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.051s	user 0.012s	sys 0.002s
I20260709 12:22:50.590708 12127 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:50.625015  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.017s	sys 0.024s
I20260709 12:22:50.625527  8217 raft_consensus.cc:2376] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10. Re-sending same reply.
I20260709 12:22:50.410761 12141 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.582897 12066 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.562140 12046 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.606232 11792 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:50.599608 12077 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:50.624799 12174 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:50.599905 11999 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.601450 12060 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:50.662341 11913 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.000s
I20260709 12:22:50.611557 12126 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:50.723001  8139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.006s	sys 0.021s
W20260709 12:22:50.724457  8139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.006s	sys 0.021s
I20260709 12:22:50.678964 11792 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:50.703848 11892 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:50.731871  8756 raft_consensus.cc:2368] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12.
I20260709 12:22:50.726507 11694 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.611560 12107 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:50.639564  8064 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:50.648672  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.032s	sys 0.039s
I20260709 12:22:50.589323 12003 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:50.650007 12127 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.601418 11728 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:50.718279 11913 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.508402 12167 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.633064  8063 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:50.602421 11965 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:50.690035  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 90579.8us
I20260709 12:22:50.813813  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.480953  8214 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:50.630918 12132 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.640161 12163 consensus_queue.cc:1243] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:50.639169 12095 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.717947 12174 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:50.793764  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.032s	sys 0.046s
W20260709 12:22:50.824158  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 803476us
W20260709 12:22:50.554292 12146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.018s	sys 0.027s
I20260709 12:22:50.764418 12014 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.819232 12164 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.819715 12171 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.819788 11612 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:50.820725 12135 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.023s	sys 0.020s
W20260709 12:22:50.859236  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 262000us
I20260709 12:22:50.813894 11909 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.821038 11972 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:50.821394 12140 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.821466 12074 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:50.821406 12179 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:22:50.822366 12151 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:22:50.823040 11723 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:50.831955  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:50.878209  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46345.6us
I20260709 12:22:50.829721  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.835615  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.837519  8144 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:50.837864  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.637701  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.017s	sys 0.024s
W20260709 12:22:50.849416  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 447662us
I20260709 12:22:50.849357  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.881752  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 972878us
I20260709 12:22:50.812898 11735 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:50.831547 12146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.019s	sys 0.027s
I20260709 12:22:50.761545 11792 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:50.859177 12135 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.023s	sys 0.020s
I20260709 12:22:50.866905 12145 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:50.869491  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 262256us
I20260709 12:22:50.848349 12169 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:50.851387 11609 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.731851 12147 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.879938  8141 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:50.896824  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.897708  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.898574  8141 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:50.899624  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.902164  8141 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:50.883074  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.832085 12132 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.893752  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:50.879175  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:50.906585  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.911015  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.914676  8146 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:50.888615 11612 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:50.890666 12142 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.911749 11792 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:50.902232 12145 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.915218 12046 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.892313 12008 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.915985  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1729) took 1602 ms. Trace:
I20260709 12:22:50.934937  8211 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:50.879205 11972 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:22:50.934406  8215 rpcz_store.cc:276] 0709 12:22:49.313875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.314011 (+   136us) service_pool.cc:224] Handling call
0709 12:22:49.314392 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.566786 (+252394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.566840 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.569802 (+  2962us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.860475 (+290673us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:49.860542 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.860661 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.915773 (+1055112us) raft_consensus.cc:1685] finished
0709 12:22:50.915791 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.915912 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34678,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":498136,"threads_started":2,"wal-append.queue_time_us":909688}
I20260709 12:22:50.858214 12171 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.917276  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.929134  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.945876  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1736) took 2709 ms. Trace:
I20260709 12:22:50.963985  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:50.963148  8065 rpcz_store.cc:276] 0709 12:22:48.236956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.553009 (+1316053us) service_pool.cc:224] Handling call
0709 12:22:49.553363 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.828827 (+275464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.828862 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.834788 (+  5926us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.532444 (+697656us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4800080058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:22:50.572994 (+ 40550us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:50.573054 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.573156 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.933325 (+360169us) raft_consensus.cc:1685] finished
0709 12:22:50.933351 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.945795 (+ 12444us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":206506,"raft.run_cpu_time_us":11775,"raft.run_wall_time_us":738480,"spinlock_wait_cycles":14168448,"thread_start_us":937128,"threads_started":2,"wal-append.queue_time_us":751506}
I20260709 12:22:50.965668  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.921056 12173 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:22:50.913515 12014 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:50.962060  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:50.919343 12176 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:22:50.848399 12164 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.985954 12127 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:22:50.987004 12194 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:50.987494 12194 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.987857 12194 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:50.991737 12158 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.992875 11950 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:50.993260 12095 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.993418 11950 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.993958 12132 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:50.996775 12185 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:22:50.997298  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:50.998070 12185 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:50.998471 12185 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:50.998557  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:50.999079  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:50.999540 12185 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:50.993986 11950 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:50.969722  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52686.6us
I20260709 12:22:50.972373  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:50.929352 12180 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:51.005522  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.916209 12170 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:50.876515 12074 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:50.946487 12142 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.938135  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:50.977723 12187 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:22:50.926740 12172 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:22:50.979573 12171 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:50.922629 11892 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:22:50.921146 11735 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:50.981352 12175 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:22:50.982180 12167 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:50.982620 11700 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.004s
I20260709 12:22:50.973861 12014 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:50.984777 12193 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:22:51.067528 12132 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:50.997004  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:50.971601  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76972.9us
W20260709 12:22:50.931133 12118 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.968s	user 0.010s	sys 0.001s
I20260709 12:22:50.931191 11924 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:50.932618 11913 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:50.931574 12126 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:51.016824  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.017325  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.055413  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 738) took 1458 ms. Trace:
I20260709 12:22:51.091008  8139 rpcz_store.cc:276] 0709 12:22:49.596910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.620955 (+ 24045us) service_pool.cc:224] Handling call
0709 12:22:49.621367 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.621746 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.621773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.622285 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.725925 (+1103640us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:50.725999 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.726080 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.006361 (+280281us) raft_consensus.cc:1685] finished
0709 12:22:51.006378 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.055348 (+ 48970us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1283,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15496,"thread_start_us":1052079,"threads_started":1,"wal-append.queue_time_us":1136438}
I20260709 12:22:51.093598  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.057977  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.094964  8142 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:50.926445 12166 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:51.059718  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 121665us
I20260709 12:22:51.102247  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.007144  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:51.055540  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50143.1us
I20260709 12:22:51.103128  8065 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:51.103561  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:50.987874 12164 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.065534  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:50.970188 11612 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.111279  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 710) took 1093 ms. Trace:
I20260709 12:22:50.932711 12140 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:22:50.960510 11609 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:22:50.915957 12183 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
I20260709 12:22:50.975010 12008 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:51.053748 12170 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:51.075027  8140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 728) took 2021 ms (client timeout 1765 ms). Trace:
I20260709 12:22:51.057338 12060 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:51.084175 12132 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.006629 12141 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.064895 12142 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.066464 12046 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.077800 12014 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.136988 12188 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.137704 12188 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.081398  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.071484 12185 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:51.076356 11784 consensus_meta.cc:287] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.002s
I20260709 12:22:51.145026 11784 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:51.145954 11784 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.146621 11784 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.077518 11700 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.096175  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.148731 12142 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.099721  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.149571  8137 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:51.149837  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50259.1us
W20260709 12:22:51.078769 12013 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:22:51.151525 12046 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.152707 12013 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:51.153177 12013 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.153563 12013 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:51.117322 11612 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.118386 11913 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.105221  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.109368  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.111073  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.111930  8211 rpcz_store.cc:276] 0709 12:22:50.019805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.020031 (+   226us) service_pool.cc:224] Handling call
0709 12:22:51.111057 (+1091026us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:51.111198 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365539712}
I20260709 12:22:51.116333 12129 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:51.171891  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 90545.9us
W20260709 12:22:51.176569  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65595.5us
I20260709 12:22:51.177248  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.174482  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.178357  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:51.178728  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69469.7us
I20260709 12:22:51.179394  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.113221  8141 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:51.179773  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:50.997004  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:51.082854 11965 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:51.122665  8140 rpcz_store.cc:269] 0709 12:22:49.053627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.118210 (+ 64583us) service_pool.cc:224] Handling call
0709 12:22:51.074817 (+1956607us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001c43d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:51.074957 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3057103104}
I20260709 12:22:51.101559 12166 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.127275  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:51.128528  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2866) took 3084 ms. Trace:
I20260709 12:22:51.118686 12164 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.133077  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 741) took 1535 ms. Trace:
I20260709 12:22:51.134189 12192 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:22:51.181368  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.183678  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:51.140291 12188 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.174983  8139 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:51.193420  8729 leader_election.cc:400] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11.
I20260709 12:22:51.196157  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.198747  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.132121  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2864) took 3126 ms. Trace:
I20260709 12:22:51.087419 12118 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:51.225984  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98848.3us
I20260709 12:22:51.124678 12170 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:51.231606  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44483us
I20260709 12:22:51.225600  8069 rpcz_store.cc:276] 0709 12:22:48.044691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.533323 (+1488632us) service_pool.cc:224] Handling call
0709 12:22:49.533643 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.869738 (+336095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.869775 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.870261 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.545040 (+674779us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:50.545104 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.584296 (+ 39192us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54001072d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:50.584350 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.124320 (+539970us) raft_consensus.cc:1685] finished
0709 12:22:51.124349 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.128465 (+  4116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13020,"raft.queue_time_us":105212,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4517,"spinlock_wait_cycles":742007680,"thread_start_us":624204,"threads_started":1,"wal-append.queue_time_us":833518}
I20260709 12:22:51.126222 12132 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:51.167275 12168 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.489s	user 0.004s	sys 0.000s
I20260709 12:22:51.320538  8215 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:51.226812 11914 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.160596 11612 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:51.319882  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 136314us
I20260709 12:22:51.311542 12011 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.320333  8064 rpcz_store.cc:276] 0709 12:22:48.005476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.529397 (+1523921us) service_pool.cc:224] Handling call
0709 12:22:49.529777 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.802113 (+1272336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.131888 (+329775us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540011d5d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:51.132066 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551704960}
W20260709 12:22:51.341130  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 159805us
I20260709 12:22:51.320201  8144 rpcz_store.cc:276] 0709 12:22:49.598037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.601404 (+  3367us) service_pool.cc:224] Handling call
0709 12:22:49.601793 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.884031 (+1282238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.132844 (+248813us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000438d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:51.133016 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836459776}
I20260709 12:22:51.238119 12074 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.226223 12172 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:51.164943 11902 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.006s
I20260709 12:22:51.176724 12169 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.185303 11950 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.321334  8729 leader_election.cc:403] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:51.168757 12046 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.225404 12183 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.224853 12135 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:51.325894 11924 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:51.332329 12204 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:22:51.332620  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 894) took 1633 ms. Trace:
I20260709 12:22:51.388487 12172 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:51.393100  8757 rpcz_store.cc:276] 0709 12:22:49.699058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.703120 (+  4062us) service_pool.cc:224] Handling call
0709 12:22:51.332376 (+1629256us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54005460d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:51.332552 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087595264}
I20260709 12:22:51.394136 12177 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:51.393986 12172 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.394729 12177 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.396225 12118 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.397102 11784 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.389634 11950 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.399480 12145 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.333132 12161 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:51.402321 12201 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:51.336246  8062 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:22:51.336884  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.113474 12174 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.234058 11964 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:51.337220  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.318868  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.338270  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.338801  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:51.234258 12166 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.343261  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.422753  8217 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:51.423988  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.345297  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:51.345772  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.425774  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.426257  8217 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:22:51.426627  8220 raft_consensus.cc:2410] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:22:51.318059 12141 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.317869 11999 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:51.351399 12171 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:51.346619  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.169279 11913 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:51.348773 12206 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:22:51.338263 11914 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:51.358294  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.447134  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 128339us
I20260709 12:22:51.349503  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:51.448742  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 106898us
I20260709 12:22:51.448895  8215 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:51.350958  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.450927  8211 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:51.376422  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.374240  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.381333  8216 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:51.381402 12188 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.382483 12193 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11.
W20260709 12:22:51.383494  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 190278us
I20260709 12:22:51.230639 11792 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 12:22:51.346927 11612 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.415910  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 77174.2us
I20260709 12:22:51.338950 12164 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:51.413915 11964 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.419734 11864 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.387993 12183 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.452503  8140 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:51.480578 12183 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.480432  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.483208  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.483966  8759 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:51.346297  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.379953 12147 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 12:22:51.461241  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84890us
I20260709 12:22:51.486133  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.462092  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:51.487809  8069 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:51.463117  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:51.489094  8215 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.486812  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1739) took 3248 ms. Trace:
I20260709 12:22:51.464022  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.465031  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:51.465706  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:51.491042  8219 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:51.491426  8211 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.385775 11902 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.502476  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.469017 11964 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.469192 12074 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:51.469624 12192 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:51.470304 12174 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.471441 12209 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:51.471758 12177 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.472162  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.473361  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.474537  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.475751  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:51.476821  8068 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:51.477114  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:51.477314 12210 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.454960 11914 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.493788  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:51.497084  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.439738 12158 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.592134 12216 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.592774 12216 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.490049  8061 rpcz_store.cc:276] 0709 12:22:48.238254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.552889 (+1314635us) service_pool.cc:224] Handling call
0709 12:22:49.574860 (+ 21971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:49.833270 (+258410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.833304 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:49.860153 (+ 26849us) log.cc:844] Serialized 52 byte log entry
0709 12:22:50.004109 (+143956us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:50.004184 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.004378 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.166697 (+1162319us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:51.456036 (+289339us) raft_consensus.cc:1685] finished
0709 12:22:51.456063 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.486753 (+ 30690us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":218938,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11558,"spinlock_wait_cycles":34652032,"thread_start_us":337672,"threads_started":2,"wal-append.queue_time_us":701286}
I20260709 12:22:51.434168 12171 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.596751 12171 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.564957  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.506686  8216 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:51.600884  8216 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:51.602105  8216 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.603641  8216 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.521682  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:51.604480  8764 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.573360 11913 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.535277  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:51.569671  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:51.512470 12055 consensus_meta.cc:287] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.493s	user 0.011s	sys 0.003s
I20260709 12:22:51.609709 12181 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:51.609829 12055 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:51.610220 12181 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:51.554961  8763 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:51.557891 12211 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:22:51.557307 12210 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.612818 11609 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:51.613265 11609 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.613722 11609 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:51.614049 12210 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.614624 12210 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.615144 12210 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:51.558756 12208 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:22:51.560712 12199 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:22:51.564152 11924 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:22:51.485492 12164 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.622721 12164 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.507889 12135 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:22:51.489272 11612 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.625366  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2861) took 3631 ms. Trace:
I20260709 12:22:51.625809  8063 rpcz_store.cc:276] 0709 12:22:47.994310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.224459 (+230149us) service_pool.cc:224] Handling call
0709 12:22:48.254453 (+ 29994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.811303 (+2556850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.625121 (+813818us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b540011e4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:51.625303 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5469802368}
W20260709 12:22:51.627362  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 891) took 1929 ms (client timeout 2208 ms). Trace:
I20260709 12:22:51.627440 11612 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:51.627902  8756 rpcz_store.cc:269] 0709 12:22:49.698050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.699245 (+  1195us) service_pool.cc:224] Handling call
0709 12:22:51.627154 (+1927909us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:51.627297 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372393856}
I20260709 12:22:51.538076 12167 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:22:51.648072  8220 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:51.533735 11784 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.564821 12147 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:22:51.595240 12216 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:51.579108 12194 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.005s
I20260709 12:22:51.521340 12192 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:51.514277 12145 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.506711 12161 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:22:51.580359  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:51.555583 12002 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:51.657630 12013 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.001s
I20260709 12:22:51.590024  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:51.590706  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.591262 12177 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.517076  8146 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:51.596082  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1789) took 2700 ms. Trace:
I20260709 12:22:51.698756  8138 rpcz_store.cc:276] 0709 12:22:48.896150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.145933 (+249783us) service_pool.cc:224] Handling call
0709 12:22:49.146345 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.632465 (+1486120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.595810 (+963345us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54002f1f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:51.596020 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373793536}
I20260709 12:22:51.439572 12141 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:51.566555  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73533.4us
I20260709 12:22:51.630851  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:51.531467  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:51.659109  8764 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:51.659145  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:51.657039  8215 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:51.578166 11902 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:51.660328  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 157955us
I20260709 12:22:51.658150 12126 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.662801  8729 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.504s (SENT)
W20260709 12:22:51.709589  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46836us
I20260709 12:22:51.629297 12014 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.588999 12154 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:51.658931 12142 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.004s
I20260709 12:22:51.706321  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:51.710166  8729 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.550s (SENT)
W20260709 12:22:51.713828  8729 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.664s (SENT)
I20260709 12:22:51.689666 12192 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.692567 12002 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.664726 12135 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:51.689903 12145 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.692967 11864 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.661640 12166 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.711776 12157 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.664474 12194 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.690286 12132 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.708786 11902 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:51.611199 12181 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.662632 11784 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.708405 11999 raft_consensus.cc:2764] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:51.730634 12145 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.707623 12013 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.765303 11892 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:51.728209 12135 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:51.769002 12139 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.770028 12164 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:51.749996 11864 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.746450 12141 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.722894 12142 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.728886 12002 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.749946 12167 raft_consensus.cc:2764] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:51.722329 12126 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:51.774712 12191 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.850s	user 0.007s	sys 0.004s
I20260709 12:22:51.793687 12164 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:51.794695 12181 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.742059 12183 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.825246 12194 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.826889 12210 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.834664 12183 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.837304 12192 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.840368 12192 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.630350  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:51.873802  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.033s
W20260709 12:22:51.874539  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.015s	sys 0.034s
I20260709 12:22:51.874627  8064 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:51.590746  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2874) took 1719 ms. Trace:
I20260709 12:22:51.877044  8062 rpcz_store.cc:276] 0709 12:22:49.871109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.871820 (+   711us) service_pool.cc:224] Handling call
0709 12:22:49.872133 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.409484 (+1537351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.590463 (+180979us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400106dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:51.590679 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3366623104}
W20260709 12:22:51.878741  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.000s
W20260709 12:22:51.879293  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.000s
W20260709 12:22:51.881676  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 250705us
I20260709 12:22:51.882095  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.885331  8061 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:51.887907  8212 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:51.888736  8069 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:51.889178  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 243978us
I20260709 12:22:51.891610 12013 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.893292  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.895072  8138 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:51.897653  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.900161  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.901136  8144 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:51.901088  8138 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.903591  8211 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:51.904258 11924 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:51.905539  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 706) took 1987 ms. Trace:
I20260709 12:22:51.906394  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.906802 12008 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:51.907445 12008 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.907629  8140 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:51.761735  8729 leader_election.cc:336] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.885s (SENT)
I20260709 12:22:51.905236  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.925339 11902 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:51.927609  8757 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:51.928683  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:51.920850  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:51.941048  8140 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 4.
I20260709 12:22:51.941886 11784 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:51.897575 12013 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:51.944043 12013 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.944396 12013 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:51.791798 11892 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:51.950953 12132 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.952433  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:51.953215 12166 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.953449  8067 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:51.954685  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:51.955415  8062 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.957525  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:51.958693  8064 raft_consensus.cc:2368] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
I20260709 12:22:51.962522  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.888604 11612 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:51.963171  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.965248  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:51.986893  8220 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:51.965277 12142 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.959211 12046 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:51.961782 12192 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:22:51.990217 12046 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:51.990716 12046 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:51.991107 12192 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:51.991528 12192 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:51.963366 12014 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:51.992988  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.994361  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:51.995962  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:51.996618 12107 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.997085  8066 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:51.997169  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:51.997888  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:51.998586  8066 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:51.998694  8068 raft_consensus.cc:2376] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10. Re-sending same reply.
I20260709 12:22:51.999272  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.000303  8063 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:51.812291 12170 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.001178 12227 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.001762 12227 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.002246 12227 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.003530 12170 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:51.948125 11892 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.006114  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.007057  8067 raft_consensus.cc:2376] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9. Re-sending same reply.
I20260709 12:22:52.007380 11864 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:52.008697  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1813) took 1029 ms. Trace:
I20260709 12:22:52.009249  8146 rpcz_store.cc:276] 0709 12:22:50.931053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.972090 (+ 41037us) service_pool.cc:224] Handling call
0709 12:22:51.960293 (+988203us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400312c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:51.960479 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176626432}
I20260709 12:22:52.011252 12126 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:52.014262  8144 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
W20260709 12:22:52.015637  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123157us
I20260709 12:22:52.017777  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:52.019963  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.021448  8143 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:51.989264  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:52.000402  8066 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:52.022264  8138 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:51.988536  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:51.991840 12046 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:51.889209 12011 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:52.027160 12126 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:52.030995 12126 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:52.031684 11964 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.003s
I20260709 12:22:52.032253 11964 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.027269  8762 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.034207 12129 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:52.034716 12129 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:52.035717 12194 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:52.036970  8211 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:52.037941 12195 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:52.038487 12195 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.038895 12195 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:52.041584  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:52.032514 12126 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.031492  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.996945 11612 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.040387  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:52.041334 11964 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:52.056322  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.997189 12107 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:52.063234  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.065343 12107 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.065814  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.066586  8067 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:52.067361  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:52.081538 12229 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:52.081790  8731 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 1.765s (SENT)
I20260709 12:22:52.082264 12229 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.084510  8762 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:52.080351  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.097337  8066 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:52.036026 12129 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.094071  8138 raft_consensus.cc:2368] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:52.093513  8140 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:51.906016  8218 rpcz_store.cc:276] 0709 12:22:49.919213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.919563 (+   350us) service_pool.cc:224] Handling call
0709 12:22:49.919916 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.575587 (+655671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.575633 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.576220 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.850653 (+274433us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:50.850691 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.850776 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.773930 (+923154us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:51.904858 (+130928us) raft_consensus.cc:1685] finished
0709 12:22:51.904913 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.905315 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77096,"raft.queue_time_us":489754,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6312,"spinlock_wait_cycles":21200128,"thread_start_us":893893,"threads_started":2,"wal-append.queue_time_us":319054}
I20260709 12:22:52.086570  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:52.061007 12142 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:52.129285  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:52.130303  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:51.809726 12135 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.022720 12192 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.113266  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:52.114108  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:52.117467  8211 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:52.118024  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:52.134158  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 372479us
I20260709 12:22:52.082813 12229 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.120271  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:52.126559  8758 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:22:52.104598 11924 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:52.134788  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.122709  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:52.124475  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:52.121430  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:52.165252  8062 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:52.124285  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:52.167142  8765 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.123456  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:52.125252  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:52.168187  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:52.124709 12046 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.116096 12129 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:52.126412 12197 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:52.179983 12197 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:52.180939 12142 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:52.182169  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.175037  8065 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:52.137336 11914 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.005s
I20260709 12:22:52.186201 11914 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.188052  8763 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:52.127449 12216 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:52.170403  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:52.197132  8138 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:52.204977  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1671) took 1379 ms. Trace:
I20260709 12:22:52.205402  8137 rpcz_store.cc:276] 0709 12:22:50.825649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.825799 (+   150us) service_pool.cc:224] Handling call
0709 12:22:50.826080 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.150157 (+324077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.204508 (+1054351us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400043654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:52.204783 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743384832}
I20260709 12:22:52.092154 12013 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.243846  8141 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.244680 12055 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:52.245191 12055 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:52.246574 11609 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.632s	user 0.015s	sys 0.003s
I20260709 12:22:52.247457 11609 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.143285 12002 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:52.246693 12055 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:52.846315  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 788187us
I20260709 12:22:52.302053  8765 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:52.263332  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 203535us
I20260709 12:22:52.385238  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:52.758440  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.024397  8211 raft_consensus.cc:2376] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9. Re-sending same reply.
W20260709 12:22:52.758617 12171 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.013s
W20260709 12:22:52.954845 12195 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.915s	user 0.013s	sys 0.000s
W20260709 12:22:52.295382 12198 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.976s	user 0.002s	sys 0.002s
I20260709 12:22:52.978600 12013 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:52.262068  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.025898 12171 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.250029  8218 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:53.031226  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2926) took 1015 ms. Trace:
W20260709 12:22:52.356961  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.031617  8218 rpcz_store.cc:276] 0709 12:22:52.016009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.113795 (+ 97786us) service_pool.cc:224] Handling call
0709 12:22:53.031170 (+917375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:52.358631  8141 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:52.422765  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 276722us
I20260709 12:22:52.248950  8146 raft_consensus.cc:1217] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 12:22:53.029994  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 637) took 1034 ms. Trace:
W20260709 12:22:53.035167  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.197656 12216 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:52.294598  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.041150  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:53.041850  8146 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:22:53.026084  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:52.995645 12107 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.003s
W20260709 12:22:52.716446  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 717) took 2622 ms (client timeout 1765 ms). Trace:
W20260709 12:22:52.299424 12237 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:22:52.868263 12129 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.659s	user 0.004s	sys 0.004s
I20260709 12:22:52.256526 12170 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.050658 12170 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.053426 12170 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.054107 12170 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.816483 12219 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.089s	user 0.000s	sys 0.003s
W20260709 12:22:53.048520  8214 rpcz_store.cc:269] 0709 12:22:50.094233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.096760 (+  2527us) service_pool.cc:224] Handling call
0709 12:22:52.715966 (+2619206us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:52.716205 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73167744}
I20260709 12:22:53.069839  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.071151 12171 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.071233 12055 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:53.072183  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:53.073395  8213 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:53.073890  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2923) took 1106 ms. Trace:
I20260709 12:22:53.074191  8213 rpcz_store.cc:276] 0709 12:22:51.967505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.263843 (+296338us) service_pool.cc:224] Handling call
0709 12:22:53.073820 (+809977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.075129 11612 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.075469  8109 leader_election.cc:400] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12.
I20260709 12:22:53.075847  8109 leader_election.cc:403] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:53.076725 11609 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.077414 11609 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.078133 11609 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.080255 11609 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.026059 12195 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.083014 12195 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.084493 12107 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:53.085976 12229 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.003s
I20260709 12:22:53.086684 12107 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.086544 12229 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.087393 12107 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:53.089525 12013 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.089424  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.090278 12013 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.075125  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:52.866410 12145 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.072s	user 0.012s	sys 0.000s
I20260709 12:22:53.093045  8213 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:52.255623 12130 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:53.094069  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1817) took 1920 ms. Trace:
I20260709 12:22:53.094165 12130 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:53.094492  8145 rpcz_store.cc:276] 0709 12:22:51.173597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.187406 (+ 13809us) service_pool.cc:224] Handling call
0709 12:22:51.187845 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.188446 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.188493 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.189221 (+   728us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.392292 (+203071us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b18002ea080. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:22:51.530276 (+137984us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:51.530343 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.530455 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.634170 (+1103715us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:53.093623 (+459453us) raft_consensus.cc:1685] finished
0709 12:22:53.093648 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.093841 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1046,"raft.queue_time_us":129,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":85892,"spinlock_wait_cycles":104810496,"thread_start_us":137718,"threads_started":1,"wal-append.queue_time_us":502913}
I20260709 12:22:53.059237  8067 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.059738 12216 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:52.518441 12139 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:53.060943 12135 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:53.061998 12189 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.992s	user 0.003s	sys 0.010s
I20260709 12:22:52.521359 11843 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:53.095669 12130 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.065384  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:53.066107  8211 raft_consensus.cc:2368] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12.
I20260709 12:22:52.243818 12224 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:53.090649  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:53.105460  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2928) took 1088 ms. Trace:
I20260709 12:22:53.105907  8218 rpcz_store.cc:276] 0709 12:22:52.016876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.088986 (+1072110us) service_pool.cc:224] Handling call
0709 12:22:53.105385 (+ 16399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.092971 12145 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.108379 12171 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:53.109361  8186 leader_election.cc:400] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:53.109789  8186 leader_election.cc:403] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:22:53.114395  8219 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:22:53.117049 12142 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.117877 12142 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:53.119342 12130 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.119477 12142 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:52.816733 11999 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:52.262292 12217 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.043191 12227 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.040s	user 0.006s	sys 0.009s
I20260709 12:22:52.300963 11700 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.044157 12046 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.855s	user 0.003s	sys 0.008s
I20260709 12:22:53.100282  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2924) took 1129 ms. Trace:
I20260709 12:22:53.037164  8068 rpcz_store.cc:276] 0709 12:22:51.995537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.999568 (+  4031us) service_pool.cc:224] Handling call
0709 12:22:52.000021 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.000579 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.000604 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.035610 (+ 35006us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.147893 (+112283us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:52.147944 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.148027 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.020320 (+872293us) raft_consensus.cc:1685] finished
0709 12:22:53.020346 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.029934 (+  9588us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4294,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":111780,"threads_started":1,"wal-append.queue_time_us":300012}
I20260709 12:22:52.401566 12008 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.181950  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.182822  8068 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:53.182770 12145 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.183835  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.103410  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2919) took 1138 ms. Trace:
I20260709 12:22:53.184566  8068 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:53.054677 12170 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.140671 12002 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.144796 11700 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:53.145373  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1744) took 1799 ms (client timeout 1699 ms). Trace:
I20260709 12:22:53.146763  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1698) took 1118 ms. Trace:
I20260709 12:22:53.155745 11914 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:53.159399 12245 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:22:53.181164 12229 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.163395  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 905) took 1528 ms. Trace:
I20260709 12:22:53.165141  8218 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:53.166086 11694 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:53.169198 12013 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:53.169329 12238 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.105s	user 0.004s	sys 0.004s
I20260709 12:22:53.102743 11843 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:53.169747 12197 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.173200 12217 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.176831 12164 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.178565 11902 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:53.116343  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 734) took 1534 ms. Trace:
I20260709 12:22:53.184801  8211 rpcz_store.cc:276] 0709 12:22:51.965552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.025656 (+1060104us) service_pool.cc:224] Handling call
0709 12:22:53.103325 (+ 77669us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:53.188875 12244 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.728s	user 0.008s	sys 0.001s
I20260709 12:22:53.126955 11999 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:53.180928  8213 rpcz_store.cc:276] 0709 12:22:51.967966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.074871 (+1106905us) service_pool.cc:224] Handling call
0709 12:22:53.097263 (+ 22392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.200416  8146 rpcz_store.cc:276] 0709 12:22:52.027954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.040753 (+ 12799us) service_pool.cc:224] Handling call
0709 12:22:52.041268 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.048277 (+1007009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.146437 (+ 98160us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540008edd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:53.146690 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389476096}
I20260709 12:22:53.160665 12227 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:53.200281  8212 rpcz_store.cc:269] 0709 12:22:51.346254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.346402 (+   148us) service_pool.cc:224] Handling call
0709 12:22:53.145006 (+1798604us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540016b2d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:53.145256 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041505024}
I20260709 12:22:53.206337  8067 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:53.206308  8763 rpcz_store.cc:276] 0709 12:22:51.635090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.635255 (+   165us) service_pool.cc:224] Handling call
0709 12:22:51.635680 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.188462 (+552782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.163090 (+974628us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54005b0754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:53.163312 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269490944}
I20260709 12:22:53.211972  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.212558  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2916) took 1310 ms. Trace:
I20260709 12:22:53.213815  8219 rpcz_store.cc:276] 0709 12:22:51.582298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.631051 (+ 48753us) service_pool.cc:224] Handling call
0709 12:22:51.631377 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.115043 (+1483666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.115933 (+   890us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:53.116262 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377831680}
W20260709 12:22:53.210767 12126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.016s	sys 0.049s
I20260709 12:22:53.202706 12145 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:53.222188  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2918) took 1321 ms. Trace:
I20260709 12:22:53.222637 12145 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.219280 11999 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:53.220104  8218 rpcz_store.cc:276] 0709 12:22:51.899917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.127935 (+1228018us) service_pool.cc:224] Handling call
0709 12:22:53.164972 (+ 37037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.209756 (+ 44784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.209962 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.221540 12197 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.222636  8211 rpcz_store.cc:276] 0709 12:22:51.920132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.221173 (+1301041us) service_pool.cc:224] Handling call
0709 12:22:53.221532 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.221835 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.221864 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.221928 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:53.221961 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.222016 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.222117 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.228668  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 642) took 1050 ms. Trace:
I20260709 12:22:53.231382  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 636) took 1233 ms. Trace:
I20260709 12:22:53.229552  8067 rpcz_store.cc:276] 0709 12:22:52.174255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.174463 (+   208us) service_pool.cc:224] Handling call
0709 12:22:53.220840 (+1046377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.219455 12008 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.217908 11694 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:53.240983  8211 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.241740  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2922) took 1274 ms. Trace:
I20260709 12:22:53.225244 11843 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.242368 12217 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.231751  8064 rpcz_store.cc:276] 0709 12:22:51.995144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.998494 (+  3350us) service_pool.cc:224] Handling call
0709 12:22:51.998875 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.999707 (+   832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.999733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.007838 (+  8105us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.057420 (+ 49582us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:52.166185 (+108765us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.166446 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.166539 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.188078 (+1021539us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:53.225710 (+ 37632us) raft_consensus.cc:1685] finished
0709 12:22:53.228131 (+  2421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.228275 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110543,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":25321,"raft.queue_time_us":1099,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":274,"spinlock_wait_cycles":7115136,"thread_start_us":48999,"threads_started":1,"wal-append.queue_time_us":400597}
I20260709 12:22:53.242728 11843 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.242071  8211 rpcz_store.cc:276] 0709 12:22:51.967035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.226768 (+1259733us) service_pool.cc:224] Handling call
0709 12:22:53.227989 (+  1221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.241456 (+ 13467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.241666 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:53.226876 12126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.017s	sys 0.049s
I20260709 12:22:53.251387 11694 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.252894  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 736) took 1157 ms. Trace:
I20260709 12:22:53.253265  8211 rpcz_store.cc:276] 0709 12:22:52.095222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.246735 (+1151513us) service_pool.cc:224] Handling call
0709 12:22:53.252241 (+  5506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.252533 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.252558 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.252615 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:53.252666 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.252718 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.252816 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.254577 12197 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.254756  8211 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.255645  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 737) took 1160 ms. Trace:
I20260709 12:22:53.255384 12197 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.256211 12227 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.256045  8211 rpcz_store.cc:276] 0709 12:22:52.095710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.254152 (+1158442us) service_pool.cc:224] Handling call
0709 12:22:53.254529 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.255425 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.255594 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.257612  8211 pending_rounds.cc:85] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:22:53.257835 12197 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.257952  8211 pending_rounds.cc:107] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:22:53.302512  8211 raft_consensus.cc:2889] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.258181 12142 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:53.254670 12107 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12.
I20260709 12:22:53.247248 12145 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.248575 12164 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:53.297194 11700 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.323377  8146 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:53.305426 12218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.020s	sys 0.034s
W20260709 12:22:53.324767 12218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.021s	sys 0.034s
I20260709 12:22:53.321348  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.339316  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:53.402910  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.414939  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2904) took 1796 ms. Trace:
I20260709 12:22:53.419631  8146 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.399447 12170 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.415534  8061 rpcz_store.cc:276] 0709 12:22:51.618349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.623646 (+  5297us) service_pool.cc:224] Handling call
0709 12:22:51.623960 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.885967 (+262007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.400308 (+1514341us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400346a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:53.414846 (+ 14538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599640320}
I20260709 12:22:53.431922  8218 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:22:53.432319  8218 pending_rounds.cc:85] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:22:53.432570  8218 pending_rounds.cc:107] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:22:53.432821  8218 raft_consensus.cc:2889] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.435159  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2921) took 1468 ms. Trace:
I20260709 12:22:53.435524  8218 rpcz_store.cc:276] 0709 12:22:51.966602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.224949 (+1258347us) service_pool.cc:224] Handling call
0709 12:22:53.225323 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.433291 (+207968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.434880 (+  1589us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540017d4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:53.435095 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472805248}
I20260709 12:22:53.435986  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:53.423188 12145 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:53.448851  8069 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:53.449036 12170 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:53.439069 12077 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:22:53.456403  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.037s	sys 0.030s
W20260709 12:22:53.463277  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.037s	sys 0.030s
I20260709 12:22:53.460290  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.465516  8063 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:53.466096  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.469861  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1757) took 1288 ms. Trace:
W20260709 12:22:53.470614  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.430006 11999 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.472041  8218 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:53.470515  8063 rpcz_store.cc:276] 0709 12:22:52.181394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.196490 (+ 15096us) service_pool.cc:224] Handling call
0709 12:22:53.460075 (+1263585us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800010598. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:53.469733 (+  9658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29684480}
I20260709 12:22:53.467454 12161 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.510118  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.512431  8213 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:53.461265 12145 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.522043  8214 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:53.489727 12077 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.524165  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:53.525357 12077 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.525934  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:53.527854 12145 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.528414 12145 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:53.528791 12227 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.528995 12210 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.528791 12145 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:53.533444 12145 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.535516  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.536212  8070 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:53.537292  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:53.491425 12139 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:22:53.540068 12239 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.451s	user 0.003s	sys 0.006s
W20260709 12:22:53.540512 12248 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:22:53.479833 12170 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.542237  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.543967  8213 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:53.545572  8143 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:53.546976  8218 raft_consensus.cc:2368] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6.
I20260709 12:22:53.512902 12161 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.557312  8141 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:53.552536 11892 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:53.564872  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 455647us
W20260709 12:22:53.566249  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.569132  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 497041us
I20260709 12:22:53.569746  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:53.570659  8218 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 8: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:53.571432  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.002s
W20260709 12:22:53.582095  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.010s	sys 0.002s
W20260709 12:22:53.582521  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.41087e+06us
W20260709 12:22:53.583773  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.024s	sys 0.031s
W20260709 12:22:53.584239  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.024s	sys 0.031s
W20260709 12:22:53.588670  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.580945  8062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.003s	sys 0.010s
W20260709 12:22:53.604562  8062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.003s	sys 0.010s
I20260709 12:22:53.604964  8146 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:22:53.585999  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.013s
W20260709 12:22:53.608708  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.014s
I20260709 12:22:53.608459  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.609372  8141 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:53.553150 12139 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.611155  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 643) took 1346 ms. Trace:
I20260709 12:22:53.550575 12210 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.611665  8062 rpcz_store.cc:276] 0709 12:22:52.301594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.041085 (+739491us) service_pool.cc:224] Handling call
0709 12:22:53.048684 (+  7599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.605105 (+556421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.605149 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.610822 (+  5673us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:53.610865 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.610938 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.611088 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44435,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":20255,"thread_start_us":545027,"threads_started":1}
W20260709 12:22:53.618238  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.011s
W20260709 12:22:53.609737  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 534490us
W20260709 12:22:53.615041  8065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.010s
W20260709 12:22:53.610198  8731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.009s
W20260709 12:22:53.619735  8731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.005s	sys 0.010s
W20260709 12:22:53.610146  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.012s
W20260709 12:22:53.620790  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.003s	sys 0.012s
I20260709 12:22:53.622119  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:53.619104  8065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.005s	sys 0.010s
W20260709 12:22:53.618690  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.011s
I20260709 12:22:53.586575 12171 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:53.630672  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:53.632513  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.634709  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.630553  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.642170  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.642310  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.651437  8065 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:53.655603  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.652056  8218 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
W20260709 12:22:53.656611  8729 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.905s (SENT)
I20260709 12:22:53.637809 12227 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:53.658653  8146 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.656257  8144 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:53.654196  8728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.009s
I20260709 12:22:53.661051  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:53.661574  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.045s
W20260709 12:22:53.662405  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.045s
I20260709 12:22:53.663075  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2910) took 1917 ms. Trace:
W20260709 12:22:53.677650  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.678161  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.663008  8728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.009s
W20260709 12:22:53.680529  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.685892  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.683386  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:53.692924  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.689194  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.659972 11999 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.677105  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.700557  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.703060  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.703913  8144 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:22:53.693995  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.687863  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2917) took 1787 ms. Trace:
I20260709 12:22:53.694952  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.669313  8215 rpcz_store.cc:276] 0709 12:22:51.734802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.735017 (+   215us) service_pool.cc:224] Handling call
0709 12:22:51.735540 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.115269 (+379729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.115332 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.167290 (+ 51958us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.401652 (+234362us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:52.401687 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.416918 (+ 15231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.651593 (+1234675us) raft_consensus.cc:1685] finished
0709 12:22:53.651620 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.651776 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968,"raft.queue_time_us":54968,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6022,"thread_start_us":524745,"threads_started":2,"wal-append.queue_time_us":1152873}
I20260709 12:22:53.724728  8062 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:53.707990 11694 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:53.728824  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.826997 11928 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:53.733058  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.733532 12210 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.733927  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:53.734579  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2929) took 1717 ms (client timeout 2185 ms). Trace:
I20260709 12:22:53.735291  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.736127  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:53.738066  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.869160  8146 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:53.738418 12217 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.873281  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.738824 12008 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:53.739195 12192 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.739265 12229 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.740955  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.877187  8765 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:53.741968 12258 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:53.742776 12265 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.743571 12255 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.734530 12252 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:53.745364  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:53.888599  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 207277us
I20260709 12:22:53.734822  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:53.748867 12243 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.617s	user 0.004s	sys 0.010s
I20260709 12:22:53.690276 12227 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.889881 12227 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:53.890476  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 155733us
I20260709 12:22:53.891068  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 731) took 2423 ms. Trace:
I20260709 12:22:53.749814  8220 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:53.892910 12227 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.757236  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.694448 12055 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.895304  8070 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.876189 12217 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.773234  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.764000  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.774343  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:53.775379  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.787657  8213 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:53.773125 12177 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.559s	user 0.006s	sys 0.050s
I20260709 12:22:53.788514 12171 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.791441  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.792009  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:53.793467  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.816082 12266 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.816951 11843 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.817986 11902 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 12:22:53.818792  8763 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:53.819272 12170 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:53.826133  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 188484us
I20260709 12:22:53.827387  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.844203  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:53.851742  8109 leader_election.cc:400] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
I20260709 12:22:53.730489 12262 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.833719 12241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.019s	sys 0.011s
W20260709 12:22:53.868897  8214 rpcz_store.cc:269] 0709 12:22:52.017262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.069451 (+1052189us) service_pool.cc:224] Handling call
0709 12:22:53.734373 (+664922us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400134054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:53.734523 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020992896}
W20260709 12:22:53.904548 12177 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.841s	user 0.006s	sys 0.051s
I20260709 12:22:53.880920 11928 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:53.936604  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.880079 12008 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:53.881821 12229 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.936283 12227 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.957512  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2920) took 1991 ms (client timeout 2055 ms). Trace:
I20260709 12:22:53.922212 12255 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:53.924726  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.019s
W20260709 12:22:54.016963  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.002s	sys 0.029s
I20260709 12:22:54.016304 12227 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.017894 11902 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.018244 12008 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:54.003808 12164 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.005s
I20260709 12:22:53.867945  8138 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:54.019356 12255 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:53.850191  8212 rpcz_store.cc:276] 0709 12:22:51.900371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.226563 (+1326192us) service_pool.cc:224] Handling call
0709 12:22:53.240880 (+ 14317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.241198 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:53.241522 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:22:53.678984 (+437462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.679060 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:53.687536 (+  8476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.687636 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.687793 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":552745,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":12362,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":18185,"thread_start_us":418296,"threads_started":1,"wal-append.queue_time_us":567534}
I20260709 12:22:53.872844  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.875440  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:53.875329 11694 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:53.740700 12002 consensus_queue.cc:1175] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92362bf8983f4a71a3511e987a2c6578" responder_term: 9 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:53.883019  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.891489  8217 rpcz_store.cc:276] 0709 12:22:51.467567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.504581 (+ 37014us) service_pool.cc:224] Handling call
0709 12:22:51.510918 (+  6337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.929701 (+418783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.929757 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.931073 (+  1316us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.982726 (+ 51653us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.982786 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.982961 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.563979 (+1581018us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:53.890595 (+326616us) raft_consensus.cc:1685] finished
0709 12:22:53.890619 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.890869 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15790,"raft.queue_time_us":31781,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":22011,"spinlock_wait_cycles":97368832,"thread_start_us":460606,"threads_started":2,"wal-append.queue_time_us":171147}
I20260709 12:22:53.891793  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:53.857436 12139 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.894258  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:53.953465 12277 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:54.022871  8062 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.023308 12277 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:53.753808  8069 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:53.720700 12130 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.896413  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.896474  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.894222  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:53.898471  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:53.895161  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 154514us
I20260709 12:22:53.901204  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:53.880034 12254 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.902985  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:53.906734  8139 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:53.902700  8142 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:53.899039 12265 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.913283  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.018482 11902 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.907385 12258 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.113173 12260 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:54.024469 12277 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.105844  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.121800 12260 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.037791  8063 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:22:53.871344  8141 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:54.105854  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:53.909660 12252 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.113096 12264 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.096419  8068 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.040215  8066 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 5.
I20260709 12:22:53.963496 11843 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.981468 12145 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.957404 12266 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:53.978469 12241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.024s	sys 0.015s
I20260709 12:22:54.124608 12260 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.991011  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:54.126088  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.962795 12217 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:53.953763  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 161837us
I20260709 12:22:54.144397  8070 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.144972  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.145424 12260 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:54.147641 12260 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:54.148990  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:54.127863  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1756) took 1981 ms (client timeout 1679 ms). Trace:
I20260709 12:22:54.129061  8215 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:54.094376  8062 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.128823  8067 raft_consensus.cc:2410] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:53.924917  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 738) took 1828 ms. Trace:
I20260709 12:22:53.980970  8760 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:54.126401  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:54.131532  8146 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:54.001258  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2913) took 2103 ms. Trace:
I20260709 12:22:54.019742 12135 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.091176  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.024648  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.125723 12264 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:53.918336 12251 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.986080  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.126760  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:53.921932 12055 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.127118 11612 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.084270  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.949497 12269 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:54.036827 12216 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.134804 12265 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.043857 11928 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.024420 11694 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.982020  8757 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.956256 12161 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:53.917959 12268 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:54.127465 12252 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:54.138278  8729 connection.cc:256] RPC call timeout handler was delayed by -1.4917161069997746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:22:54.138386 12210 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.016376  8220 rpcz_store.cc:269] 0709 12:22:51.966071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.988134 (+ 22063us) service_pool.cc:224] Handling call
0709 12:22:53.957271 (+1969137us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001b9254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:53.957426 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849437056}
I20260709 12:22:54.020699  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:53.980063  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.140511  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:54.141321  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 249702us
I20260709 12:22:54.141897  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.142045  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 645) took 1079 ms. Trace:
I20260709 12:22:53.999099  8065 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:54.020133  8109 leader_election.cc:403] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:54.142714 12258 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:53.998312  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:53.937448  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.125115  8145 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.130112 12145 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.156183  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:54.150504  8066 rpcz_store.cc:269] 0709 12:22:52.146525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.154213 (+  7688us) service_pool.cc:224] Handling call
0709 12:22:53.321213 (+1167000us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800010598. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:22:54.127656 (+806443us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540004f6d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:54.127759 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669324288}
W20260709 12:22:54.127311  8034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.647s (SENT) [suppressed 23 similar messages]
W20260709 12:22:54.154244  8731 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.002s	sys 0.026s
I20260709 12:22:54.160594  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.148264 12260 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:54.157809  8144 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:54.160135  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2925) took 2191 ms. Trace:
I20260709 12:22:54.168370  8211 rpcz_store.cc:276] 0709 12:22:52.096021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.257014 (+1160993us) service_pool.cc:224] Handling call
0709 12:22:53.257352 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.306310 (+ 48958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.306358 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.308890 (+  2532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.754843 (+445953us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:53.754911 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.755004 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.924569 (+169565us) raft_consensus.cc:1685] finished
0709 12:22:53.924593 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.924805 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":344309,"threads_started":1,"wal-append.queue_time_us":543012}
I20260709 12:22:54.179404  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:54.129524 11843 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.019838 12227 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.125566 11902 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.157670 11700 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.130223 12266 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.129565 12130 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.188475  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.155838 12255 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:54.398782  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.399412  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.164059  8216 rpcz_store.cc:276] 0709 12:22:51.898238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.969813 (+ 71575us) service_pool.cc:224] Handling call
0709 12:22:52.083045 (+113232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:52.130590 (+ 47545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.130630 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:53.274956 (+1144326us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:53.276756 (+  1800us) log.cc:844] Serialized 52 byte log entry
0709 12:22:53.688821 (+412065us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:53.688863 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.688948 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.000685 (+311737us) raft_consensus.cc:1685] finished
0709 12:22:54.000718 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.001043 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":512,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":182,"spinlock_wait_cycles":35799424,"thread_start_us":395308,"threads_started":1,"wal-append.queue_time_us":566113}
I20260709 12:22:54.393590  8061 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:54.392194  8070 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:22:54.371119  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 183242us
I20260709 12:22:54.395066  8218 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.393244  8069 rpcz_store.cc:276] 0709 12:22:53.062947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.435622 (+372675us) service_pool.cc:224] Handling call
0709 12:22:54.141974 (+706352us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:54.353473  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 362211us
W20260709 12:22:54.355198  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.393190  8212 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:53.996423 12262 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.244341  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.403586  8214 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:54.246961  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.398324  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 146008us
I20260709 12:22:54.391969  8141 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 6. Ops: []
W20260709 12:22:54.404639  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.243993  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.243417  8139 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:54.405273  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.188720  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:54.392277  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 747007us
I20260709 12:22:54.404855  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:54.400990  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.406015  8140 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:54.406076  8068 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:54.406488  8070 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:22:54.402588  8729 connection.cc:256] RPC call timeout handler was delayed by -1.378316107000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:22:54.407747  8729 connection.cc:256] RPC call timeout handler was delayed by -1.0575352350001594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 12:22:54.408819  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.412261  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:22:54.412531  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 285231us
I20260709 12:22:54.181162 11999 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:54.127041 12254 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.424113  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:54.424659  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 580955us
I20260709 12:22:54.425032  8761 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:54.393546  8219 rpcz_store.cc:276] 0709 12:22:51.976163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.228867 (+1252704us) service_pool.cc:224] Handling call
0709 12:22:53.236592 (+  7725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.244828 (+  8236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:53.662729 (+417901us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.159724 (+496995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.159782 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:54.159837 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.159931 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.160073 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":549418,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":87,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":49016,"thread_start_us":854090,"threads_started":2}
I20260709 12:22:54.422878  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.423641  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:54.426388  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.426393  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.427150  8066 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.428213  8063 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.430377  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.430925  8065 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:54.431522  8062 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:54.448912  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.449028  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.176582 12135 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.450131  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.448276  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.454618  8069 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
W20260709 12:22:54.440678  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.432900  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.434511  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.451716  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.425606 11999 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.456671  8146 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:54.456790 11999 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.457465 12130 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:54.457623  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:54.458439  8146 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:54.403228 11700 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.459597  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.460922  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.462213  8062 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 11. Ops: []
I20260709 12:22:54.463630  8213 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:54.464005  8061 raft_consensus.cc:2368] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:54.449710  8145 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:54.465510  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.189952 11612 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:54.456043  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.471611  8220 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:54.467710  8212 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:54.471913  8062 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:54.472332  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.472707  8066 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:22:54.462721  8143 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:22:54.428192 12145 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:54.430823 11843 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
I20260709 12:22:54.433864 12229 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.453743 12171 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.482595  8217 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:54.483421  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.479727  8070 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:54.214388 12251 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.490430  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.491735  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.498443  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.499284  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2936) took 1046 ms. Trace:
I20260709 12:22:54.499573  8212 rpcz_store.cc:276] 0709 12:22:53.456349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.498172 (+1041823us) service_pool.cc:224] Handling call
0709 12:22:54.499206 (+  1034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.500695 12217 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:54.500401 12260 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.500986  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:54.501673  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68801.1us
I20260709 12:22:54.502450  8062 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:54.503098  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:54.506465 11700 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:54.506645  8110 connection.cc:256] RPC call timeout handler was delayed by -2.0321530729997903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:22:54.507197  8110 connection.cc:256] RPC call timeout handler was delayed by -1.3567118699997991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3037s for a response
W20260709 12:22:54.507495  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1907623189999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:22:54.507781  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1583623189999344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 12:22:54.508088  8110 connection.cc:256] RPC call timeout handler was delayed by -1.0602623189997757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:22:54.508845  8067 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.509240  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:54.508347  8110 connection.cc:256] RPC call timeout handler was delayed by -1.0512623189997612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:22:54.515643  8217 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:22:54.521503  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45196.1us
W20260709 12:22:54.570201  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.524223 12130 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:54.537984 12251 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:54.539280  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.578119  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:54.519030 12217 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:54.543536 12282 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:22:54.544243 12287 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:22:54.545469 12288 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:54.552772  8142 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:54.543476 11999 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.554232 12192 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:54.558579 12266 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:54.560830 11902 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:54.630388  8762 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:54.567272  8759 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.480891 12145 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:54.568913  8067 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:54.578182  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.579070  8219 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:54.542608  8211 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:54.587270  8070 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:54.423952 12210 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.596567  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.596922  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.636749  8061 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:54.597553  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.600883  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.595427 12229 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:54.598182  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.575024 12171 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:54.566742  8215 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:54.601624  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.652377  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2934) took 1206 ms. Trace:
I20260709 12:22:54.652928  8215 rpcz_store.cc:276] 0709 12:22:53.446201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.880500 (+434299us) service_pool.cc:224] Handling call
0709 12:22:54.652281 (+771781us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:54.670208  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.652730  8760 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:54.678395  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.679104  8068 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:22:54.680779  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:54.681766  8215 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:54.643764  8066 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:54.650051  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.599390  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.637072 12145 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:54.603876 12251 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:22:54.695411  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.696070  8762 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:54.692602  8070 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:22:54.693816  8068 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:54.695796  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 138800us
I20260709 12:22:54.629401 12263 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:22:54.707780  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:54.709998  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 170787us
I20260709 12:22:54.711731  8068 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:54.709802  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 113056us
I20260709 12:22:54.714377  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.714996  8069 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:54.724987 12171 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.728709  8219 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:54.732177  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.733614  8069 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:54.745682 11999 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:54.750732  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.752655 12229 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:54.753233 12229 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:54.754086 12255 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:54.754601 12255 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:54.756115  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.735111  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.758020  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.759322 12296 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:54.759909  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2935) took 1313 ms. Trace:
I20260709 12:22:54.760337  8219 rpcz_store.cc:276] 0709 12:22:53.446518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.688409 (+1241891us) service_pool.cc:224] Handling call
0709 12:22:54.707083 (+ 18674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.759610 (+ 52527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.759842 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.761111  8068 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:54.763706  8065 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:54.765342  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 63976.9us
I20260709 12:22:54.767254  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.770388  8063 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:54.770702  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.771646  8764 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:54.772647  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.773396  8065 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.762977  8214 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:22:54.762878  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.781605  8069 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:54.784121  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 744) took 1128 ms. Trace:
I20260709 12:22:54.785503  8214 rpcz_store.cc:276] 0709 12:22:53.655945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.215085 (+559140us) service_pool.cc:224] Handling call
0709 12:22:54.784051 (+568966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.763618 12251 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:54.803704  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:54.811275  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.788800  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.765113 12265 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:22:54.825796  8068 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:54.827363  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.827649  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:54.785773 12217 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:54.794333  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:54.825186  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47399.8us
I20260709 12:22:54.831872  8066 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:54.791399  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.826084  8069 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:54.825932  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.833786  8062 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:54.786463 11928 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:54.829241  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46725.8us
I20260709 12:22:54.834946  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.836789  8214 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:54.837459  8068 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:54.827857 12177 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:54.840076  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.840668  8066 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:22:54.841602  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.842343  8066 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:54.844643  8066 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:54.845484  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48108.7us
W20260709 12:22:54.847247 12301 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:54.848182 12210 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:54.754127 12229 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.849517  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:54.850756 12177 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:54.851429 12177 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:54.851785 12177 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:54.852759 12177 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.854028 12177 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.846975  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:54.856345 12258 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:54.857040  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65733.4us
I20260709 12:22:54.857196 12258 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:54.858109 11928 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:22:54.859511  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.797935 12251 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:54.797113 12192 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:54.869359 12192 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.863591  8216 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:54.903924  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.904347  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2938) took 1436 ms. Trace:
I20260709 12:22:54.904803  8066 raft_consensus.cc:2376] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10. Re-sending same reply.
I20260709 12:22:54.904845  8216 rpcz_store.cc:276] 0709 12:22:53.471746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.434265 (+962519us) service_pool.cc:224] Handling call
0709 12:22:54.904286 (+470021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.906106  8216 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:54.906663  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 742) took 1321 ms. Trace:
I20260709 12:22:54.906950  8216 rpcz_store.cc:276] 0709 12:22:53.585661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.905638 (+1319977us) service_pool.cc:224] Handling call
0709 12:22:54.905929 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.906453 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.906617 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.864856  8061 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:54.864284  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:54.865032 12241 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.887897  8764 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:54.829623 11902 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:22:54.829335 12297 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:54.907442  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.910730  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:54.918177  8061 raft_consensus.cc:2376] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7. Re-sending same reply.
I20260709 12:22:54.923467  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:54.924167  8764 raft_consensus.cc:2376] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:22:54.926503  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:54.936805  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72601.8us
I20260709 12:22:54.941398  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.942502  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.923276 12297 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:54.949798 12300 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:22:54.950100 12305 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.928022 12241 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:54.952762  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 743) took 1324 ms. Trace:
I20260709 12:22:54.953621  8214 rpcz_store.cc:276] 0709 12:22:53.622975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.909475 (+1286500us) service_pool.cc:224] Handling call
0709 12:22:54.930914 (+ 21439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.941553 (+ 10639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.941587 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.946800 (+  5213us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:54.946853 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.946934 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.947066 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.938774 12130 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:54.955947  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.957537 12130 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.957150 11928 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:54.960213 12130 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:54.960458 11928 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.962733 11928 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:54.963617 12306 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:54.965313 12216 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:54.965826 12216 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:54.966027 12296 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:54.967408  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.968225  8061 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:54.969359  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:54.975230 11612 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:54.975785 12145 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:54.976528  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2939) took 1497 ms (client timeout 1991 ms). Trace:
W20260709 12:22:54.980881  8213 rpcz_store.cc:269] 0709 12:22:53.478861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.905210 (+426349us) service_pool.cc:224] Handling call
0709 12:22:54.976346 (+1071136us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400168fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:54.976468 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745084800}
I20260709 12:22:54.981257 12135 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:54.981690 12216 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:54.982546  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 746) took 1284 ms. Trace:
I20260709 12:22:54.982923  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.982898  8213 rpcz_store.cc:276] 0709 12:22:53.697775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.981714 (+1283939us) service_pool.cc:224] Handling call
0709 12:22:54.982009 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.982207 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.982231 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.982269 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:54.982301 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.982382 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.982489 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:54.984354  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.978209  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 758) took 1186 ms. Trace:
I20260709 12:22:54.977427 12241 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:54.950736 12305 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:54.977005  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:54.937296 12298 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:22:54.993278  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:54.994592  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.004843  8068 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:54.997462  8142 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:54.992084  8143 rpcz_store.cc:276] 0709 12:22:53.792210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.793167 (+   957us) service_pool.cc:224] Handling call
0709 12:22:54.978021 (+1184854us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54001c3ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:54.978128 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281981824}
I20260709 12:22:55.009545  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.010169  8061 raft_consensus.cc:2376] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9. Re-sending same reply.
I20260709 12:22:54.992867 11928 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:22:55.024861  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.025738  8068 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:55.005995  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.030378  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 745) took 1365 ms. Trace:
W20260709 12:22:55.030855  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 89527.6us
I20260709 12:22:55.030817  8214 rpcz_store.cc:276] 0709 12:22:53.665418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.954897 (+1289479us) service_pool.cc:224] Handling call
0709 12:22:54.991851 (+ 36954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.023646 (+ 31795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.023690 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.030100 (+  6410us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:55.030139 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.030200 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.030314 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.032207  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.033092  8068 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:55.034950  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.035903  8061 raft_consensus.cc:2368] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:55.035043  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.037057  8764 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
W20260709 12:22:55.041376  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 139139us
W20260709 12:22:55.036918  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 110525us
I20260709 12:22:55.043941  8214 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:55.044610  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1751) took 1218 ms. Trace:
I20260709 12:22:55.046437  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.045552  8214 rpcz_store.cc:276] 0709 12:22:53.825929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.032785 (+1206856us) service_pool.cc:224] Handling call
0709 12:22:55.043749 (+ 10964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.044345 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.044545 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.048962  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 664) took 1313 ms. Trace:
I20260709 12:22:55.050009  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.050835  8765 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:22:55.049330  8761 rpcz_store.cc:276] 0709 12:22:53.731466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.740685 (+  9219us) service_pool.cc:224] Handling call
0709 12:22:55.044547 (+1303862us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54005000d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.044696 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258642688}
W20260709 12:22:55.052464  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59308.3us
I20260709 12:22:55.053664  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.046005  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.062479  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.063266  8214 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:55.034857 12216 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.065935  8065 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 6.
I20260709 12:22:55.065809  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.043417 11928 consensus_queue.cc:1243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:55.070194  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1752) took 1194 ms. Trace:
I20260709 12:22:55.070722  8214 rpcz_store.cc:276] 0709 12:22:53.869700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.047766 (+1178066us) service_pool.cc:224] Handling call
0709 12:22:55.063027 (+ 15261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.064009 (+   982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.064271 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.072432  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.088323  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.090065  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1750) took 1279 ms. Trace:
I20260709 12:22:55.090745  8061 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:55.091352  8065 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.061378 12258 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:55.100744 12302 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:22:55.091224  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.101661  8761 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:22:55.102346  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1783) took 1029 ms. Trace:
I20260709 12:22:55.102573  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:55.102766  8067 rpcz_store.cc:276] 0709 12:22:54.149233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.155863 (+  6630us) service_pool.cc:224] Handling call
0709 12:22:55.102184 (+946321us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540004f6d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.102288 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262958976}
I20260709 12:22:55.103756  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.104179  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1760) took 1116 ms. Trace:
I20260709 12:22:55.104426  8761 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:55.104590  8217 rpcz_store.cc:276] 0709 12:22:53.987387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.024309 (+ 36922us) service_pool.cc:224] Handling call
0709 12:22:55.104006 (+1079697us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400373554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.104120 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724870400}
I20260709 12:22:55.105465  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.106272  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1756) took 1120 ms. Trace:
I20260709 12:22:55.099474 11999 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:55.106914 12279 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.635s	user 0.001s	sys 0.000s
I20260709 12:22:55.107072 11999 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:55.108383 12289 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.618s	user 0.000s	sys 0.001s
I20260709 12:22:55.109081  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:55.109501  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.109920 12142 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:55.110304 12142 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:55.110500  8216 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 4. Current term is 6. Ops: []
I20260709 12:22:55.110699 12142 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.111136  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1757) took 1125 ms. Trace:
I20260709 12:22:55.111467  8216 rpcz_store.cc:276] 0709 12:22:53.986255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.110083 (+1123828us) service_pool.cc:224] Handling call
0709 12:22:55.110336 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.110921 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.111088 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.113821  8140 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:55.114537 11843 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.115306  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.108086 11999 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.116590 11999 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.096468  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 741) took 1511 ms. Trace:
I20260709 12:22:55.117739  8758 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:55.115005 11843 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.064400 12171 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.106868  8761 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:55.122862  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 220579us
I20260709 12:22:55.106663  8217 rpcz_store.cc:276] 0709 12:22:53.985858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.105456 (+1119598us) service_pool.cc:224] Handling call
0709 12:22:55.105734 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.105948 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.105975 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.106017 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:55.106059 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.106116 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.106220 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.116134  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.072436 12135 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.145052  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.146322  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:55.146978  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.147440 12265 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:55.118012  8212 rpcz_store.cc:276] 0709 12:22:53.584922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.882830 (+1297908us) service_pool.cc:224] Handling call
0709 12:22:54.929635 (+ 46805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.964580 (+ 34945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.964611 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.965184 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.028064 (+ 62880us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:55.028108 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.028181 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.096246 (+ 68065us) raft_consensus.cc:1685] finished
0709 12:22:55.096264 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.096406 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10978,"raft.queue_time_us":19340,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":62550,"threads_started":1,"wal-append.queue_time_us":95730}
I20260709 12:22:55.149258 12217 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:55.149441  8212 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:55.149794 12217 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:55.150751 12217 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:55.131458  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.152908 11914 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:55.154256  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 101332us
I20260709 12:22:55.154363 11914 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:55.155079  8110 leader_election.cc:400] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6.
I20260709 12:22:55.155434  8110 leader_election.cc:403] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:55.132263  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69870.2us
I20260709 12:22:55.145080 12135 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:22:55.155998 12313 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 5. Current term is 6.
I20260709 12:22:55.133764  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.134716  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.157231  8137 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:22:55.134268  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.158912  8144 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 6: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:55.090139 12305 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.140875  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.141417 11612 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:55.160904  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.141569  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.162034  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.162242  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.163044  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.142370  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.142969  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.164211  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.124396 12298 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.173476 12268 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:55.173578 12298 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.174077 12298 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.174716 11612 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:55.175117 11612 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.175455 11612 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.173709  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.143685 12314 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:22:55.135178  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.178305  8143 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:22:55.178905  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.174011 12268 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.180521 12254 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.180903 12268 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.153301 12145 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.066705 12304 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:22:55.154963 11914 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.132977  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.156283  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:55.123551  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.185786  8765 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:55.186095  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.169893  8214 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:22:55.187448  8214 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 4
I20260709 12:22:55.164070  8140 raft_consensus.cc:2376] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:22:55.036147 12297 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.119426 12307 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.181806  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49226 (request call id 89) took 1189 ms. Trace:
I20260709 12:22:55.207623  8216 rpcz_store.cc:276] 0709 12:22:53.988165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.112156 (+1123991us) service_pool.cc:224] Handling call
0709 12:22:55.177207 (+ 65051us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:55.208236  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.122802 12258 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:55.183820  8217 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:55.167016  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.210011  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2945) took 1274 ms. Trace:
I20260709 12:22:55.210381  8211 rpcz_store.cc:276] 0709 12:22:53.935399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.421482 (+486083us) service_pool.cc:224] Handling call
0709 12:22:55.209857 (+788375us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400374454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.209957 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213755264}
I20260709 12:22:55.212245  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.213621  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.177042  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.188277  8214 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:22:55.072901 12255 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.232005 12255 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.130779 12216 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:55.232954 12216 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.235540 12216 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:55.207293 12171 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:55.236975  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 70041.4us
I20260709 12:22:55.237684 12171 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:55.238148 12171 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.238431  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.239805 12314 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.240260 12314 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:55.240723 12314 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.127863 12192 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:22:55.189095  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.195976 12265 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:55.196041 12305 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:55.182612 12130 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.198139 12262 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:55.184852 12312 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:55.204187 12313 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:55.206874  8765 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:55.215210  8214 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.217140 12254 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.217075 12266 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.218185 11914 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.221576  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1830) took 1082 ms. Trace:
W20260709 12:22:55.225675  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 668) took 1493 ms (client timeout 1832 ms). Trace:
I20260709 12:22:55.226428 11843 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:55.229692 12161 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:55.248090  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62690.4us
I20260709 12:22:55.268603  8142 rpcz_store.cc:276] 0709 12:22:54.139208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.140201 (+   993us) service_pool.cc:224] Handling call
0709 12:22:55.221357 (+1081156us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000442d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.221501 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366265728}
W20260709 12:22:55.269461  8759 rpcz_store.cc:269] 0709 12:22:53.751095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.875129 (+124034us) service_pool.cc:224] Handling call
0709 12:22:55.225472 (+1350343us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54003106d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.225602 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191028608}
W20260709 12:22:55.273784  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.263803 12313 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.251468 12305 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.282281 12305 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.283051 12311 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:55.215885 12258 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.253816  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.284825 12145 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:55.285224 12145 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:55.285708 12145 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.266098 12254 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.286370 12254 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.287825 12260 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.288241 12277 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.288710 12277 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.262600 12216 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.262225 12255 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.259189  8216 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:55.274915  8764 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:22:55.276484  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2942) took 1342 ms. Trace:
I20260709 12:22:55.277439 11723 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:22:55.297693 11723 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.297930  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:55.298655  8216 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.298576 12171 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.277719 12313 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.278842 11914 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.280263 12307 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:55.280448  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53335.5us
I20260709 12:22:55.280448 12130 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:55.266309 12266 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.281778 12306 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:55.263441 12312 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.249653  8065 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:22:55.291743  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:55.254999  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76192.5us
W20260709 12:22:55.290886  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 159686us
I20260709 12:22:55.293768  8214 rpcz_store.cc:276] 0709 12:22:53.934337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.071733 (+1137396us) service_pool.cc:224] Handling call
0709 12:22:55.090548 (+ 18815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.276150 (+185602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.276414 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.298058 11723 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.277354 12265 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.259894 12142 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:55.309041  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 145468us
I20260709 12:22:55.328768 12313 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:55.315215  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 130755us
I20260709 12:22:55.330186  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.330591 12142 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:55.331604  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.331701 12266 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.318413  8214 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:55.321784 12312 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.333585 12255 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:55.334347 12255 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.315932  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.335896  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.285275 12258 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:55.324419  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 86104.3us
I20260709 12:22:55.337355  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:55.339521  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47836us
I20260709 12:22:55.348264  8216 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:55.349745  8212 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:22:55.319744 12229 raft_consensus.cc:2764] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:55.342533 12142 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:55.336858 12306 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.356858  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.315883 12262 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:22:55.394616  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57370.5us
I20260709 12:22:55.399151  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:55.371625  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.397233 12142 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:55.402240 12142 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.402899 12142 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.358433 12258 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:55.405433 12320 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:22:55.406198  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.407994  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.412869  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.355394 12266 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.414755  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.411042 12258 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:55.416144  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.301143 12277 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.439891 12277 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.440261  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 740) took 1856 ms. Trace:
I20260709 12:22:55.440725  8218 rpcz_store.cc:276] 0709 12:22:53.583979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.828379 (+1244400us) service_pool.cc:224] Handling call
0709 12:22:54.978719 (+150340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.979114 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.979143 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.979632 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.028303 (+ 48671us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:55.028354 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.028434 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.180699 (+152265us) raft_consensus.cc:1685] finished
0709 12:22:55.180723 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.439998 (+259275us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400168fd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:55.440196 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2807,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":344979200,"thread_start_us":47637,"threads_started":1,"wal-append.queue_time_us":92799}
W20260709 12:22:55.444722 12130 consensus_queue.cc:1175] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92362bf8983f4a71a3511e987a2c6578" responder_term: 12 status { last_received { term: 11 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:55.420158 12268 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.414902 12161 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:55.447837 12268 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.419660 12327 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.400954 12192 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:55.437016  8758 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:22:55.354854 12307 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:55.477413  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 141591us
W20260709 12:22:55.477679  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63767.8us
W20260709 12:22:55.478497  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53665.8us
I20260709 12:22:55.474820 12307 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.531639  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.542716  8146 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:55.483948 12258 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:55.485212 12314 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.421452 11902 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:55.416941 12326 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.495666 12305 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.472405 12255 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.497378  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1768) took 1560 ms. Trace:
I20260709 12:22:55.498538 12306 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.352442 11612 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.501875 12142 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.419715 12241 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:22:55.504282 12171 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.571401 12142 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.504941 12327 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.506009 12264 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:55.475390 12192 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.573086  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.573197 12192 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.574429  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.575629  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.576332  8217 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:22:55.510480  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 109354us
I20260709 12:22:55.576972  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.578380  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:55.510792  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 353721us
I20260709 12:22:55.514153 12210 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:55.523525  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.524348  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.581841  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:55.582428  8215 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.524518 12324 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.526293  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.526969  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:55.529006  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 96865.4us
W20260709 12:22:55.536929  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 198471us
W20260709 12:22:55.537675  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98119us
I20260709 12:22:55.599205  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:55.556537  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.592243 12328 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:55.549292 12307 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.559127  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.560364  8064 rpcz_store.cc:276] 0709 12:22:53.937453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.940655 (+  3202us) service_pool.cc:224] Handling call
0709 12:22:53.941233 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.431770 (+490537us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:55.097875 (+666105us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b1800177220. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:22:55.246171 (+148296us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.353221 (+107050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.357244 (+  4023us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.357380 (+   136us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:55.358772 (+  1392us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.362028 (+  3256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.434217 (+ 72189us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001f6154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:55.434262 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.497151 (+ 62889us) raft_consensus.cc:1685] finished
0709 12:22:55.497172 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.497316 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23474,"prepare.queue_time_us":220974,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":6694,"raft.queue_time_us":40898,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":24521,"spinlock_wait_cycles":1234068096,"thread_start_us":236606,"threads_started":2,"wal-append.queue_time_us":223296}
I20260709 12:22:55.555670  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.625136  8214 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:55.091385  8213 rpcz_store.cc:276] 0709 12:22:53.811024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.984031 (+1173007us) service_pool.cc:224] Handling call
0709 12:22:54.984323 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.984540 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:54.987210 (+  2670us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.089682 (+102472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.089744 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:55.089791 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.089865 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.090003 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":748,"prepare.queue_time_us":193,"prepare.run_cpu_time_us":4090,"prepare.run_wall_time_us":6755,"raft.queue_time_us":12696,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":51542,"threads_started":1}
I20260709 12:22:55.524930  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.525625  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.561811 12326 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:55.627043  8141 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:55.627092  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.627827  8142 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.580494 12210 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:55.564570  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:22:55.591209  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.556697 11999 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:55.592142  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.630029  8218 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:55.592720 12258 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.587191 12241 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.586233 12305 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.595739  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.557680  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.617556 12324 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.618162  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:55.558619  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.568226 11612 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:55.619530  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.622305 12217 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.618672  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.618958 12328 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:55.629096  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67360.3us
W20260709 12:22:55.631853  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78457.4us
I20260709 12:22:55.635540 12260 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:55.684160 12260 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.685662 12260 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.496542 12254 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.688289  8212 raft_consensus.cc:2368] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
I20260709 12:22:55.689167 12324 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.689831 12254 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:55.690647 12324 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.622452 12161 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:55.660527 11700 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.627393 12326 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.639323  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.641975 12210 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.642791 12327 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:55.706245 12055 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:55.643481 12241 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.556576 12313 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:22:55.631430 12265 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:22:55.718062  8214 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:55.648411  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52776.5us
I20260709 12:22:55.720557  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.654280  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:55.657189  8215 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:22:55.621268  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.659839  8035 connection.cc:256] RPC call timeout handler was delayed by -1.0274778150001111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:22:55.725883  8035 connection.cc:256] RPC call timeout handler was delayed by -1.0184778150000966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 12:22:55.589318  8219 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:55.560820 12299 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:22:55.629292  8211 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:55.622273 12264 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:55.695006 12328 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.631286 11999 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:55.635406 12255 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:22:55.559806 11902 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.694805 12217 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.695999  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2916) took 1095 ms. Trace:
I20260709 12:22:55.699558  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:22:55.762697  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:55.646587  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:55.619181 12298 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.708539  8218 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:55.774565  8070 rpcz_store.cc:276] 0709 12:22:54.600307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.649530 (+ 49223us) service_pool.cc:224] Handling call
0709 12:22:54.649800 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.697396 (+ 47596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.695692 (+998296us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400322dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:55.695921 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80945920}
W20260709 12:22:55.704916  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.716121 12251 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.716797  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.729053  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.780179  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.768134  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.781530  8061 raft_consensus.cc:2376] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10. Re-sending same reply.
I20260709 12:22:55.781629  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.730592  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.745147  8068 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:22:55.782436  8067 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:55.683004  8220 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:22:55.783463  8066 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:55.746205  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.784314  8065 raft_consensus.cc:2376] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13. Re-sending same reply.
I20260709 12:22:55.732754  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.750356  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:55.753780  8062 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [10.9-11.10]
W20260709 12:22:55.754307  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 115086us
I20260709 12:22:55.767727  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.767342  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:55.790628  8763 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.756642  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:55.746279 12263 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:55.775099  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.760982  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:55.755597  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.806572  8069 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:55.716004 12327 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.745674  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.808426  8063 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:22:55.808485  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.756832  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:55.763897 12338 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.811012  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:55.811348  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:55.811774  8061 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.761210 12264 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:55.753307 11999 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.812911  8138 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:55.760803 12297 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.774642 12314 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:55.759212 12216 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:55.819931  8756 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:55.719667 12241 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.785698 12333 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.824985  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.826846  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.814005 12145 consensus_meta.cc:287] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
W20260709 12:22:55.829516  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96870.6us
I20260709 12:22:55.801569 12304 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:55.836213  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:55.809046 12255 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:55.847090  8061 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:55.854698  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:55.774484 12312 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.825680 12210 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.857149  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.861644  8141 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.815670 12264 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:55.855751  8142 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:55.824819 12216 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:22:55.860720  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98092.4us
W20260709 12:22:55.864740  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.879460  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.880137  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:55.881662  8142 raft_consensus.cc:2376] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
W20260709 12:22:55.882957  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46827.5us
I20260709 12:22:55.894214  8141 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:55.895543  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:55.896974  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:55.897306  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.762382 11723 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.840832 11902 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.850685 12277 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:22:55.851974 12145 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:55.870404 12265 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.955389  8142 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:55.957403  8143 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:55.958441  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74485.3us
W20260709 12:22:55.959793  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 167840us
I20260709 12:22:55.960553  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:55.961197  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.858947 12251 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.961426  8141 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:22:55.963771  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68316.4us
I20260709 12:22:55.868498 12304 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:55.961413  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.972653  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:55.931777 12303 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:55.966877  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:55.932852 12334 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:22:55.965818 11723 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.849511 12333 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.933851 12338 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:55.957199 12241 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.968603 12265 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:55.997556  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:56.000104 12346 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:56.002456 12341 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 12:22:56.041713  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:56.005684 12343 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:22:55.993086 11700 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:56.006381  8763 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
W20260709 12:22:56.051219  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69256.3us
I20260709 12:22:55.979807 12055 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:55.988205 11612 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.980496 12303 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:56.050731  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53274.4us
W20260709 12:22:56.006605 12345 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:22:55.895744 12264 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.938061 12327 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:55.987910 12008 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:22:56.071837  8758 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.041270 12346 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.989293 12192 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:56.074402  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 90020.6us
I20260709 12:22:56.077662  8760 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:56.063072 12338 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:56.082723  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.084277  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:56.062697 12298 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.086524  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.069782 12258 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.090001  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.093945  8142 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:56.096095  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.097201  8145 raft_consensus.cc:2368] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13.
I20260709 12:22:56.075956 12217 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.076835 12346 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.997263 12216 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.070118 12314 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:56.100172 12229 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.080662 11612 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:56.076252 12266 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:22:56.088792 12313 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.128178 12321 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.085068 12265 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:56.129331 12322 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:22:56.093401 12268 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:56.100692 12258 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:56.138491  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52003.4us
I20260709 12:22:56.139855  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.144132 12130 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:56.144758 11999 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.147373  8061 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:56.136446  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 331725us
I20260709 12:22:56.149212  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:56.117259 12312 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.125507 12314 consensus_queue.cc:1243] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:22:56.155376  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.180510  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:56.180871  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.181852  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:56.182137  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:56.182626  8140 raft_consensus.cc:2368] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14.
I20260709 12:22:56.151649 12258 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.185083  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.185484 12333 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.186470 11999 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:56.180606  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:56.189110  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:56.189271  8062 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.189702  8069 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:22:56.217785  8062 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:56.148927 12008 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:56.226385  8061 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:56.225560  8142 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:56.133886 12313 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.128760 12321 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.185492 12258 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.192723 12145 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:56.224210 11843 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:56.076522 12304 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.117486 12303 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.137749 12268 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.148953 12130 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.242843  8063 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:56.256827  8142 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:56.260818 11612 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.265405 12321 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.267795 12192 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:56.268613 12307 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.006s
I20260709 12:22:56.284957  8142 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:56.284066  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:56.286149  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:56.285060 12307 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.289115 12307 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.270339 12313 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.273155  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:56.292375  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.292588  8757 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:22:56.296339  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 157953us
I20260709 12:22:56.303444  8142 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
W20260709 12:22:56.272401 12328 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.002s
I20260709 12:22:56.308342  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:56.279665 12296 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:56.330735 12296 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:56.316195 11999 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:56.331804 11999 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:56.331693 12296 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.333043 11999 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.319500  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1846) took 1200 ms. Trace:
I20260709 12:22:56.335613 12328 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.321903  8731 leader_election.cc:400] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13.
I20260709 12:22:56.336777  8731 leader_election.cc:403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.336371  8138 rpcz_store.cc:276] 0709 12:22:55.118747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.118859 (+   112us) service_pool.cc:224] Handling call
0709 12:22:56.319235 (+1200376us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400312254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:56.319416 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508363136}
I20260709 12:22:56.337594 12311 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:56.275629 12268 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.277568 12130 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.337875  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.273629 12303 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.328266 11914 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:56.330322 12326 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
W20260709 12:22:56.344609  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.348564  8731 leader_election.cc:400] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14.
I20260709 12:22:56.350296  8731 leader_election.cc:403] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.350823  8137 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.354404  8144 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:22:56.353929  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45679.6us
I20260709 12:22:56.333040 12296 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:56.360152  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 392468us
I20260709 12:22:56.359459 12260 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:56.348129 12130 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.379899  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.374270  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:56.380824  8061 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:56.347579 12055 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:56.378384  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:56.388167  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:56.388473  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:56.388828  8068 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:56.386044  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:56.390197  8146 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.390697  8146 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:56.390969  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.392484  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:56.392612  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:56.393275  8760 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:56.392411  8062 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:56.393435  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:56.396775  8069 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:56.393705  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.373354 12241 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:56.314999  7955 maintenance_manager.cc:643] P d9f88eae4422483fae5be30b0540c616: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.616s	user 0.198s	sys 0.062s Metrics: {"bytes_written":30090,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":466266,"dirs.run_cpu_time_us":585,"dirs.run_wall_time_us":25912,"drs_written":1,"lbm_read_time_us":530,"lbm_reads_lt_1ms":4,"lbm_write_time_us":369422,"lbm_writes_10-100_ms":6,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":152903,"threads_started":1,"update_count":8}
I20260709 12:22:56.397502  8139 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:56.383023 12002 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.403317 12002 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.374974 12333 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:22:56.405359 12333 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:56.408793  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:56.401539 12297 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.350363 12326 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.393134 12304 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:56.549816 12304 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.550190 12304 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:56.406327 12229 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:56.401068 12328 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.413365  8062 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:56.554250  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:56.554914  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.406455  8146 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:56.528228 12363 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.143s	user 0.002s	sys 0.004s
I20260709 12:22:56.529938  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.537003 12346 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.555691  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.559850 12346 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.560922  8146 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.561120  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.563048  8145 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:22:56.462110  8035 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.401216 12265 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:56.410092 11612 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.548143 12338 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:56.548813 12311 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13.
I20260709 12:22:56.410113 12333 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:56.551918 12326 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.564596 12002 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:56.548883  8764 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:56.543166  8140 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:56.549252  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.540253 12216 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.549388  8068 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:22:56.548610  8137 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:22:56.573055  8729 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.676s (SENT)
W20260709 12:22:56.783852  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 210822us
I20260709 12:22:56.551236  8061 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:56.591895  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:56.785517 12298 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.786173  8213 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:56.786139 12298 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.592022  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:56.593021  8212 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.613775  8214 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:56.614236 12130 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.789129  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:56.789578 12130 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.791239 12263 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:56.791718 12263 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.792100 12263 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:56.794766 12277 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:56.796139 12277 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:56.635753  8211 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:56.645581  8760 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:22:56.644492 12378 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.798002 12378 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.800836 12378 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:56.587728 12297 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.801800 12329 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:56.803205 12297 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.647281 12145 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.804104 12145 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.806905 12145 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:56.807639 12277 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:56.809008 12277 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.810906 12277 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.617725 12055 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.792289 12130 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.784262  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1733) took 1081 ms. Trace:
I20260709 12:22:56.813488  8137 rpcz_store.cc:276] 0709 12:22:55.702635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.702756 (+   121us) service_pool.cc:224] Handling call
0709 12:22:56.784037 (+1081281us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400352854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:56.784184 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314887040}
W20260709 12:22:56.673995 12370 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:22:56.823751  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:56.824568  8211 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:22:56.548206  8069 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:22:56.680883  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 267166us
I20260709 12:22:56.682051 12265 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.683190 12333 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.831714 12229 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:56.833982  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:56.834892  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.835395  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.519400  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 131754us
I20260709 12:22:56.684886 12241 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14.
I20260709 12:22:56.691135  8757 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:22:56.680116 12340 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.998s	user 0.010s	sys 0.006s
I20260709 12:22:56.836206  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:56.836123  8729 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.699s (SENT)
I20260709 12:22:56.693441 12304 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:56.653121 12262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.011s	sys 0.012s
I20260709 12:22:56.795969 12351 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:56.838089  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 610) took 1790 ms. Trace:
I20260709 12:22:56.580472 12268 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:56.804749  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.839355 12304 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.838536  8761 rpcz_store.cc:276] 0709 12:22:55.048037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.246838 (+198801us) service_pool.cc:224] Handling call
0709 12:22:55.247293 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.352117 (+104824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.352162 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.394698 (+ 42536us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.627664 (+232966us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:55.627703 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.627768 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.420487 (+792719us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:56.837750 (+417263us) raft_consensus.cc:1685] finished
0709 12:22:56.837774 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.838017 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16644,"raft.queue_time_us":33494,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":42681600,"thread_start_us":298338,"threads_started":2,"wal-append.queue_time_us":269093}
I20260709 12:22:56.840088 12304 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:56.841109  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:56.841542 12338 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:56.842609 12241 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:56.843079 12241 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.843477 12241 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:56.844782  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.845597 12304 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:56.709097  8138 raft_consensus.cc:2368] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10.
I20260709 12:22:56.846758 12338 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:56.846684 12304 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.848040 12265 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:56.854424  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:56.855237  8763 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:56.847914 12338 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.857211 12338 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:56.850267 12263 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.859107 12338 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.849808  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:56.862191 12263 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.862996 12263 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.863615 12263 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.867733  8760 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:56.869591  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:56.870306 12263 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.883275  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.884292  8140 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:56.880271  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:56.888547  8138 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:22:56.870311  8764 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:56.890880 12377 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
W20260709 12:22:56.838107  8729 leader_election.cc:336] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.802s (SENT)
I20260709 12:22:56.896853  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:56.897789 12263 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.898411  8761 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
W20260709 12:22:56.899302  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61235.2us
I20260709 12:22:56.903892  8764 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:56.893162 12338 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.905407 12298 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:56.920987 12333 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.930889  8142 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:22:56.934935 12241 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:56.939877 12262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.011s	sys 0.012s
I20260709 12:22:56.941269 12229 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:56.941445  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107551us
I20260709 12:22:56.941864 12229 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:56.942308 12229 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:56.861243  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.944355  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 1.40326e+06us
W20260709 12:22:56.945712  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.946039  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:56.946172  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.949709  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.949898  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.951557  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:56.952207  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.952585  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:56.954550  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:56.958292  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:56.958729  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.960186  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.961663  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.962718 12216 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:56.963143  8184 leader_election.cc:400] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10.
I20260709 12:22:56.963311 12216 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:56.964411 12216 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.969240 12378 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:56.969785 12378 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:56.970247 12378 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:56.964902 12372 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:56.973239 12372 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:56.974275 12372 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.942374  8035 leader_election.cc:400] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
I20260709 12:22:56.976787  8035 leader_election.cc:403] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.964430  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:56.983630 12378 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:56.988504 12385 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:56.989080 12216 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:56.990471 12216 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:56.991024 12378 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:56.989311  7956 maintenance_manager.cc:419] P d9f88eae4422483fae5be30b0540c616: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9614 bytes on disk
I20260709 12:22:56.992223 12385 raft_consensus.cc:2764] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:56.994199  7955 maintenance_manager.cc:643] P d9f88eae4422483fae5be30b0540c616: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":505,"lbm_reads_lt_1ms":4}
I20260709 12:22:56.989450  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.999897  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:56.995499 12378 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:57.004551  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1725) took 1482 ms. Trace:
I20260709 12:22:57.005026 12378 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:57.005069  8144 rpcz_store.cc:276] 0709 12:22:55.522569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.526053 (+  3484us) service_pool.cc:224] Handling call
0709 12:22:57.004317 (+1478264us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400042754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:57.004481 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740815104}
I20260709 12:22:57.006227 12378 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:56.991665 12216 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:57.007102  8184 connection.cc:256] RPC call timeout handler was delayed by -1.3999286770003891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:22:57.007555  8184 connection.cc:256] RPC call timeout handler was delayed by -1.2993186539997623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 12:22:57.007730 12372 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:57.007920  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0753662470001473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 12:22:57.008203 12372 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.008666 12372 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.010630  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.010905  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.012190  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.012360  8217 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:57.013017  8220 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:57.013512  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.013854  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:57.014503  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.015358  8220 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:57.015699  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:57.016307  8217 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:57.016979  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.017786  8218 raft_consensus.cc:2368] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:22:57.017603  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:57.018668  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.019449  8216 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:57.019985  8219 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 11. Ops: []
I20260709 12:22:57.018712  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.021015  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:57.021138  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.021898  8143 raft_consensus.cc:2368] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14.
I20260709 12:22:57.016393  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:57.022632  8220 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.024936  8140 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:57.025017 12385 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:57.019995  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:57.026925  8137 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:22:57.030829  8220 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:57.007117  8141 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:57.020435  8139 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:57.034626  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.035661  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:57.036346  8145 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:57.037109  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:57.038501  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:57.039177  8140 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:57.020393  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:57.040432  8216 raft_consensus.cc:2376] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:22:57.041632  8216 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:57.042749  8216 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.044132  8216 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:57.050643 12135 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.051303 12135 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.055073 12296 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.055684 12296 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.057616 12142 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:57.058148 12142 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.058558 12142 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.059201 11999 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:57.061461 12135 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:57.064105 12296 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.064791 12296 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.065325 12296 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.065620 12304 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:57.066468 12304 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:57.021706  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:57.068301  8218 raft_consensus.cc:2376] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:22:57.067746 12304 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.070600  8218 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:57.070892 12135 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.072289 12135 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.073726 12338 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:57.032382  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.077332  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.078542  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.079046  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.054482 12372 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.084931 12385 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:57.076730 12338 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.084657 12142 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.088227 12338 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:57.088340  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68425.5us
I20260709 12:22:57.089512  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:57.091313 12388 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.094656 12135 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:57.096966 12142 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:57.098295  8217 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:22:57.108801  8070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.019s
W20260709 12:22:57.109366  8070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.019s
I20260709 12:22:57.099589 12296 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.112004 12296 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:57.112735 12296 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:57.114444 12296 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.119349  8064 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:57.121085  8211 raft_consensus.cc:2368] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10.
I20260709 12:22:57.123353 12372 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:57.124888 12385 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:57.172086  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.285189  8145 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:22:57.331444  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.129041 12338 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.477931 12396 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:57.478297 12395 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.480209 12396 consensus_queue.cc:1243] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:57.480669 12395 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.482390 12396 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.485846 12396 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.491777 12395 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.492215 12338 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:57.493096 12396 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:57.695022  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.697710  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:57.698654  8764 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:57.700493  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:57.702258  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:57.702365  8764 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:57.705236  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:57.713586  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:57.712414  8760 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:22:57.714447  8764 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:57.741393 12241 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.755563 12264 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:57.763223 12262 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.763876 12262 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.773088  8761 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:57.780180 12229 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.784358 12229 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.805313  8763 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:22:57.805850  8763 pending_rounds.cc:85] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 9
I20260709 12:22:57.806108  8763 pending_rounds.cc:107] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:22:57.806366  8763 raft_consensus.cc:2889] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:57.810755 11843 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:57.811367 11843 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:57.826500 11843 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:57.830487  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2943) took 1456 ms. Trace:
I20260709 12:22:57.831012  8070 rpcz_store.cc:276] 0709 12:22:56.374088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.375676 (+  1588us) service_pool.cc:224] Handling call
0709 12:22:56.393826 (+ 18150us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:56.394188 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.394231 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:56.405897 (+ 11666us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.890174 (+484277us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:57.109877 (+219703us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:57.109943 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.110054 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.110124 (+    70us) raft_consensus.cc:1685] finished
0709 12:22:57.110144 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.830381 (+720237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7276,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":2852736,"thread_start_us":563836,"threads_started":1,"wal-append.queue_time_us":243850}
I20260709 12:22:57.834555 11902 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.834800 11843 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:57.851980  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 922) took 1479 ms. Trace:
I20260709 12:22:57.853211  8757 rpcz_store.cc:276] 0709 12:22:56.372536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.372688 (+   152us) service_pool.cc:224] Handling call
0709 12:22:57.851668 (+1478980us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54005f1c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:57.851861 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675138432}
I20260709 12:22:57.858629  8213 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:57.863067  8212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.018s	sys 0.023s
W20260709 12:22:57.868867  8212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.018s	sys 0.023s
I20260709 12:22:57.869915  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 780) took 1063 ms. Trace:
I20260709 12:22:57.870384  8212 rpcz_store.cc:276] 0709 12:22:56.806157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.806290 (+   133us) service_pool.cc:224] Handling call
0709 12:22:56.806715 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.807116 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.807143 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.807625 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:22:57.869511 (+1061886us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:57.869559 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.869631 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.869690 (+    59us) raft_consensus.cc:1685] finished
0709 12:22:57.869703 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.869848 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":21118,"spinlock_wait_cycles":75392,"thread_start_us":1061435,"threads_started":1,"wal-append.queue_time_us":149234}
I20260709 12:22:57.872380  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 768) took 1664 ms. Trace:
I20260709 12:22:57.878093  8141 rpcz_store.cc:276] 0709 12:22:56.207824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.207980 (+   156us) service_pool.cc:224] Handling call
0709 12:22:57.006928 (+798948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.033719 (+ 26791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.872151 (+838432us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400042750. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:57.872311 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836423936}
I20260709 12:22:57.887086  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:57.888029  8757 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:57.892532 12391 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.893285 12391 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.898895  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:57.899834 12216 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:57.901177  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:57.905659 12371 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.281s	user 0.010s	sys 0.004s
W20260709 12:22:57.949437  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb5e0 after lost signal to thread 6877
W20260709 12:22:57.959333  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.025s
W20260709 12:22:57.959836  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.026s
W20260709 12:22:57.960443  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.961292  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.963112  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6b60 after lost signal to thread 8001
I20260709 12:22:57.963423  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:57.964051  8215 raft_consensus.cc:2376] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7. Re-sending same reply.
W20260709 12:22:57.964540  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1ec0 after lost signal to thread 8094
I20260709 12:22:57.970479 12391 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:57.971875 12391 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.972513 12391 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:57.975033 12391 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:57.983196  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003937a0 after lost signal to thread 8170
I20260709 12:22:57.991062  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 616) took 1929 ms. Trace:
I20260709 12:22:57.991636  8756 rpcz_store.cc:276] 0709 12:22:56.061615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.070007 (+  8392us) service_pool.cc:224] Handling call
0709 12:22:56.081321 (+ 11314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.219373 (+138052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.219447 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.223440 (+  3993us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.358710 (+135270us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:56.358743 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.358805 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.905102 (+1546297us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:22:57.990629 (+ 85527us) raft_consensus.cc:1685] finished
0709 12:22:57.990657 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.990983 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30255,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2825088,"thread_start_us":192849,"threads_started":2,"wal-append.queue_time_us":181876}
W20260709 12:22:58.009030  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.014s	sys 0.034s
W20260709 12:22:58.009533  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.014s	sys 0.034s
I20260709 12:22:58.010131 11902 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.010742 11902 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.013055 11902 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.017472 12262 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.020661 12391 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.021257 12391 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.023574 12391 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.021258 11902 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:58.024695 11902 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:58.026084  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 1.08379e+06us
I20260709 12:22:58.026895 11902 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:58.027606  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.028056  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.028366  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.027412  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.030588  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:58.032859 12229 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.037339 12255 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:58.037457 12008 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.039050 12255 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:58.039556 12255 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:58.040766 12008 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.041559 12055 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:58.039359 12356 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:58.043417 12356 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:58.043808 12356 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:58.040563 12255 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.044704 12356 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.046181 12356 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.051185  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.052495 12055 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.052768  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.053696 12055 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.055056  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.055853 12055 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.056268  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.056916  8064 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:22:58.058144  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.060672  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.061357  8070 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:58.061476 12229 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11.
I20260709 12:22:58.042799 12008 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:58.056362 12055 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.063097 12008 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:58.063441 12055 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.064247 12008 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.065611 11902 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:58.066196 11902 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.062212  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.069774  8064 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.069900 12391 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.070511 12391 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.074257 12055 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.075073  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.078333  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2936) took 1930 ms. Trace:
I20260709 12:22:58.078764  8063 rpcz_store.cc:276] 0709 12:22:56.147689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.147800 (+   111us) service_pool.cc:224] Handling call
0709 12:22:58.078129 (+1930329us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:58.078271 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213448960}
I20260709 12:22:58.082209  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.082612  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.082931  8214 raft_consensus.cc:2376] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:22:58.083493  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2947) took 1074 ms. Trace:
I20260709 12:22:58.083612  8070 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:58.083853  8214 rpcz_store.cc:276] 0709 12:22:57.009307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.081943 (+1072636us) service_pool.cc:224] Handling call
0709 12:22:58.083422 (+  1479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:58.090085  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.090828  8068 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
W20260709 12:22:58.091717  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.008s	sys 0.000s
W20260709 12:22:58.092319  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.008s	sys 0.000s
I20260709 12:22:58.094417  8068 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:58.097170  8220 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:58.099983  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2963) took 1086 ms. Trace:
I20260709 12:22:58.101490  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.102371  8068 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:58.105676 12389 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:58.105904  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 204829us
I20260709 12:22:58.106076  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.106781  8068 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:58.107232 12389 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:58.107362  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:58.107757 12389 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.110384 12389 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.110956 12389 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.107757  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.112389  8070 raft_consensus.cc:2368] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:58.114831  8069 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:58.120934 12161 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.121589 12161 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.123962 12161 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.126291  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.127020  8144 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:58.127238  8138 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:58.128526  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:58.129865  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.130612  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:22:58.131055 12392 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.647s	user 0.003s	sys 0.000s
I20260709 12:22:58.131637  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:58.132272  8139 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.132941  8140 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:58.133330  8140 pending_rounds.cc:85] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 4
I20260709 12:22:58.133549  8140 pending_rounds.cc:107] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:58.133787  8140 raft_consensus.cc:2889] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:58.136152  8064 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:22:58.136073  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.136915  8216 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:58.137603 12145 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.138173 12145 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.140595  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2960) took 1127 ms. Trace:
I20260709 12:22:58.141021  8219 rpcz_store.cc:276] 0709 12:22:57.013080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.022158 (+  9078us) service_pool.cc:224] Handling call
0709 12:22:57.022612 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.022962 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.022994 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.046473 (+1023479us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:58.046877 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.134512 (+ 87635us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:58.139956 (+  5444us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.140156 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.140237 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.140292 (+    55us) raft_consensus.cc:1685] finished
0709 12:22:58.140376 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.140534 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4945,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":36773,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"spinlock_wait_cycles":11182976,"thread_start_us":92377,"threads_started":2,"wal-append.queue_time_us":85257}
W20260709 12:22:58.144565  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080027df00 after lost signal to thread 8244
W20260709 12:22:58.144950  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080034c020 after lost signal to thread 8245
I20260709 12:22:58.121584 12372 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.149667 12372 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.150581  8061 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:58.151880 12372 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:58.152848  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:58.153550  8217 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:58.154016  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.154799  8214 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:22:58.100337  8220 rpcz_store.cc:276] 0709 12:22:57.014074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.032990 (+ 18916us) service_pool.cc:224] Handling call
0709 12:22:57.033275 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.097614 (+1064339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.099746 (+  2132us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400316fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:22:58.099923 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445305088}
I20260709 12:22:58.160173  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.160871  8216 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:58.162392  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.163897  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.164963  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.168358  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.169255  8063 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:58.173295  8110 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.566s (SENT)
I20260709 12:22:58.177014  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.177600  8069 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.177736  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.179304  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:58.178746  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:58.180681  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.181367  8214 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:58.181354  8068 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:58.183202  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.184324  8069 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:22:58.178242  8139 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:58.185662  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:58.186535  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 77976.3us
I20260709 12:22:58.189414  8217 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:58.190558  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:58.191136  8217 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:58.180078  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.192420  8212 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:58.192297  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.193149  8220 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:58.193305  8069 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:58.197026  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.197557  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.198837  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.199080  8066 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:58.199363  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.200078  8065 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:58.140516 12145 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:58.201997  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.202541  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.203241  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.167694 12360 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.175388 12055 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.205940  8219 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:22:58.176019 12391 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.206758  8063 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:22:58.207187  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.207564  8062 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:58.193877 11902 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.200220 12344 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.234416  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.235239  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.221995 12055 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.237684 12361 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:58.238137 12361 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:58.238404 12055 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.239065 12361 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.239595 11902 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:58.240226 12361 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.222863  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.257808  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:58.191927 12400 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:22:58.225132  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51866.4us
W20260709 12:22:58.262133  8110 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.607s (SENT)
I20260709 12:22:58.218164  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.263228  8066 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:58.263280  8217 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:22:58.264599  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.266171  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.201310 12002 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:58.269624 12002 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.270056 12002 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.226497 12303 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:58.227201  8063 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:58.272982 12303 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:58.274051  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.228562 12255 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.275019 12255 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.205391 12346 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:58.200157 12297 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:58.231091  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.216964 12360 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.278307  8062 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:58.232101  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.279356  8065 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:22:58.276870 12346 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.233026  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.233791 12344 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.281026 12255 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.281785 12346 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.282318 12344 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.219688  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.283170 12297 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.283259  8069 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:58.234846 12161 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:58.180757 12389 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:58.283728 12297 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.241545 12262 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.222049  8064 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:58.242061 12264 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.220769 12145 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:58.248744 12391 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:58.250875  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:58.313169  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62392.4us
W20260709 12:22:58.318248  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2946) took 1309 ms (client timeout 1566 ms). Trace:
W20260709 12:22:58.318725  8211 rpcz_store.cc:269] 0709 12:22:57.008967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.034301 (+ 25334us) service_pool.cc:224] Handling call
0709 12:22:58.317951 (+1283650us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54002b4654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:58.318156 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196728704}
I20260709 12:22:58.267848 12216 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:58.268385 12378 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.268908 12372 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:58.274001 12303 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.274930 12400 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.230070  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:58.355772  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 125809us
I20260709 12:22:58.357168 12400 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.357286 12055 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:58.358361 12055 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.358724 12055 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.359372 12400 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:58.261147  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:58.361009  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 99967.8us
I20260709 12:22:58.361310 12360 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.361696  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:58.362556 12161 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:58.362671  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:58.277613  8061 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:58.266950  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:58.240398 11902 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:58.284799  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76821.2us
I20260709 12:22:58.366074  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:58.289125  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89695us
W20260709 12:22:58.292228  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.008s	sys 0.008s
W20260709 12:22:58.293401  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003d99e0 after lost signal to thread 8790
W20260709 12:22:58.369604  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080032f9c0 after lost signal to thread 8791
I20260709 12:22:58.301329  8062 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:58.337610 12411 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:58.338431 12389 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:58.311271 12255 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:22:58.311213 12262 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.312073 12145 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.311998 12264 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.354839 12297 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.363180 12161 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:58.374573  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.374828  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.394681  8066 raft_consensus.cc:2368] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13.
I20260709 12:22:58.393304 12145 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.395612  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.396234  8066 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:22:58.371783  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.397399  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.397969  8062 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:58.399115  8062 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:58.400152  8062 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:58.340916 12241 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.404013 12145 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.405864 12264 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.406216 12145 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:58.376792  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.008s	sys 0.009s
I20260709 12:22:58.407114 12161 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.408367  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.375582 12216 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:58.379504  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.388686  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73294us
I20260709 12:22:58.417622  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:58.383064  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.418346  8731 leader_election.cc:400] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10.
I20260709 12:22:58.418803  8731 leader_election.cc:403] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:58.385972 12378 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:58.425266  8066 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:58.386415  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 109925us
W20260709 12:22:58.393497  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.426819  8110 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.055s (SENT)
I20260709 12:22:58.410434  8062 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:22:58.427325  8062 pending_rounds.cc:85] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 7
I20260709 12:22:58.427250  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:58.427630  8062 pending_rounds.cc:107] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:22:58.427901  8062 raft_consensus.cc:2889] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:58.428381  8143 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:58.411885  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.374280 12411 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:58.432489  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.376573 12251 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:58.409404  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.440764  8140 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:58.440917  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:58.429020  8141 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:58.431407  8137 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:58.438287  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.382097 12414 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:58.458694  8110 leader_election.cc:336] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.187s (SENT)
I20260709 12:22:58.416903 12216 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.384017 12391 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:22:58.413758 12412 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:58.461584  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:58.462610  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.432646 12411 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.467583  8142 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:58.392764 12255 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.468268  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58952.9us
W20260709 12:22:58.466620  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.469564  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.472908  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.444851 12264 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10.
I20260709 12:22:58.478987 12378 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:58.480173 12378 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.470256  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 107657us
I20260709 12:22:58.535646  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.465790 12216 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.538729  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.465510 12412 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.592734  8144 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:58.419160 12410 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:22:58.537063 12145 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:58.593894  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.594241  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.592803  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:58.596078  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123247us
I20260709 12:22:58.537036 11843 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:58.596980  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.594667  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:58.592978  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 175460us
W20260709 12:22:58.600099  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.602758  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.607451  8218 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:58.602823  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.607932  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:58.604538  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.536464 12411 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.607879  8062 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:58.608843  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:58.607784  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.607549  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.612241  8065 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.608780  8144 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.537158 12405 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.613544  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.619678  8215 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:58.620486  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.613606  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:58.615346  8146 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 2.054s	user 0.025s	sys 0.000s
I20260709 12:22:58.622856  8146 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:22:58.623330  8146 pending_rounds.cc:85] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:22:58.623629  8146 pending_rounds.cc:107] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:22:58.623946  8146 raft_consensus.cc:2889] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:58.626335  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:58.626410  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.595013 12297 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.622103  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.630832  8212 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:58.631179  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:58.631748  8066 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.594354 12412 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.465226 11902 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.636646  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 774) took 2247 ms. Trace:
I20260709 12:22:58.636896  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:58.637218  8146 rpcz_store.cc:276] 0709 12:22:56.383448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.383597 (+   149us) service_pool.cc:224] Handling call
0709 12:22:56.383865 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.630789 (+2246924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.630991 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:58.637631  8756 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:22:58.635308  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.606856 12258 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.636103  8761 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:58.638504  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.639190  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:58.705425  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:58.745862  8062 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:58.599074 12423 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:58.745733  8762 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 6.
I20260709 12:22:58.463359 12389 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.745339  8065 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:22:58.636902 12305 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:22:58.622715 12145 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:58.630642 12414 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:22:58.754318  8760 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:58.755003  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:58.751066  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:58.750933  8144 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:58.628445 12426 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:22:58.725646 12408 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 12:22:58.763916  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 153408us
I20260709 12:22:58.764197  8066 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:58.754386 11843 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:58.752982 12229 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.761307 12391 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:58.791015  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:58.750252 12421 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:58.763063 12297 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:58.761551 12405 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:58.768764 12417 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.175s	user 0.008s	sys 0.000s
I20260709 12:22:58.762058 12407 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.725682 12055 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.808319  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.778200 12410 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.754386 12258 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.788722 11843 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.805560 12297 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:58.829030  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 208625us
I20260709 12:22:58.813062 12262 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.767093 12424 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:22:58.830698 12297 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:58.814136 12391 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:58.773957 12414 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.761725 12423 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.830149 11843 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:58.779920 12426 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.859151 12427 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:22:58.827152 12361 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:58.833810  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 375152us
I20260709 12:22:58.873200  8757 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:58.873365  8110 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.208s (SENT)
I20260709 12:22:58.868196  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:58.834396  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 208853us
I20260709 12:22:58.833606 12429 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.878163 12418 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:58.878757 12428 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.879141 12372 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:58.879297 12428 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.879809 12372 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.878791 12418 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.816847 12410 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:58.882761  8110 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.238s (SENT)
I20260709 12:22:58.883260  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:58.883374  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.887766  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.893895  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:58.821120 12407 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.853674 12432 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:22:58.898269  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:58.872931 12361 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.831643 12145 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.855257 12431 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.854090 12255 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:58.899923  8110 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.282s (SENT)
I20260709 12:22:58.903069  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:58.909958  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.901641  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:58.912071  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 281101us
W20260709 12:22:58.904003  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 113095us
W20260709 12:22:58.917007  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080014bde0 after lost signal to thread 6877
W20260709 12:22:58.919160  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08001b41e0 after lost signal to thread 8001
I20260709 12:22:58.919615  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:58.920552  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08000993e0 after lost signal to thread 8094
W20260709 12:22:58.921859  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1700 after lost signal to thread 8170
I20260709 12:22:58.899217 12361 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.924433 12436 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:58.925350 12436 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:58.925863 12436 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.930153 12428 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:58.930898 12428 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:58.931565 12428 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.933660 12418 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:58.922833  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:58.935081  8757 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:22:58.937664 12426 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.939671 12414 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:58.935649 12410 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:22:58.900027 12002 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 12:22:58.943941 12441 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.879146 12251 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:22:58.955008  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.959299  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.940002 12423 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:22:58.958765  8145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.037s
W20260709 12:22:58.973273  8145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.025s	sys 0.037s
I20260709 12:22:58.900262 12424 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:58.909245 12055 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.918017 12378 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.974191  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51490.1us
I20260709 12:22:58.957381 12229 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.899698 12431 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.902477 12433 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.909611 12255 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:22:58.984939 12400 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:22:58.986079  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.986454 12400 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.986840  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.986912 12400 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:58.989609  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.972034 12425 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.212s	user 0.000s	sys 0.004s
I20260709 12:22:58.972107  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:59.010437  8142 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:59.000986 12258 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:58.958911 12441 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.016979 12441 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:58.946082 12391 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.981963 12378 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.980618 12372 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:59.004216  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:58.985354  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:58.993677  8241 debug-util.cc:398] Leaking SignalData structure 0x7b0800342340 after lost signal to thread 8244
I20260709 12:22:58.943964 12002 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:58.902475 12429 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:58.979447 12421 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:58.977924 12423 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:59.021847  8142 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:58.976769 12424 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:59.020128 12430 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:22:59.037928  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080029bca0 after lost signal to thread 8245
I20260709 12:22:59.014062  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:22:59.073231  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59338.2us
I20260709 12:22:59.058599 12443 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:59.069150  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 175399us
I20260709 12:22:59.076658  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.020851 12264 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:59.090967 12361 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.095661  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.104609  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.108645  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:59.110813 12008 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.111395 12421 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:59.111832  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.112363  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.112555  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:59.113336  8758 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:59.113595 12441 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:59.114428 12424 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.115525 12424 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:59.080273 12414 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:59.117017 12414 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:22:56.908555  8729 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.814s (SENT)
W20260709 12:22:59.117861  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 2.20921e+06us
I20260709 12:22:59.083438 12372 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:59.120890  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080038c340 after lost signal to thread 8790
W20260709 12:22:59.121223  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5f40 after lost signal to thread 8791
I20260709 12:22:59.122553 11843 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.123660 12229 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:59.124079 12229 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:22:59.124941 12241 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.125418 12241 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.127353 12241 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:59.127753 12436 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.129830 12420 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:59.130259 12420 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:59.130599 12420 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:59.134922  8139 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:59.136304  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.136847 12400 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:59.141099  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.107859  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.142102  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.145397  8184 leader_election.cc:400] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:59.145846  8184 leader_election.cc:403] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:59.075695 12443 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.138625 12431 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:59.093394 12002 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:59.066493 12251 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.187079  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.189714  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:59.191659  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.116398 12407 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:59.111819 12421 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.184821  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:22:59.174853 12344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.012s	sys 0.018s
W20260709 12:22:59.185271  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 285364us
I20260709 12:22:59.196045 12441 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11.
I20260709 12:22:59.102566 12423 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:22:59.227550  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.203095  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:22:59.194643 12443 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.102289 12264 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:22:59.136174 12412 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.186779 12359 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:59.190188 12372 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:59.197728  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 212368us
I20260709 12:22:59.209885  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:59.315596  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105821us
I20260709 12:22:59.214977 12431 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:22:59.219743  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:22:59.215619  8758 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:22:59.225346  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:22:59.234184  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.199947 11843 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:59.117872 12414 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:59.222257 12435 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:22:59.239174  8765 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:59.227682  8110 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.991s (SENT)
I20260709 12:22:59.336934  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:22:59.196928  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.194065  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.039s (SENT) [suppressed 38 similar messages]
I20260709 12:22:59.242550  8144 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:22:59.200430 12422 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:22:59.225828 12410 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:59.293169  7966 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:59.221509 12344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.012s	sys 0.019s
I20260709 12:22:59.251341  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.348503  8756 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:59.293931  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.301661 12361 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:59.303870 12412 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:59.304862 12378 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:59.311332 12429 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:59.311648  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:22:59.214627 12411 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.004s
I20260709 12:22:59.221086 12421 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:59.321331  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:22:59.340570  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:59.342411  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 122725us
I20260709 12:22:59.345016  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.368116  8220 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:22:59.345577  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.349118  8142 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:22:59.370272  8142 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:59.370106  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.371354  8214 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 3
I20260709 12:22:59.371557  8142 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:59.348121  8109 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:59.216233 12229 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:22:59.364176  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.373184  8220 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:59.371690  8214 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:22:59.374305  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.374634  8214 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.375519  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.376524  8218 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:59.377151  8220 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
W20260709 12:22:59.377661  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 150056us
I20260709 12:22:59.378280  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.378919  8138 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:22:59.379033  8220 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:22:59.378422  8110 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.044s (SENT)
I20260709 12:22:59.364483  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.384836  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:59.337827 12360 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.330818 12359 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:22:59.361318 12216 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.003s
I20260709 12:22:59.399847  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.400498  8217 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:22:59.400687  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:59.401933  8215 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:22:59.403455  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2948) took 1227 ms. Trace:
I20260709 12:22:59.403983  8061 rpcz_store.cc:276] 0709 12:22:58.175986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.179009 (+  3023us) service_pool.cc:224] Handling call
0709 12:22:59.403214 (+1224205us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b540011e4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:59.403380 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179249024}
I20260709 12:22:59.349740 12400 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.390707  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.361486 12145 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:59.407853  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:59.420809  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:22:59.400048  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:59.409071  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:59.379760 12410 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:59.442816  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:22:59.387725 12429 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:59.455861  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:59.428387  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234352us
I20260709 12:22:59.435307  8211 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:59.360790 12456 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:59.347493 12356 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:22:59.398962 11902 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:59.433341  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:59.446942  8765 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:22:59.448060 12255 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:59.452910  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.453565  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.390455 12391 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:59.486538 12391 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.486856  8138 raft_consensus.cc:2410] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:59.486938 12391 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:59.487982  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.386749 12439 raft_consensus.cc:2764] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:59.457947  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.458423  8218 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:59.393373 12360 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.476092  8215 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:59.482534  8729 connection.cc:256] RPC call timeout handler was delayed by -2.5835682890001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 12:22:59.495213  8729 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.115s (SENT)
I20260709 12:22:59.495609  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:59.361171 12423 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:22:59.400972 12055 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:59.478257  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44981.3us
I20260709 12:22:59.509662  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:22:59.489722  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 94644.4us
I20260709 12:22:59.498211  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:59.506729  8213 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:22:59.510627  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.511005  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.507917  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.513769  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:59.514869  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.456842 12229 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:59.441219 12411 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:59.514537  8218 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:59.475616 12429 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.455474 11843 raft_consensus.cc:2764] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:59.483748 12241 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:59.515919  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.491214 12451 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.489419 12346 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:59.554988  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.555740  8213 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:22:59.529678  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:22:59.490933 12361 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:59.550558  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.485085 11902 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.382753 12264 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.427546 12216 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.508424 12360 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.493554 12145 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:22:59.560756  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.432991 12400 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.516405 12055 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:22:59.508647 12431 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:59.569758  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 74579us
W20260709 12:22:59.701673  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.702569  8729 connection.cc:256] RPC call timeout handler was delayed by -1.9096250450002117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3174s for a response
W20260709 12:22:59.703022  8729 connection.cc:256] RPC call timeout handler was delayed by -1.5976506940000945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:22:59.703343  8729 connection.cc:256] RPC call timeout handler was delayed by -1.4978286479999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2907s for a response
W20260709 12:22:59.703660  8729 connection.cc:256] RPC call timeout handler was delayed by -1.1299991990003946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 12:22:59.560580  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:59.550637 12429 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:59.549234 12456 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:59.554311 12241 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.555581 12303 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.637468  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:59.559816 12346 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.564664 12432 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:59.695851  8220 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:22:59.723026  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 162636us
W20260709 12:22:59.723457  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.725401  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:59.726123  8138 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.726493  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.686874 12055 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:59.530583 12462 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.561839 12361 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.700486  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.739508  8211 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:22:59.570796 12428 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:22:59.705809 12439 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.624199 12442 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:22:59.571838 12436 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:59.723587 12456 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.726963 12241 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:59.515884 12359 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.732738  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:22:59.778579  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:59.747293  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 1.28745e+06us
I20260709 12:22:59.747340 12439 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:59.757830 12467 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:22:59.758236 12400 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:22:59.758318 12423 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:59.736322 12303 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.704427  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:22:59.791719  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 87383.4us
I20260709 12:22:59.564517 11902 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.724684  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:59.725412 12346 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.725534 12432 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:22:59.786371  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 699) took 1161 ms. Trace:
I20260709 12:22:59.793210  8757 rpcz_store.cc:276] 0709 12:22:58.625314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.625443 (+   129us) service_pool.cc:224] Handling call
0709 12:22:59.786164 (+1160721us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54006054d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:22:59.786316 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250652928}
I20260709 12:22:59.787235  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:22:59.793850  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.794565  8141 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.787873  8760 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:59.775825  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.795452  8731 leader_election.cc:400] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14.
I20260709 12:22:59.777369  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.746031  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.757440  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:22:59.795334  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70770.9us
I20260709 12:22:59.797174  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:22:59.777561  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44936.8us
I20260709 12:22:59.734813  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.771625  8138 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:22:59.802150  8217 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:59.571033 12451 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.810560  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.811790  8213 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:59.814051  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:59.814803  8067 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:59.814818  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:59.815774  8064 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:59.804932  8219 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 9: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:22:59.807196  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.817304  8218 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:22:59.667368 12410 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.816334  8066 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:59.827231  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:59.762049 12456 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:59.818790  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:22:59.833294  8211 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.819283  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:22:59.819667  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.818131  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:59.805770 12460 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:22:59.836467  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:22:59.776276 12361 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:59.890321  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:22:59.890694  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55872.4us
I20260709 12:22:59.789798 11843 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:59.892298  8061 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:59.817054 12462 raft_consensus.cc:2764] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:22:59.784816 12439 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:22:59.899824  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:59.898255  8062 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:59.806016 12432 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.721889 12145 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.806792 12423 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:59.834256 12443 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 12:22:59.929638 12443 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.894660 12436 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:22:59.908835 12433 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:22:59.933303 12476 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:22:59.935760 12451 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:22:59.943130 12479 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:59.953255  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:22:59.955091  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:22:59.896236  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 97860.8us
I20260709 12:22:59.898255  8067 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:59.897536  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:22:59.904227  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:22:59.964169  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:22:59.899053 12216 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:59.900525  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 101829us
I20260709 12:22:59.902844  8141 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:22:59.736150 12431 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:22:59.917009  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.994568  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.917629  8763 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:59.898855 12459 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:22:59.918918  8137 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:22:59.928428  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:00.001154  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 204077us
I20260709 12:22:59.964840  8066 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.834075 12442 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:22:59.972860 12423 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:59.974627 12297 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.116s	user 0.005s	sys 0.005s
W20260709 12:22:59.975083 12424 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.000s
I20260709 12:23:00.009102 12297 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.009690 12483 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:00.010574  8146 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:00.012970 12297 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.013633 12431 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.016191 12407 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:00.016750 12407 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:22:59.895884 12262 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 12:22:59.979550 12421 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.000s
I20260709 12:22:59.979475 12346 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:22:59.980564  8142 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:59.981756 12303 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:22:59.982831 12464 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 12:22:59.983520 12468 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
W20260709 12:22:59.984247 12465 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:22:59.924613 11843 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:59.984969 12450 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:22:59.985658 12361 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:00.077258 12008 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.000s
W20260709 12:22:59.987500  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080032e5c0 after lost signal to thread 12373
I20260709 12:22:59.987612 12456 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:22:59.902217  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:00.001564  8069 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:22:59.964668  8065 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:00.006044  8729 leader_election.cc:400] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13.
W20260709 12:23:00.099000  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 93142.2us
I20260709 12:23:00.099987  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:00.007594 12466 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:22:59.977738 12420 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.000s
I20260709 12:23:00.041005  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2972) took 1660 ms. Trace:
I20260709 12:23:00.111816  8068 rpcz_store.cc:276] 0709 12:22:58.380589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.424517 (+ 43928us) service_pool.cc:224] Handling call
0709 12:22:58.426412 (+  1895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.427209 (+   797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.427240 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:59.091582 (+664342us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b2c000014c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:22:59.092074 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:22:59.229436 (+137362us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:59.229479 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.229606 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:00.040583 (+810977us) raft_consensus.cc:1685] finished
0709 12:23:00.040607 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.040887 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":390,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":14616960,"thread_start_us":132776,"threads_started":1,"wal-append.queue_time_us":396845}
W20260709 12:23:00.041798 12461 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:23:00.062043 12344 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:00.062945 12432 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.066954  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.071411  8066 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:23:00.073537  8211 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:22:59.986449 12391 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.127398  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.104249  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 202096us
I20260709 12:23:00.104951  8063 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:00.088759 11843 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.106690 12462 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:00.078495 12441 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:00.108547 12262 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.108783 12346 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.110594 12361 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.078761 12002 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.137109  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.126276 12264 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.118472 12431 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:00.082093 12421 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.148355  8143 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:00.087040 11902 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.121191 12344 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:00.139670 12448 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.161170 12431 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.168126 12431 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.168454 12448 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.170388 12344 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.161224 12441 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.173336 12456 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.119282 12420 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.175076 12455 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.885s	user 0.004s	sys 0.000s
I20260709 12:23:00.175709 12441 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.175998 12477 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:00.176561 12477 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:00.177695 12477 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.178694 12421 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.179934 12432 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.181871 12241 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.179530  8145 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:00.183859 12429 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.160832 12002 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.185667  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:00.186115 12391 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.187506 11843 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.188167 12420 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:00.189114 12008 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:00.163352 12264 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.189905  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.205412  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:00.179273 12477 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.194766  7966 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:00.195647  8035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.012s	sys 0.056s
I20260709 12:23:00.102303 12407 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.197283  8138 raft_consensus.cc:2368] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
W20260709 12:23:00.208638  8035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.012s	sys 0.056s
I20260709 12:23:00.202654  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:00.193492  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 63760.2us
W20260709 12:23:00.193987  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96744.4us
I20260709 12:23:00.144325 12055 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.210220  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.210569  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:00.211678 12424 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:00.218189 12264 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:00.250514  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.218835  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.219223 12008 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:00.253469  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.257434  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:00.219372 12451 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:00.220042 12462 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:00.206259 12441 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.211442 12378 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.207727 12255 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:00.222826 12002 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:00.224651  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1757) took 1740 ms. Trace:
I20260709 12:23:00.243539 12407 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.230744 12241 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.201792 12414 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:23:00.233633 12391 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:00.243814  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:00.245831  8142 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:23:00.248322  8141 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:00.249455  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.289727  8139 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:00.259023  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:00.259738  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.291587  8066 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:00.263942  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.266068  8036 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:23:00.269001  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 143007us
I20260709 12:23:00.292899  8065 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:00.274973  8144 rpcz_store.cc:276] 0709 12:22:58.484701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.787692 (+302991us) service_pool.cc:224] Handling call
0709 12:22:58.788076 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:59.338800 (+550724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.224334 (+885534us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540008f2d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:00.224547 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044385024}
W20260709 12:23:00.227311  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 446433us
I20260709 12:23:00.242822 12303 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:00.243291 12424 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.259665 12400 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:00.274155 12436 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:23:00.281301 12421 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:00.281524 12432 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:00.282532 12482 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:23:00.251593 12405 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.285141  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:00.285447  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:00.298028  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.341269  8068 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:00.260677 12360 consensus_meta.cc:287] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 12:23:00.271188 12389 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.272084 12411 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:00.271294 12258 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:00.301298  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.307494  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.309870  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.349647  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 930) took 1256 ms. Trace:
I20260709 12:23:00.277719 12484 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:23:00.387516  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 102143us
I20260709 12:23:00.299705 12424 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.348873 12437 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:23:00.315100 12400 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.387437  8763 rpcz_store.cc:276] 0709 12:22:59.093066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.093684 (+   618us) service_pool.cc:224] Handling call
0709 12:22:59.101880 (+  8196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.995472 (+893592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.349403 (+353931us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54004c2f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:00.349585 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875483392}
I20260709 12:23:00.313973 12002 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 12:23:00.337741 12481 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:23:00.391286  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:00.450508  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 59342.2us
I20260709 12:23:00.451975  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:00.453802  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:00.351037  8063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 2968) took 2123 ms (client timeout 2184 ms). Trace:
W20260709 12:23:00.454603  8063 rpcz_store.cc:269] 0709 12:22:58.227864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.273762 (+ 45898us) service_pool.cc:224] Handling call
0709 12:23:00.350846 (+2077084us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54000fcdd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:00.350964 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4209035008}
I20260709 12:23:00.350278  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 626) took 1586 ms. Trace:
W20260709 12:23:00.410439  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166711us
W20260709 12:23:00.421905  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.305018 12378 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:00.336648 12255 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.456401  8760 rpcz_store.cc:276] 0709 12:22:58.763785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.776152 (+ 12367us) service_pool.cc:224] Handling call
0709 12:22:59.787701 (+1011549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.795413 (+  7712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.350024 (+554611us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54006054d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:00.350204 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260484864}
I20260709 12:23:00.463929  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.304698 12488 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:00.466243  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:00.462128  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:00.466157  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 163519us
W20260709 12:23:00.468528  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167165us
I20260709 12:23:00.398510 12456 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:00.304032 12303 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:00.466449 12229 consensus_meta.cc:287] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.902s	user 0.011s	sys 0.002s
I20260709 12:23:00.493582  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:00.494491  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:00.495689  8764 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:00.494535  8757 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:00.353885 12405 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.484766  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 176861us
I20260709 12:23:00.499848  8759 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:00.511284  8765 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:00.355261 12360 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.356897 12431 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.468806 12488 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.467759 12421 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:00.518790  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56802.1us
I20260709 12:23:00.468457 12378 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:00.519572  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:00.484150 12255 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.541046  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:00.541764  8213 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.547008  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 2980) took 1177 ms. Trace:
I20260709 12:23:00.526300  8068 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:00.526937  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:00.469468 12477 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:23:00.528769 12499 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.529352 12264 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:00.530270  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:00.530898 12431 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.533439  8757 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:00.510712 11843 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:00.535235  8760 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:00.556252  8069 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:00.537457  8761 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:00.538208  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:00.558163  8762 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.538730 12389 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:00.563234  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.547551  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:00.547132  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:00.545315 12489 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:23:00.585363  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.544018 12495 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:23:00.586510  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.587235  8063 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:00.587172  7966 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 6 to 10, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.589993 12360 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.522636 12488 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.590160  7966 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 4 to 8, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 8 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:00.544339 12303 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.554126 12429 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.594473 12378 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.597149  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.599787  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.588362  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.600708  8143 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:00.525483 12361 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:00.601701  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.602970  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.551355 12436 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.605315  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1755) took 2132 ms. Trace:
I20260709 12:23:00.605108 12436 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.605816  8146 rpcz_store.cc:276] 0709 12:22:58.473253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.754719 (+281466us) service_pool.cc:224] Handling call
0709 12:23:00.605093 (+1850374us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400313154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:00.605248 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2867898240}
I20260709 12:23:00.606536 12429 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.607199  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.607111 12429 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.608323 12436 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:00.610105 12429 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:00.610675 12487 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:23:00.613794  8064 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:00.614310 12429 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.614926 12429 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.615363  8064 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:00.617466 12429 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.619328 12405 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.550237  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.545459  8215 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:00.600710  8063 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:00.552167  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:00.553876  8758 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:00.622727  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.547755  8214 rpcz_store.cc:276] 0709 12:22:59.369972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.370813 (+   841us) service_pool.cc:224] Handling call
0709 12:22:59.371151 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:59.383733 (+ 12582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:59.383762 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:59.384265 (+   503us) log.cc:844] Serialized 52 byte log entry
0709 12:22:59.798643 (+414378us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:59.798756 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.798904 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:00.546691 (+747787us) raft_consensus.cc:1685] finished
0709 12:23:00.546725 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.546926 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3043,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":14654,"thread_start_us":341605,"threads_started":1,"wal-append.queue_time_us":661321}
I20260709 12:23:00.569648  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:00.623940  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54392.2us
I20260709 12:23:00.604233  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.591980  7966 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 3 to 12, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 12 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:00.626191  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.627071  8137 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:00.627262  7966 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 7 to 10, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.625379  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:00.629518  7966 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 5 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 7 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:00.563319 12008 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:00.563511 12389 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:00.574988  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:00.576494  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:00.559587 12255 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.580072 11843 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:00.580888 12055 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:00.583446  7967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 174) took 33276 ms (client timeout 15000 ms). Trace:
I20260709 12:23:00.564512 12497 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:00.564738 12264 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.564898  8218 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:00.486070 12346 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.574144  8213 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:00.634384  7966 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:00.667824  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.669281  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.670495  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:00.693532  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 386138us
I20260709 12:23:00.693600 12432 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:00.700968  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:00.716836  7966 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 7 to 8, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 8 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:00.704515  8061 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:00.620420 12428 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:23:00.699318  8762 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:00.712479  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.701509 12229 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.719270  7966 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.672711 12411 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:00.744902  8218 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:00.747023  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.747819  8146 raft_consensus.cc:2393] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:00.748704  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.741271  7966 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.725575 12055 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:00.754987  7966 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 5 to 7, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 7 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.702786 12255 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:00.760766  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 90883.1us
W20260709 12:23:00.759895  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 243592us
I20260709 12:23:00.736120 12389 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.777647  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.703372  7967 rpcz_store.cc:269] 0709 12:22:27.313366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.328938 (+ 15572us) service_pool.cc:224] Handling call
0709 12:23:00.583093 (+33254155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:50.913043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:50.994298 (+ 81255us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:50.994329 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:22:50.994342 (+    13us) tablet.cc:662] Decoding operations
0709 12:22:50.995322 (+   980us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:50.995383 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:50.995412 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:50.996110 (+   698us) tablet.cc:701] Row locks acquired
0709 12:22:50.996132 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:22:50.996283 (+   151us) write_op.cc:270] Start()
0709 12:22:50.996390 (+   107us) write_op.cc:276] Timestamp: P: 1783599770996230 usec, L: 0
0709 12:22:50.996410 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:51.124766 (+128356us) log.cc:844] Serialized 3218 byte log entry
0709 12:22:52.397316 (+1272550us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54001a61a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca01dbe 00007f498ca0c930 00007f498ca0c8d8 00007f498ca0c858 00007f498ca0c813 00007f498ca0ba9c 00007f49928f72f6 00007f49928f1aa8 00007f498ca487cb 00007f498ca4b2c0
0709 12:22:53.712834 (+1315518us) op_driver.cc:464] REPLICATION: finished
0709 12:22:54.402241 (+689407us) write_op.cc:301] APPLY: starting
0709 12:22:54.448148 (+ 45907us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:54.461521 (+ 13373us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:54.461571 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:54.496976 (+ 35405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:54.497349 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:22:54.497394 (+    45us) write_op.cc:312] APPLY: finished
0709 12:22:54.497780 (+   386us) log.cc:844] Serialized 65 byte log entry
0709 12:22:54.695236 (+197456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:54.735783 (+ 40547us) write_op.cc:454] Released schema lock
0709 12:22:54.744715 (+  8932us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:54.745223 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:54.745253 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3884226,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":471144,"apply.run_cpu_time_us":32456,"apply.run_wall_time_us":397485,"num_ops":8,"prepare.queue_time_us":597024,"prepare.run_cpu_time_us":26234,"prepare.run_wall_time_us":661647,"raft.queue_time_us":1180668,"raft.run_cpu_time_us":55321,"raft.run_wall_time_us":577694,"replication_time_us":2643362,"spinlock_wait_cycles":25945472,"thread_start_us":2234026,"threads_started":5,"wal-append.queue_time_us":645549,"wal-append.run_cpu_time_us":63124,"wal-append.run_wall_time_us":4890006}]]}
I20260709 12:23:00.734745 12229 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.789932 12502 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:00.790452 12502 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:00.790983 12229 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.792032 12498 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.795634 12443 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.797935 12411 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.801892 12500 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.807157  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:00.807964 12457 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:00.808418 12457 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:00.749085  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:00.808817 12506 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:00.809226  8762 raft_consensus.cc:606] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:00.809504 12457 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.758684 12055 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.810585 12055 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:00.810806 12457 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:00.808494  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:00.801981 12485 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:00.711689 12497 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.831655  8068 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
W20260709 12:23:00.829861  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.832607  7966 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.840518  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:00.837766  7966 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.843703  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:00.844332  8762 raft_consensus.cc:606] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:00.852242  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:00.854346  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:00.827849 12485 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:00.795647 12264 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.842908  7966 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.808336 12488 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.870571  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.863758  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 151379us
I20260709 12:23:00.871385  7966 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 8 to 11, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 11 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:00.873072  7966 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:00.869930  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 244618us
I20260709 12:23:00.877931 12499 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:00.828387 12500 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:00.872970  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:00.862272 12498 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:00.893891  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:00.776013 11843 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.901799 12262 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:00.850039 12424 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.877966 12505 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.957001 12498 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:00.959542 12441 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.949795 12436 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.818008 12502 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:00.960134  7952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 767edb8a304f440591a33aae36a36252 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:00.895098 12442 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:00.869997 12504 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:23:00.900532 12361 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:23:00.981317 12509 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:00.981482 12502 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.981814 12509 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.982234 12509 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:00.979070 12436 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.989952 12346 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.990792  8137 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:00.992359 12442 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:00.994616 12442 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.995350  8062 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:00.996021 12264 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.996506 12264 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:00.977260 12516 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:00.999740 12264 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:00.999969 12516 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:01.000794 11902 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.001027 12516 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.001650 12497 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:00.977667 12505 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.003621 12432 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:01.004102 12432 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.004969 12505 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:01.007265  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:01.007903  8140 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.009375  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:01.009996  8139 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:01.011013  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:00.963106  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 90215.6us
I20260709 12:23:00.888195 12443 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:00.898792 12414 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:23:01.013648 12002 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:01.013891 12443 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.011791  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:01.015993 12443 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:00.977537  7952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 94432.5us
I20260709 12:23:01.017791  8139 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:01.012734  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.023962 12002 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:01.024691 12216 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:01.025313  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 257759us
W20260709 12:23:01.025950  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 128447us
I20260709 12:23:01.026538  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.027081  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.027655  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.028280  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.028837  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.027097  8215 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.963742 12055 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.043606  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.020709 12477 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:01.048717  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:01.049647  8139 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:01.050436  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.051199  8214 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:01.054992 12055 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:01.057747  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.060501  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.060731  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.062929  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:01.048638 12477 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.065971  8139 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:01.066753  8215 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:01.069062  8138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1766) took 1642 ms (client timeout 2183 ms). Trace:
I20260709 12:23:01.087159  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:23:01.091634  8138 rpcz_store.cc:269] 0709 12:22:59.426762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.817864 (+391102us) service_pool.cc:224] Handling call
0709 12:23:01.068872 (+1251008us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400255154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:01.069002 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832434048}
I20260709 12:23:01.061563 12255 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:01.105724  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.105867  8065 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:01.105726  8063 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:01.107422  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:01.107924  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45071.6us
I20260709 12:23:01.108894  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.071949 12145 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:01.122822  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.128400  8065 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.124497  8140 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:01.065639 12002 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:23:01.089504 12258 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.130149  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:01.089757 12229 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.095292 12495 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.125834  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.075951 12216 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.059803 12498 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.104084 12477 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.110380 12055 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:01.123665 12406 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:01.175946  8063 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:01.101070  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.179800  8140 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:01.183461  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:01.128469  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.186582  8065 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:01.127174 12145 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.192013  8217 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:01.199146  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.197321  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.200866  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.163861 12507 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.204411  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:01.171288 12488 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.206938  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:01.170593 12424 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.209412  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:01.209985  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.211611  8064 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:01.178258 12502 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:01.209096  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 169759us
I20260709 12:23:01.181540 12406 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:01.179401 12216 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.178435 12258 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.180088 12229 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.183892 12495 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.196421 12506 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:01.201489 12145 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:01.385982  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 102787us
I20260709 12:23:01.402066  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:01.215843  8138 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.188299 12516 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.581323  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:01.431166  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.225230  8186 leader_election.cc:400] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:23:01.400940  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1848) took 1142 ms. Trace:
I20260709 12:23:01.251922  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:01.423964  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 2979) took 2054 ms (client timeout 2082 ms). Trace:
I20260709 12:23:01.424389  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.252892  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:01.449054  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.283972  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:01.474527  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 346158us
W20260709 12:23:01.390866  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.239039  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:01.403153  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:01.489382  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.387729  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1892) took 1089 ms. Trace:
I20260709 12:23:01.399750  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:01.213007  8140 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:01.248322  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:01.196257 12055 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:01.451985 12541 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:23:01.581952  8138 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.582369  8186 leader_election.cc:403] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:01.582540  8066 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:23:01.582760  8069 rpcz_store.cc:276] 0709 12:23:00.258912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.259041 (+   129us) service_pool.cc:224] Handling call
0709 12:23:00.265222 (+  6181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.556811 (+291589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.400580 (+843769us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000fd7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:01.400865 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668747520}
W20260709 12:23:01.582994  8216 rpcz_store.cc:269] 0709 12:22:59.369694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.369801 (+   107us) service_pool.cc:224] Handling call
0709 12:23:01.423737 (+2053936us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400169ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:01.423896 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3868944128}
W20260709 12:23:01.583624  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 159322us
I20260709 12:23:01.620680  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:01.427517 12499 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:01.485154 12255 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.483381 12530 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:01.477424 12400 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:01.312065 12511 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:23:01.600387  8758 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:01.218158 12410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.007s	sys 0.002s
W20260709 12:23:01.343041 12525 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:23:01.600432  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:01.602487  8141 rpcz_store.cc:276] 0709 12:23:00.298411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.298555 (+   144us) service_pool.cc:224] Handling call
0709 12:23:00.298894 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.524135 (+225241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:00.537960 (+ 13825us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.749613 (+211653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.749671 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:00.749728 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.387482 (+637754us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400312c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:01.387532 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.387669 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20449,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":87,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2388,"spinlock_wait_cycles":517460864,"thread_start_us":211323,"threads_started":1,"wal-append.queue_time_us":277982}
I20260709 12:23:01.602670  8067 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.602838  8064 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.620146  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1762) took 2263 ms. Trace:
I20260709 12:23:01.667721  8145 rpcz_store.cc:276] 0709 12:22:59.356390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.359243 (+  2853us) service_pool.cc:224] Handling call
0709 12:22:59.359619 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.191740 (+832121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.619880 (+1428140us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54000528d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:01.620085 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885166464}
I20260709 12:23:01.486294 12446 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.417088 12477 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.389600 12509 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:01.727897  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.728396 12509 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:01.274410 12378 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:01.729238 12378 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:01.730198 12378 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.730859  8064 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:01.732268  8759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:01.629209  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:01.743690 12391 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:01.631119  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 406074us
I20260709 12:23:01.747292 12407 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:23:01.631176  8212 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:01.758313  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.654920 12255 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.759884  8216 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:01.342892 12436 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.397912 12448 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.391115 12457 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.768920 12457 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.771170 12457 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.770978 12161 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:01.536616 12502 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.771929 12502 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:01.585397  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:01.772756 12554 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
W20260709 12:23:01.773242  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 187895us
I20260709 12:23:01.773443 12420 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:01.774026 12496 raft_consensus.cc:993] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:23:01.574302 12406 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.774641 12496 raft_consensus.cc:1081] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
W20260709 12:23:01.389052 12536 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:23:01.579334 12506 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:01.776450 12506 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.776988  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.365228 12491 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:01.295944 12547 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.651310  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.652865  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.653564  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.360008 12359 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.661425  8138 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:01.605283 12529 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.406002 12488 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.394882 12432 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.649052 12444 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.386284 12462 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.268s
W20260709 12:23:01.653221 12410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.007s	sys 0.012s
I20260709 12:23:01.583906  8756 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:01.650629 12532 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:23:01.683909 12551 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:23:01.795740 12255 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.687933 12216 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:01.647899 12545 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.689077 12446 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.797463  8139 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.798300 12241 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:01.386252 12485 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.799345 12485 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.800734 12428 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:01.702993 12229 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:01.707895 12055 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.711539  8067 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:01.804798 12488 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.806625  8067 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:01.807214 12488 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.808029  8067 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:01.811278  8067 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:23:01.718184 12495 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:01.718447  8065 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:01.830060  8216 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:23:01.720175 12534 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.557s	user 0.003s	sys 0.006s
I20260709 12:23:01.653617 12518 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:23:01.721592  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 675) took 1161 ms. Trace:
I20260709 12:23:01.833784  8068 rpcz_store.cc:276] 0709 12:23:00.560733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.566776 (+  6043us) service_pool.cc:224] Handling call
0709 12:23:01.721356 (+1154580us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400202bd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:01.721509 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537232128}
I20260709 12:23:01.722488  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1845) took 1467 ms. Trace:
I20260709 12:23:01.722769  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1901) took 1095 ms. Trace:
I20260709 12:23:01.662209 12411 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:23:01.787186 12448 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:01.841951 12448 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.842461 12448 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.662750 12530 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.581826 12516 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.238592 12507 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.846761 12513 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:01.780889 12491 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:01.848505 12507 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:01.849145 12507 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:01.849536 12507 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:01.849593 12491 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:01.850893 12553 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 12:23:01.850477 12507 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.851275 12491 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.851712  8763 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:01.725793  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 786) took 1203 ms. Trace:
I20260709 12:23:01.852525  8142 rpcz_store.cc:276] 0709 12:23:00.522809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.829601 (+306792us) service_pool.cc:224] Handling call
0709 12:23:00.829897 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.830230 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.830257 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.837941 (+  7684us) log.cc:844] Serialized 26 byte log entry
0709 12:23:01.039450 (+201509us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:01.039492 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.039562 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.725498 (+685936us) raft_consensus.cc:1685] finished
0709 12:23:01.725521 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.725718 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1843,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2841,"thread_start_us":166949,"threads_started":1,"wal-append.queue_time_us":218583}
I20260709 12:23:01.629016  8214 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:01.853951  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 795) took 1317 ms (client timeout 1665 ms). Trace:
W20260709 12:23:01.854344  8143 rpcz_store.cc:269] 0709 12:23:00.536965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.603965 (+ 67000us) service_pool.cc:224] Handling call
0709 12:23:01.853772 (+1249807us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540008f7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:01.853895 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777779968}
I20260709 12:23:01.855221  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.741683  8757 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:01.742125  8064 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:01.744475  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1894) took 1293 ms. Trace:
W20260709 12:23:01.742165  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58859us
I20260709 12:23:01.747764  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:01.662794 12400 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:01.858294  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 110605us
I20260709 12:23:01.736327 12477 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.641846 12499 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:01.751255  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.630154  8063 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.753921  8759 raft_consensus.cc:606] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:01.722795 12258 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.877282  8064 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:01.756379 12519 raft_consensus.cc:993] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:23:01.764958  8061 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:01.770823  8761 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.773963 12420 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:01.642098  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 169566us
W20260709 12:23:01.893865  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.459822 12262 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:01.748420 12251 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:23:01.771976 12161 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:01.784415  8758 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
W20260709 12:23:01.785399  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 501927us
I20260709 12:23:01.788908  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.791632  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.798493 12446 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.690886  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:01.715561 12514 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.752s	user 0.003s	sys 0.000s
I20260709 12:23:01.835337  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:01.835525  8137 rpcz_store.cc:276] 0709 12:23:00.626951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.627851 (+   900us) service_pool.cc:224] Handling call
0709 12:23:01.722543 (+1094692us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002f1554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:01.722688 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647553408}
I20260709 12:23:01.835180  8062 rpcz_store.cc:276] 0709 12:23:00.255386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.255951 (+   565us) service_pool.cc:224] Handling call
0709 12:23:00.256310 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.995731 (+739421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.722267 (+726536us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54001da6d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:01.722430 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699231488}
I20260709 12:23:01.763149 12391 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.798432 12432 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.898805 12496 raft_consensus.cc:1081] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:23:01.956866 12499 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.958531 12499 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:01.856351  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:01.859503  8760 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:23:01.864777  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.857089  8144 rpcz_store.cc:276] 0709 12:23:00.451675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.455653 (+  3978us) service_pool.cc:224] Handling call
0709 12:23:00.456021 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.516047 (+ 60026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.516083 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.516594 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:23:00.706250 (+189656us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:00.706305 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.744030 (+1037725us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b5400253d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:01.744084 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.744135 (+    51us) raft_consensus.cc:1685] finished
0709 12:23:01.744149 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.744388 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5011,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13130,"spinlock_wait_cycles":137001344,"thread_start_us":173258,"threads_started":1,"wal-append.queue_time_us":325638}
I20260709 12:23:01.869393 12457 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:01.868182  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:01.964618  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 96509.9us
I20260709 12:23:01.965376  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:01.872313  8219 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:01.875000  8759 raft_consensus.cc:614] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:01.881073  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 129888us
I20260709 12:23:01.967000  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:01.888892  8063 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:01.832397 12008 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:01.890002  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:01.833202 12428 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:01.976294  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 317540us
I20260709 12:23:01.985844  8214 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:01.986661  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:01.987401  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.892740 12495 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.866700 11843 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.846807 12516 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.009213  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.010118  8063 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:02.010435  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:01.914083  8066 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:23:02.011407  8066 pending_rounds.cc:85] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 9
I20260709 12:23:02.011765  8066 pending_rounds.cc:107] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:23:02.012050  8066 raft_consensus.cc:2889] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.013695  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:01.921845  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:02.015396  8757 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:23:01.916190  8765 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.926782  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:02.018342  8762 raft_consensus.cc:2410] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:23:01.879328 12423 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:01.931069 12389 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.935107 12406 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.941658 12502 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.942270 12444 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9.
I20260709 12:23:01.952445 12145 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:01.958451 12391 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:01.869328 12400 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:01.970851  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:02.050338  8217 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:02.050797  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 80016.4us
I20260709 12:23:01.971354  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:01.983247  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:01.981781  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:01.898056  8138 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:02.053107  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:01.989147  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:01.990062  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:02.054724  8064 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.997227  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:01.901465 12262 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.998914  8137 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:23:02.004148  8756 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:23:02.008351  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 251357us
I20260709 12:23:02.057142  8137 pending_rounds.cc:85] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 10
I20260709 12:23:02.057523  8137 pending_rounds.cc:107] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:02.057880  8137 raft_consensus.cc:2889] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:01.889807 12462 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:23:01.924010  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:02.059576  8218 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:02.020610  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.061486  8063 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:02.062474  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:02.042748  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:02.063174  8063 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.026223  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:02.026242  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.997116 12407 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:02.003398 12556 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:02.077981  8213 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:02.081514  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:02.066339  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.088332  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.091919  8218 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:02.068138  8219 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:02.072865  8765 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:02.019905 12547 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.074695  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:02.075851  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49742.7us
I20260709 12:23:02.076007  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.081964  8063 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:23:02.098757  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.099624  8063 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:02.100221  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:02.101310  8063 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:02.102841  8063 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:02.003504 12428 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.032405 12557 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:02.039397  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 264822us
I20260709 12:23:02.106005  8062 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:02.050899 12297 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.106813  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:02.107491  8765 raft_consensus.cc:606] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:02.107872  8765 raft_consensus.cc:614] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:02.109560  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:02.121814  8064 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:02.066699 11843 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:02.136574  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:02.086227 12055 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:02.077791 12407 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:02.164865  8070 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:02.021979 12420 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.169338  8215 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:02.134766 12477 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:02.205175  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.141081 12488 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:02.144903 12436 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:02.093690 12444 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:23:02.248695  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.166941 12557 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.166069 12432 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:02.166247 12424 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.172073 12407 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.176931 12359 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:02.146596 12297 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.236764 12488 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.162042 11843 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.256704 12477 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:02.234381 12559 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:02.168357 12251 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:02.314993 12344 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:02.344149  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.324791 12488 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.332163 12359 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:02.316120 12424 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.281934 12557 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:02.368615 12558 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
I20260709 12:23:02.368880 12477 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.350553 12251 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:02.342787 12559 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.383697 12502 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.397682 12557 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.408481 12559 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:02.442209  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 270731us
W20260709 12:23:02.443979  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 392244us
I20260709 12:23:02.444415  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:02.444360  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:02.456404  8144 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:02.330843  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.465956  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.469683 11843 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.470688 11843 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.470952 12297 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.472143 12229 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:02.473451 12055 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:02.473524 12428 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.474146 12055 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.474654 12055 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.476172 12229 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.477123 12258 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.495580 12258 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:02.498404 12491 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.008s
I20260709 12:23:02.499450  8763 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 7.
I20260709 12:23:02.499643 12258 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.500346 12258 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:02.500644 12495 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:02.500913 12258 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:02.502593 12258 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.504107 12391 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:02.481878 12400 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.484582 12406 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.485414 12359 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.486809 12433 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:02.489005 12297 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:02.471900 11843 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.493985 12477 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:02.478556 12251 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:02.505121 12506 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.007s
I20260709 12:23:02.495554 12229 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.514788 12530 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:02.532171  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64065.5us
I20260709 12:23:02.545022 12258 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.547838 12506 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.549978  8211 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:02.551537 12506 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.552510 12428 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.553664 12428 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:02.540942  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 422440us
W20260709 12:23:02.563167  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.565197  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.531428 12391 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:02.573801 12436 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:02.569591  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51040.1us
W20260709 12:23:02.588483  8212 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.010s
I20260709 12:23:02.589048  8212 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:02.591817  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:02.595702  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:02.547894 12433 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.598765 12433 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.599265  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:02.601483  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.602993 12559 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:02.598645  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:02.600250 12477 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.606446 12229 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.608178 12424 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.610940 11843 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.611253  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:02.578480 12506 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:02.603737 12559 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:02.613631 12499 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.654s	user 0.013s	sys 0.000s
W20260709 12:23:02.621681  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.625469  8214 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:02.624507  8219 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
W20260709 12:23:02.633306  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.633167 12391 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.621209 11843 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:02.637188  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:02.640506  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.641571  8145 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:02.644212  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:02.644454  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:02.644815  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45733.4us
I20260709 12:23:02.645140  8142 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.645363  8143 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:02.648355  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.648756  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.649030  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.649415 12407 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.649058 12488 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.652108 12407 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.652848 12488 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.655767 12546 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.650185  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.628566 12591 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:02.649273  8137 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:02.657153  8140 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:02.649988  8143 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:02.659953 12055 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.660578 12477 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.622575 12506 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.647351  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:02.656505  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.669482  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.681427  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:02.685755  8142 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:23:02.669621 12389 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.010s
I20260709 12:23:02.684340 12506 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.669505  8146 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:02.664248 12591 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:02.701485  8220 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:02.702260  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.656484 12546 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.703526  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.704298  8143 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:02.702572  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 823) took 1024 ms. Trace:
I20260709 12:23:02.707073 12436 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:02.709753  8143 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:02.712435  8145 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:02.713811  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.711524 12436 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.716315 12436 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:02.721006 12447 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.721372  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 822) took 1049 ms. Trace:
I20260709 12:23:02.721585 12447 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.721796  8219 rpcz_store.cc:276] 0709 12:23:01.672208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.629335 (+957127us) service_pool.cc:224] Handling call
0709 12:23:02.707984 (+ 78649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.720988 (+ 13004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.721018 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.721080 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:02.721127 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.721189 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.721300 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:02.699112 11843 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:02.725841  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.726648 12262 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.014s
I20260709 12:23:02.727181 12262 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:02.727944 12448 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.009s
I20260709 12:23:02.728413 12448 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.731127 12448 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.705758 12424 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.727468 12559 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.709839  8218 rpcz_store.cc:276] 0709 12:23:01.678576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.671450 (+992874us) service_pool.cc:224] Handling call
0709 12:23:02.701588 (+ 30138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.702053 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.702090 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.702175 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:02.702246 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.702333 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.702465 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:02.735021  8142 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:02.735849  8068 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:02.737612 12262 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:02.739889 12568 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 12:23:02.711560 12518 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.741074 12518 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.743865 12546 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:02.739692  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92488us
I20260709 12:23:02.754328 12424 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.757083 12055 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.761238  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.766741  8137 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:02.759893  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.771637  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.772409  8061 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:02.772580  8062 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:02.771996 12591 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.773298 12456 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:02.771660  8143 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.774988  8141 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:02.778285  8141 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:02.770968  8144 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:02.789703 12428 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.777485 12456 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:02.797593  8143 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:02.800997  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.798666 12436 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:02.801712 12566 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 12:23:02.804195 12518 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.782878  8218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51784
I20260709 12:23:02.808948 12389 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:02.809796 12389 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.810191  8141 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:02.811051  8070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 677) took 2249 ms (client timeout 1534 ms). Trace:
I20260709 12:23:02.811743  8141 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:02.812139 12389 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:02.817569 12456 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:02.818506  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3005) took 1163 ms. Trace:
I20260709 12:23:02.819157 12456 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:02.819073  8213 rpcz_store.cc:276] 0709 12:23:01.655124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.791309 (+136185us) service_pool.cc:224] Handling call
0709 12:23:02.817998 (+1026689us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000e6354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:02.818289 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386358656}
I20260709 12:23:02.821127 12424 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.821936  8218 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:02.822166  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 816) took 1540 ms. Trace:
I20260709 12:23:02.822500  8218 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:02.822728  8217 rpcz_store.cc:276] 0709 12:23:01.281515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.281696 (+   181us) service_pool.cc:224] Handling call
0709 12:23:01.282097 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.067173 (+785076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.821589 (+754416us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:02.821929 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766214912}
I20260709 12:23:02.827057  8061 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:02.829178  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.829629  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3000) took 1177 ms. Trace:
I20260709 12:23:02.830211  8215 rpcz_store.cc:276] 0709 12:23:01.652114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.652240 (+   126us) service_pool.cc:224] Handling call
0709 12:23:02.829169 (+1176929us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000cc1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:02.829380 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821669760}
I20260709 12:23:02.833945  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.834441  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:02.834794  8063 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:02.840838  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:02.842110  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:02.844235  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.889385  8144 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:02.811489  8070 rpcz_store.cc:269] 0709 12:23:00.561530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.561657 (+   127us) service_pool.cc:224] Handling call
0709 12:23:02.810633 (+2248976us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540011d0d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:02.810834 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428238720}
I20260709 12:23:02.849531 12414 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.897785 12414 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.900295 12414 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:02.894824 12530 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:02.896817 12519 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.856207 12145 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:02.894075 12491 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:02.847869 12420 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.909484  8061 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
W20260709 12:23:02.878407  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 104503us
I20260709 12:23:02.918627 12519 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.920287  8758 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:23:02.920068 12530 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.921226  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.921478  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:02.921653  8761 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:02.921259 12485 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:02.923593  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:02.925222 12602 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:23:02.926803  8757 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:02.928313 12462 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.928859  8139 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:02.932955 12255 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:02.945969  8141 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:23:02.942960  8218 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:02.951727  8141 pending_rounds.cc:85] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 11
I20260709 12:23:02.959193  8137 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:02.961068  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:02.960639  8141 pending_rounds.cc:107] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:23:02.968176  8141 raft_consensus.cc:2889] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:02.976717  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.048743  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 824) took 1087 ms. Trace:
W20260709 12:23:03.053208  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 129808us
I20260709 12:23:02.965837 12506 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:03.058751  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 803) took 1070 ms. Trace:
W20260709 12:23:03.060549  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 198463us
I20260709 12:23:03.063087  8139 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:03.059165  8141 rpcz_store.cc:276] 0709 12:23:01.983817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.983973 (+   156us) service_pool.cc:224] Handling call
0709 12:23:02.018026 (+ 34053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.774744 (+756718us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b54000ba2a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:03.045530 (+270786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.054391 (+  8861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8829696}
I20260709 12:23:02.965263 12255 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.080123  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.050056  8219 rpcz_store.cc:276] 0709 12:23:01.877215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.723281 (+846066us) service_pool.cc:224] Handling call
0709 12:23:02.723708 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.724076 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:02.724470 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.833724 (+109254us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800086ec0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:02.963950 (+130226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.964002 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:02.964047 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.964115 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.964921 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":525,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":82,"spinlock_wait_cycles":27364608,"thread_start_us":129902,"threads_started":1}
I20260709 12:23:03.042928 12485 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.070341 12414 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:02.967187 12462 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:03.097833  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.099282  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.071440 12506 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.114296  8141 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:03.105386  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:03.106410 12457 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:23:03.089222 12414 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.113185  8139 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:03.129496 12519 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.131152  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:03.133490  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:03.138214 12462 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.138844 12462 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:03.139627 12462 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.117522 12406 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.141389 12406 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.145979  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:03.104750 12479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.008s	sys 0.024s
W20260709 12:23:03.147714 12479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.427s	user 0.008s	sys 0.025s
I20260709 12:23:03.141906 12255 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.119041  8139 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:03.147222  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.150686  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:03.149411  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65706.7us
I20260709 12:23:03.152295  8143 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:23:03.152691  8143 pending_rounds.cc:85] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 8
I20260709 12:23:03.152957  8143 pending_rounds.cc:107] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:23:03.153199  8143 raft_consensus.cc:2889] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.151454  8137 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:03.144428 12406 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.149536 12414 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.161823  8217 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:03.163331  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.164902  8139 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.166050  8139 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:03.166311 12378 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:03.166857 12378 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:03.159353 12389 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:03.168510 12389 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.170650 11843 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.185735  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 827) took 1229 ms. Trace:
I20260709 12:23:03.186291  8217 rpcz_store.cc:276] 0709 12:23:01.956148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.116795 (+1160647us) service_pool.cc:224] Handling call
0709 12:23:03.161690 (+ 44895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.162210 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.185657 (+ 23447us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:03.188907  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.180462 12560 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.867s	user 0.001s	sys 0.000s
I20260709 12:23:03.201020  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.201921  8218 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.202790  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 828) took 1204 ms. Trace:
W20260709 12:23:03.206977 12567 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.856s	user 0.000s	sys 0.001s
I20260709 12:23:03.208091 12507 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.217983 12389 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.208385  8219 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:03.219414  8219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51784
I20260709 12:23:03.219683  8143 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:03.220000  8219 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:03.220422  8219 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.221050  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.222075  8143 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:23:03.223201  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.158286 12530 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:03.201020  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.225849  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.226138 12485 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.226717  8141 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:03.227625  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.229409  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.211555  8139 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:03.210755  8217 rpcz_store.cc:276] 0709 12:23:01.998601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.201702 (+1203101us) service_pool.cc:224] Handling call
0709 12:23:03.202106 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.202422 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.202446 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:03.202511 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:03.202539 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.202591 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.202716 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:03.168038 12378 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.234822  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.197302 12499 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.240461  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51784 (request call id 825) took 1333 ms. Trace:
I20260709 12:23:03.242811  8218 rpcz_store.cc:276] 0709 12:23:01.893784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.750310 (+856526us) service_pool.cc:224] Handling call
0709 12:23:03.200554 (+450244us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca83a3d 00007f4991a53cd0 00007f498afd8254 00007f498afd81e2 00007f498afd8111 00007f498afd808c 00007f498afd7342 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.210558 (+ 10004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28496768}
I20260709 12:23:03.246912  8141 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.248816  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.245398  8219 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.258111  8139 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.270241  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1854) took 1682 ms. Trace:
I20260709 12:23:03.273629  8219 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.273921  8068 rpcz_store.cc:276] 0709 12:23:01.588057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.835013 (+246956us) service_pool.cc:224] Handling call
0709 12:23:01.878692 (+ 43679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.736297 (+857605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.269871 (+533574us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400395dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:03.270152 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961180032}
I20260709 12:23:03.277954  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51784 (request call id 829) took 1258 ms. Trace:
I20260709 12:23:03.278679  8219 rpcz_store.cc:276] 0709 12:23:02.016810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.219233 (+1202423us) service_pool.cc:224] Handling call
0709 12:23:03.274830 (+ 55597us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:03.288810  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.298959  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:03.300776  8217 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:03.261620 12499 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.305117  8219 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:03.265848 12406 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:23:03.311868  8144 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:23:03.316879  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.297675 12262 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:03.319646 12432 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.320216 12432 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.329883  8139 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:03.318583 12519 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:03.328670 12447 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.341609  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.339514  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:03.349197  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64827.1us
I20260709 12:23:03.354130  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:03.355733  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 77337us
I20260709 12:23:03.358112 12528 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:03.360168 12528 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.360503 12528 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.361413 12495 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:03.362000 12495 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.363241 12530 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:03.363664 12530 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.364054 12530 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.368414 12432 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.369320  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 826) took 1474 ms. Trace:
W20260709 12:23:03.372486  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.369731  8213 rpcz_store.cc:276] 0709 12:23:01.894902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.878933 (+984031us) service_pool.cc:224] Handling call
0709 12:23:02.950540 (+ 71607us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:03.077459 (+126919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.077491 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:03.151005 (+ 73514us) log.cc:844] Serialized 52 byte log entry
0709 12:23:03.290422 (+139417us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:03.290481 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.290567 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.369042 (+ 78475us) raft_consensus.cc:1685] finished
0709 12:23:03.369063 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.369220 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5824,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":15848,"thread_start_us":119469,"threads_started":1,"wal-append.queue_time_us":172187}
I20260709 12:23:03.358901  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:03.376284  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 649) took 1449 ms. Trace:
I20260709 12:23:03.383155  8141 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:03.388787  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 2980) took 2259 ms. Trace:
W20260709 12:23:03.399885 12569 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.021s	user 0.000s	sys 0.002s
I20260709 12:23:03.382239  8763 rpcz_store.cc:276] 0709 12:23:01.926487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.974510 (+ 48023us) service_pool.cc:224] Handling call
0709 12:23:03.376034 (+1401524us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400213754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.376181 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122115840}
I20260709 12:23:03.401779  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3007) took 1746 ms. Trace:
W20260709 12:23:03.409291  8146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 1902) took 2732 ms (client timeout 2071 ms). Trace:
W20260709 12:23:03.415760  8146 rpcz_store.cc:269] 0709 12:23:00.676799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.748455 (+ 71656us) service_pool.cc:224] Handling call
0709 12:23:03.408888 (+2660433us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400313654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.409150 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4398675712}
I20260709 12:23:03.420787 12491 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:03.423162 12491 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:03.420600  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.426705  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:03.423592 12491 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:03.433153  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 74319us
I20260709 12:23:03.398190 12495 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:03.438637  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 130476us
W20260709 12:23:03.438810  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50461us
I20260709 12:23:03.390832  8069 rpcz_store.cc:276] 0709 12:23:01.099216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.654287 (+555071us) service_pool.cc:224] Handling call
0709 12:23:01.684724 (+ 30437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:01.685166 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:01.685207 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:01.685855 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 12:23:02.004139 (+318284us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:02.004195 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.004286 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.179583 (+1175297us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:03.346262 (+166679us) raft_consensus.cc:1685] finished
0709 12:23:03.346283 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.358282 (+ 11999us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81283,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4370,"spinlock_wait_cycles":65521536,"thread_start_us":317785,"threads_started":1,"wal-append.queue_time_us":480195}
I20260709 12:23:03.405994  8216 rpcz_store.cc:276] 0709 12:23:01.655692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.928597 (+272905us) service_pool.cc:224] Handling call
0709 12:23:01.929003 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:01.929377 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:01.929420 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:01.929916 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.137286 (+207370us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:02.137348 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.137453 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.398882 (+1261429us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:03.401254 (+  2372us) raft_consensus.cc:1685] finished
0709 12:23:03.401280 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.401570 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19086,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":7302400,"thread_start_us":206923,"threads_started":1,"wal-append.queue_time_us":413356}
I20260709 12:23:03.445959  8213 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:03.460397  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 143070us
I20260709 12:23:03.443506 12499 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.454893 12262 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:03.466826  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44687.6us
W20260709 12:23:03.466140 12420 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 12:23:03.463361 12507 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:03.483265  8212 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:03.485431 12161 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.485968 12161 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.489492  8137 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:03.490592 12610 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:23:03.497210 12613 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:03.497949  8763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:03.498618  8763 raft_consensus.cc:606] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:03.498941  8763 raft_consensus.cc:614] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:03.501576 12496 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:03.504806  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:03.512290  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.515964  8069 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:03.474896 12507 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:03.518088  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.520339  8063 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:03.520452  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.520881  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.521570  8068 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:03.521956  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.522303  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.526394 12530 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:03.528795  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73186.5us
I20260709 12:23:03.533027 12507 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.504165 12414 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.566865  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:03.568619  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.504515 12496 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.577517  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.514873 12610 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:03.580260  8137 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:03.577148  8109 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.585268  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.586270  8144 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:03.590404  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.591066  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.592062  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 821) took 1938 ms. Trace:
W20260709 12:23:03.589854  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1812) took 2523 ms (client timeout 1646 ms). Trace:
I20260709 12:23:03.588331  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:03.592440  8211 rpcz_store.cc:276] 0709 12:23:01.653688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.653978 (+   290us) service_pool.cc:224] Handling call
0709 12:23:01.664121 (+ 10143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.550498 (+886377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.579340 (+1028842us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540016a3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:03.592003 (+ 12663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036272512}
I20260709 12:23:03.582211 12530 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.582682 12610 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:03.594262  8220 rpcz_store.cc:269] 0709 12:23:01.060283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.060460 (+   177us) service_pool.cc:224] Handling call
0709 12:23:03.580191 (+2519731us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54002b5554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.583451 (+  3260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3760618368}
W20260709 12:23:03.598651 12614 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.081s	user 0.004s	sys 0.002s
I20260709 12:23:03.603039  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:03.597671 12457 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:03.599200 12495 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.649757  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.650002 12623 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.612246 12457 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:03.650856 12623 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.651738  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.651494 12457 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.652923  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.653465  8143 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:03.653115 12610 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.654246  8145 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:03.642714 12436 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.645056  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.655652  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.581753 12491 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.648243  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.612792 12456 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:03.659969  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:03.659376  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 71134.8us
I20260709 12:23:03.660542  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.656358  8137 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
W20260709 12:23:03.663549  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54236us
I20260709 12:23:03.660568  8758 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:03.667367  8143 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:03.667820  8143 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:03.668610  8762 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:03.664135  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.650105 12479 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:03.596845 12496 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:03.681062  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.680323 12447 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:23:03.686877 12414 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.687438 12432 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:03.687767  8142 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:03.688156 12432 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.690821  8759 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:03.691066 12432 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.680814 11843 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:23:03.692754 12462 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:03.693181 12462 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.693538 12462 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:03.694962 12495 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.695164 12262 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:03.695534 12495 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.696872 12623 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.679888 12479 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:03.697427  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.698480  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.698347 12479 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.699646  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.699939  8063 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:03.700304  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.701082  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.697250 12491 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.701802  8068 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.701632  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.702296 12255 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:03.702687  8064 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:03.702715 12255 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.703455 12496 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.701131  8061 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:03.704092 12436 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:03.704581 12436 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:03.704972 12436 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.705006  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.706501  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.707098  8070 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:03.708393 11843 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:03.708786 12622 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:03.709326  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.709444 12622 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.710036 12622 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:03.710137 12424 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:03.710665 12424 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.711031 12424 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.713227  8143 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.714015  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.714907  8143 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.716686  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.717137  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:03.719622 12506 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.699899 12479 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.720836  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.727154 12528 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:03.727802  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46926.4us
I20260709 12:23:03.727938 11843 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:03.703471 12255 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:03.728929 11843 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:03.729425 11843 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:03.729698  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 808) took 1063 ms. Trace:
I20260709 12:23:03.730131  8140 rpcz_store.cc:276] 0709 12:23:02.666686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.666818 (+   132us) service_pool.cc:224] Handling call
0709 12:23:02.669450 (+  2632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.727861 (+ 58411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.727894 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:02.727951 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:02.727989 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.729453 (+1001464us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:03.729499 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.729639 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133738240}
I20260709 12:23:03.730521 11843 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.731971  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1817) took 1643 ms. Trace:
I20260709 12:23:03.732350  8214 rpcz_store.cc:276] 0709 12:23:02.088817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.610597 (+521780us) service_pool.cc:224] Handling call
0709 12:23:03.731757 (+1121160us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b540016b2d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.731911 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5570944}
W20260709 12:23:03.733084  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.734491  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:03.704294  8763 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:03.738592  8068 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:03.740965 12145 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.754146  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:03.751650  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.758930  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:03.756203  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.763367 12145 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.765646 12145 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:03.766713 12556 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:03.767143 12556 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.767489 12556 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:03.768594 12625 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:03.768946  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:23:03.769274 12590 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.187s	user 0.000s	sys 0.004s
I20260709 12:23:03.770623  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:03.773700 12528 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.772102  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.775584  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.775946  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.776335  8062 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:23:03.776654  8061 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:03.777462  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.777256 12507 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.777815  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.778064  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.778532  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.778678  8137 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.778687  8064 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:23:03.779515 12507 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:03.779943  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:03.780730  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.783087  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.783691  8139 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
W20260709 12:23:03.783855  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.784584  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.768484  8070 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:03.784953  8763 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:03.785175  8139 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.786088  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:03.746021 12432 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.752734 11843 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.791524  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:03.741688 12456 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:23:03.804319  8143 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:03.753219 12506 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:03.816963  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:03.830566  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 85392.2us
I20260709 12:23:03.814900  8763 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.832971  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.833961  8765 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:23:03.836032  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:03.839056  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:03.785761 12491 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:23:03.831506  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:03.842516  8143 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:03.845758  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1820) took 1756 ms (client timeout 1500 ms). Trace:
W20260709 12:23:03.846021  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55207.6us
W20260709 12:23:03.805382 12447 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:23:03.850206  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.855799  8764 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:03.850723 12441 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.851475 12145 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:03.853111 12499 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.853686 12507 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:03.854348 12617 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:03.854583 12495 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:03.846339  8212 rpcz_store.cc:269] 0709 12:23:02.092062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.591150 (+499088us) service_pool.cc:224] Handling call
0709 12:23:03.844475 (+1253325us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400316fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:03.845654 (+  1179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019047296}
I20260709 12:23:03.854835 12389 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.857818  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.904168  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.858070  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.858871 12625 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.793660 12626 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:03.882701  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:03.888163  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 71282.4us
I20260709 12:23:03.857326 12255 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.901737  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.860699 12420 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.904769  8068 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.861829  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:03.905229  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:03.905700  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:03.906656  8139 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
W20260709 12:23:03.889891  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 147413us
W20260709 12:23:03.907739  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 173354us
I20260709 12:23:03.907490  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:03.888953 12627 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:03.893282 12485 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:03.913211  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:03.916316  8069 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.918987  8220 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.920029  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:03.861428 12436 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.934999  8759 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:03.916337 12618 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.916862 12627 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.946800  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:03.919432 12495 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:03.958678  8068 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:03.902565 12441 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.954101  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:03.916021 12420 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.914258 12457 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:03.943663 12485 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:03.921222 12499 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.966195  8758 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:03.939241 12491 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:23:03.955807 12627 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.934957 12507 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.939052 12389 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:03.986857  8137 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:03.938220 12506 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:03.996774  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:03.994578  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1853) took 2375 ms. Trace:
I20260709 12:23:03.994750  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:04.001411  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:04.002895 12629 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:23:03.934794 12617 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.995318  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:03.967566 12262 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:03.966886 12519 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:23:03.925678 12626 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.971019 12462 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:03.999747 12145 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.011422 12528 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:04.026840  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:04.000967  8065 rpcz_store.cc:276] 0709 12:23:01.587466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.830508 (+243042us) service_pool.cc:224] Handling call
0709 12:23:01.830888 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.098097 (+267209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.098132 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.134816 (+ 36684us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.622675 (+487859us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:02.624116 (+  1441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.749619 (+1125503us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:03.956269 (+206650us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:03.956326 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.956380 (+    54us) raft_consensus.cc:1685] finished
0709 12:23:03.956395 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.962405 (+  6010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681503872,"thread_start_us":135514,"threads_started":1,"wal-append.queue_time_us":415169}
I20260709 12:23:03.984894 12479 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:23:04.035192  8220 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:04.013633 12530 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:04.039376  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:04.041245  8762 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:04.041646  8762 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:04.049351  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:04.041468 12495 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:04.086253 12436 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:03.997625 12618 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.052932 12255 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.054548 12646 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.091043  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.076473 12648 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:04.057962 12650 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:04.037685 12145 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.100764 12617 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.137521 12507 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:04.053256 12645 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:23:04.110769 12650 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:04.135783 12637 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:23:04.173345 12528 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:04.173431  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234769us
I20260709 12:23:04.120571 12491 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:04.174185  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 210247us
W20260709 12:23:04.172727  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.119071 12420 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:04.190049  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.182551 12622 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:04.198195 12634 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:23:04.199112  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1790) took 1361 ms. Trace:
W20260709 12:23:04.199867 12635 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:23:04.202077  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 506823us
I20260709 12:23:04.203680  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:04.111475 12485 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.213613  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:04.174659 12530 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:04.216552  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 138434us
I20260709 12:23:04.180152 12650 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:04.187917 12632 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:23:04.215415  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:04.138036 12646 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:04.253482  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.257232  8065 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:04.256147  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 833) took 1473 ms. Trace:
I20260709 12:23:04.199618  8138 rpcz_store.cc:276] 0709 12:23:02.838054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.839101 (+  1047us) service_pool.cc:224] Handling call
0709 12:23:03.409768 (+570667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.423306 (+ 13538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.423360 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:03.423429 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:03.423469 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.423535 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.198903 (+775368us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400313650. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:04.199045 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6478,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4671,"spinlock_wait_cycles":1311335168}
I20260709 12:23:04.246449  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:04.189458 12491 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:04.229410  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.008s (SENT) [suppressed 21 similar messages]
W20260709 12:23:04.320338  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91022us
I20260709 12:23:04.321148 12649 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
W20260709 12:23:04.322280  8110 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.082s (SENT)
W20260709 12:23:04.270212  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.324262 12615 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:04.324774 12615 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:04.324592  8218 rpcz_store.cc:276] 0709 12:23:02.782591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.310084 (+527493us) service_pool.cc:224] Handling call
0709 12:23:03.316050 (+  5966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.404903 (+ 88853us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:03.583264 (+178361us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.816615 (+233351us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.837422 (+ 20807us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.837567 (+   145us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:03.837623 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.211835 (+374212us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b5400373a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:04.211888 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.211950 (+    62us) raft_consensus.cc:1685] finished
0709 12:23:04.255858 (+ 43908us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.256070 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27550,"prepare.queue_time_us":266730,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":170612,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":1728,"spinlock_wait_cycles":5597952,"thread_start_us":398202,"threads_started":3,"wal-append.queue_time_us":293981}
I20260709 12:23:04.325675 12615 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.215415 12659 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.228816  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:04.327229 12615 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:04.327010 12659 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:04.327554  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98970.3us
I20260709 12:23:04.328855  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.329815 12659 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.330705 12659 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.331243 12659 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:04.329958 12432 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:04.212252 12499 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:04.332278 12432 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.333777 12378 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:04.334875 12432 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:04.335546 12432 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:04.335940 12432 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.336498 12432 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:04.339078  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.225723 12622 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:04.341542  8762 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.212018 12495 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.342908  8762 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.226128 12441 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:04.346107  8065 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:23:04.348065 12633 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 12:23:04.318706 12528 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.325558 12491 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.361639 12610 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:04.362237 12610 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:04.364780 12647 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:23:04.365610 12519 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:04.366056 12519 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:04.367107 12519 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.371253 12389 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:04.373003 12618 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:04.375703  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.329811  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:04.384289  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.388253  8069 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:04.332229 12659 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.301870  8763 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:04.412462 12161 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:04.413234  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 166903us
I20260709 12:23:04.399281 12462 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:04.401173  8110 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.511s (SENT)
W20260709 12:23:04.439888  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 134933us
I20260709 12:23:04.445497  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:04.262521 12255 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:04.449647  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.015s
I20260709 12:23:04.226758 12655 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:04.443277 12556 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.005s
W20260709 12:23:04.453965  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.004s	sys 0.015s
W20260709 12:23:04.458725  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 537997us
W20260709 12:23:04.466372  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 136625us
W20260709 12:23:04.474354 11843 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.668s	user 0.005s	sys 0.005s
I20260709 12:23:04.476765 12640 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.477561 12640 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.463492 12556 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.480340  8762 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:04.395668 12432 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.450938 12457 consensus_queue.cc:1243] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:04.454304 12255 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.481365  8141 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:04.492318  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:04.519398  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.016s	sys 0.008s
W20260709 12:23:04.495393  8110 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.630s (SENT)
W20260709 12:23:04.525358  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.016s	sys 0.008s
W20260709 12:23:04.526824  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 580066us
I20260709 12:23:04.457386 12655 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.480558 12640 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.529124  8066 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:04.490059 12432 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:04.529383 12651 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:04.500944 12556 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:04.512311 12436 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:04.511973 12145 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.480780 12639 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:04.495244 12660 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:04.530829 12627 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:23:04.480815 12665 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:04.456353 12626 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:04.481664 12424 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.005s
W20260709 12:23:04.546088  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.022s
W20260709 12:23:04.577886  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.004s	sys 0.022s
I20260709 12:23:04.549536  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:04.533756 12255 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:04.504717 12646 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:04.566977  8069 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:04.563336  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.579283  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.547398  8036 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.579926  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:23:04.580070  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 540760us
I20260709 12:23:04.547663 12655 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:04.593506  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46205.2us
I20260709 12:23:04.597318  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.566910 12436 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:04.602828  8186 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.604142  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.575783 12432 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:04.491515 12530 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:04.625371  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 211398us
I20260709 12:23:04.489004 12610 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.629462  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:04.632208  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52353.1us
I20260709 12:23:04.584609 12626 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:04.642872  8141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 814) took 1155 ms (client timeout 1518 ms). Trace:
W20260709 12:23:04.656795  8141 rpcz_store.cc:269] 0709 12:23:03.483322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.483546 (+   224us) service_pool.cc:224] Handling call
0709 12:23:03.835974 (+352428us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b5c0026058c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49903f6161 00007f4990597a79 00007f4991a519b6 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:04.638117 (+802143us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002bf7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:04.638229 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488461952}
I20260709 12:23:04.606385 12145 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:04.581453 12424 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.577358 12627 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.622421 12420 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:04.621598 12479 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.648468  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44467us
I20260709 12:23:04.638530 12639 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:04.635098 12668 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:04.654903 12649 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:04.672463  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.577219 12660 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.690294 12424 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:04.676615 12420 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.691417 12420 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:04.636940 12432 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.694208 12432 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:04.697736  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.685288 12479 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.702669 12479 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:04.684875  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:04.704285  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:04.705152 12671 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:04.705665 12671 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:04.706588 12671 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.708797 12161 raft_consensus.cc:2764] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:23:04.709233 12648 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:04.709664 12648 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:04.710520 12648 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.711869 12648 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:04.712800  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.654731 12645 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:04.715281 12610 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:04.715934  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.715312 12645 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.717459  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.717978 12645 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.719653  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.720268  8211 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:04.720952  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:04.660161  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62944.2us
I20260709 12:23:04.605995 12665 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.690394 12660 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.721503  8216 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:04.731576  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.722141  8036 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.723111  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:04.677376  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:04.741472  8762 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:04.742786  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.653236 12644 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
W20260709 12:23:04.761127  8035 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.500s (SENT)
I20260709 12:23:04.675421 12495 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:04.737497  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:04.752190  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.757603  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83320us
I20260709 12:23:04.765247  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.765290  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.684253 12626 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:04.768601  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.772719  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.775695 12528 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:04.778702  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.779476  8760 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:04.780346  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.758100 12479 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:04.781060  8756 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:04.781204 12479 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:04.781563 12161 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.766309 12668 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:04.782076 12161 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.782599  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.782735 12668 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:04.783201  8764 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:23:04.783641 12668 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.784904  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:04.768652 12647 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:04.784300 12161 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:04.759666 12625 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.004s
I20260709 12:23:04.749352 12424 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:04.762787 12145 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.793942  8216 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:04.782123  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:04.749048 12639 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:04.798995  8759 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:04.795110  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 122755us
I20260709 12:23:04.809290  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.809404  8061 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:04.813788  8216 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:23:04.828074  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.781600 12479 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:04.791330 12495 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:04.829988  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 92710.8us
I20260709 12:23:04.684561 12676 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:23:04.815160 12625 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:04.843401  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.846396  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:04.732249 12436 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.847193  8216 raft_consensus.cc:2376] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9. Re-sending same reply.
W20260709 12:23:04.847208  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.758124 12650 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.848922  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.852592  8066 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:04.839094 12424 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:04.859988  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98910.2us
I20260709 12:23:04.809298 12655 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.813663 12378 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:23:04.862834  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:04.861497  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.863534  8212 raft_consensus.cc:2376] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13. Re-sending same reply.
I20260709 12:23:04.864178  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.866703  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:04.865814 12659 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:04.874344 12456 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:04.885433 12661 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:04.886118 12661 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.886569 12661 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:04.885567 12456 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:04.889123 12665 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:04.889413 12456 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.855427 12677 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:04.892724  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.862174 12647 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:23:04.852744 12660 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:23:04.897167  8066 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:04.897301  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.899127  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.853276 12646 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:04.902590  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:04.905011  8061 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:04.908918  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:04.911334  8218 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:04.891515 12659 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:04.862387 12672 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:23:04.923986  8066 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:04.924052  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.925364  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:04.891225 12626 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:04.916473 12495 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.877825 12639 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.917294 12420 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:04.862573 12678 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:23:04.918931  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:04.937026  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:04.937688  8109 leader_election.cc:336] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.184s (SENT)
I20260709 12:23:04.920302 12655 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:04.940056  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84689.6us
I20260709 12:23:04.920956  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.921609  8216 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:04.921838  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:04.946300  8064 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:04.946834  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.949615  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:04.950287  8139 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:04.922324  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.922411  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:04.920511  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:04.925271  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:04.925387  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:04.879026 12491 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.929992  8035 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.646s (SENT)
I20260709 12:23:05.052946  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:04.914525 12424 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.054951  8215 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:04.934430 12672 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:04.923899 12659 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:04.937875  8070 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:04.919713  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:05.091238  8067 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.075588  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.098290  8145 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.938230  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:04.937074  8065 raft_consensus.cc:2376] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12. Re-sending same reply.
I20260709 12:23:05.051159 12642 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:05.049005  8757 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:23:05.049361  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.050756  8066 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.046363  8759 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:05.059473  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.108243  8138 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.059000  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.059118  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.106490  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.109326  8144 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:04.938961 12615 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:05.062373  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.062942  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.063171  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.117281  8143 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:05.057119 12660 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.067215  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.067132  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.069423  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.100509  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.047490  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.102432  8070 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:05.109784  8211 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:23:05.074750  8063 raft_consensus.cc:2376] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13. Re-sending same reply.
I20260709 12:23:05.116694  8142 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:05.063040  8141 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:05.125236  8062 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:05.121660  8140 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:05.124119  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 194160us
I20260709 12:23:05.127892  8139 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:05.067147 12672 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:05.075318 12676 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:05.092599 12655 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:05.134685  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.144351  8216 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:05.063529 12644 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:05.105402 12642 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.142089  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.141746 12672 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.155279  8061 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 12:23:05.116466 12615 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:05.157709  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.057734 12491 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.161006  8219 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:05.162194  8063 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:23:05.170854  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.171574  8211 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.172495  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.134626 12432 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.175316  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.178272  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.179373  8216 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:05.180368  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.176452  8066 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:05.186278  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:05.187090  8064 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.191944  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.192349  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.192986  8213 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:05.193604  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.162937 12615 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.195130  8214 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:05.197628  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.198426  8216 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:05.199553  8216 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:05.199904  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.201433  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:05.202247  8064 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.203112  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.204339  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.205145 12432 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.205897  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.205716 12432 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.207026  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.207983 12432 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.208263  8064 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:05.200707  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 263138us
I20260709 12:23:05.208951  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.210101  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.210443 12662 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:05.210671  8062 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:05.210906 12662 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:05.211479  8061 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:05.211624  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.211768 12662 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:05.211107  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.200445  8110 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.980s (SENT)
I20260709 12:23:05.158648 12642 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.210453  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.218986  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.231132  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.232213  8219 raft_consensus.cc:2376] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:23:05.237790  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.135725 12660 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.240485  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:05.241588  8066 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:23:05.218580  8184 connection.cc:256] RPC call timeout handler was delayed by -1.5339506069999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 12:23:05.242252  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.243155  8216 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:05.244558  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:05.245873  8756 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:05.248513  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.249191  8144 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.251968  8143 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:05.251854  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.218223 12672 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:05.251379  8145 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:23:05.251968  8070 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:05.254873  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.248790 12662 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.261716  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:05.264216  8140 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:05.263628  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 209781us
W20260709 12:23:05.266044  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.259173  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.269009  8061 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:05.230468 12650 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:05.304364  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52627.5us
I20260709 12:23:05.307745  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.305472  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:05.310176  8756 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 7.
I20260709 12:23:05.255106 12640 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:05.317932  8064 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 6.
I20260709 12:23:05.239915 12485 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:23:05.163551 12676 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.320683  8759 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:23:05.341074  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.249271 12479 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.346777  8216 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:05.216542 12659 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:05.336297 12686 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 12:23:05.320066 12420 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:05.363902  8764 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:05.370790  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.370905  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.363327 12485 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:05.365502 12255 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.759s	user 0.004s	sys 0.007s
I20260709 12:23:05.415551  8061 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:05.351174 12640 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.420755  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.380086 12678 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.393992 12485 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:05.422812  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.421804  8061 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:05.427282 12648 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.001s
I20260709 12:23:05.395113 12456 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.444330  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.447403  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:05.430795 12645 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.005s
I20260709 12:23:05.453063  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.400158 12255 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.459865  8217 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.472532  8139 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:05.442987 12378 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.477797  8763 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:05.476845  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.499970  8061 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:05.427983 12678 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.520004  8763 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:05.521200  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.524202  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 273909us
I20260709 12:23:05.473271 12650 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.471629 12704 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.525334  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:05.527609  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:05.477787 12660 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.528298  8061 raft_consensus.cc:2376] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
W20260709 12:23:05.552390  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.607295  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.544127  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:05.607892  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:05.609699  8763 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:05.564316  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:05.597860  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:05.462357 12645 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:05.606294  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.622227  8211 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:05.476563 12648 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:23:05.609927  8069 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:05.532856 12704 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.612293  8138 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:05.613220 12678 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.614557  8761 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:05.615432 12661 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.728s	user 0.004s	sys 0.008s
W20260709 12:23:05.616170 12700 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:23:05.541527 12650 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:05.618548 12695 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:23:05.619391 12702 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:23:05.623744  8763 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:05.563809 12479 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.634545  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:05.637270  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.642499  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:05.664947  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 110755us
I20260709 12:23:05.697263  8211 raft_consensus.cc:2410] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:05.527475 12485 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.696834  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:05.628010 12660 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:05.653229 12707 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:23:05.653962 12705 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:23:05.700196  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 57791.7us
I20260709 12:23:05.701534 12456 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.701799  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.701803  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.707696  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.707999  8211 raft_consensus.cc:2368] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9.
I20260709 12:23:05.703078  8756 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.704934 12648 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.706233  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.657524 12650 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.655766 12556 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.728195  8212 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:05.670702  8144 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
W20260709 12:23:05.718353 12706 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:23:05.744570  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.718501 12704 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.720281 12645 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:05.706481 12639 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.746826  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.785861  8216 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:05.745780  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.728948  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.786818  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:05.786616  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80545.9us
I20260709 12:23:05.786649  8218 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:05.733999  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.738499  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3017) took 1024 ms. Trace:
I20260709 12:23:05.789199  8215 rpcz_store.cc:276] 0709 12:23:04.714818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.715658 (+   840us) service_pool.cc:224] Handling call
0709 12:23:05.738258 (+1022600us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540017d4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:05.738426 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772499712}
I20260709 12:23:05.760767  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.790585  8138 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:05.791770  8217 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:05.777701  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.764513  8145 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:05.636880 12661 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:05.741417  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 347601us
I20260709 12:23:05.748800  8036 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.745222 12491 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:05.724300 12615 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
W20260709 12:23:05.733209 12713 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.099s	user 0.004s	sys 0.001s
I20260709 12:23:05.725459 12255 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.768424 12556 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.768702 12718 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:05.768507 12610 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.053s	user 0.009s	sys 0.004s
I20260709 12:23:05.770144  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.771656  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.773257 12677 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:05.734987 12640 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.787302  8213 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:05.813161  8211 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:05.813620  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.668995 12716 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:23:05.794721  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.724151 12660 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:05.795562  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.795837  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.795837  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.788219  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.797062  8220 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:05.801517  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52821.8us
I20260709 12:23:05.802276  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.795961 12456 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:05.818101  8217 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.815110  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.776146 12420 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.813378  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:05.815579  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107933us
I20260709 12:23:05.716984 12485 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:05.823643  8215 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:05.818780  8218 raft_consensus.cc:2410] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:05.807860  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.819464  8144 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.819674  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.802008 12704 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:05.826747  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.826896  8145 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:05.814363  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.820446  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.824950  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:05.830036  8065 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.830456  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.830673  8065 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.830752  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.831260  8145 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.830269  8144 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:05.831408  8138 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:05.832479  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:05.812450 12677 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.816116 12424 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.833920  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.838920  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.839103  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.836949  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.839974  8137 raft_consensus.cc:2410] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:05.837563  8069 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.808156 12655 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:05.880656  8143 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:05.843508  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:05.843731  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.844664 12725 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:05.845063  8144 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:23:05.846885  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.884585  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.806576 12145 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:23:05.825366 12456 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.830008 12420 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.833559 12639 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.821676 12660 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:05.849635  8065 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.850325 12424 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.851887  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.853683  8140 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:05.806839 12615 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.854642 12677 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:05.855741 12662 consensus_meta.cc:287] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 12:23:05.856719  8138 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:05.857206  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:05.859336  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:05.861841 12672 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
W20260709 12:23:05.901352 12642 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.659s	user 0.000s	sys 0.012s
I20260709 12:23:05.861845 12704 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:05.864259  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.865239 12610 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:05.865882 12627 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.866019  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:05.914780  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48917.9us
W20260709 12:23:05.905977  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 117843us
I20260709 12:23:05.869408  8758 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:05.869613  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.916216  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.916726  8218 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:05.870726 12665 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.870954  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.827870 12378 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:05.830636 12255 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:05.813040 12161 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:05.925735 12161 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:05.926249 12161 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:05.927065 12161 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.928185 12649 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:05.922149 12528 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:05.929082 12145 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:05.929410 12528 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:05.929553 12145 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:05.930483 12528 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.930575 12145 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.932066 12145 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.921988 12255 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.937165 12255 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.940887 12677 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.940727 12665 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.941412 12726 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.943127 12665 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.944229  8214 raft_consensus.cc:2410] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:05.946067 12615 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.946683  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.849242 12556 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:05.836218 12693 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.584s	user 0.002s	sys 0.003s
I20260709 12:23:05.947714  8214 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.889851  8217 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:05.840664 12716 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:05.947916 12556 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.948699  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:05.949419  8217 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 8: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:05.950515  8217 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:05.892269  8216 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:05.881035 12655 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:05.907049  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63722.9us
W20260709 12:23:05.952697  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.952798 12650 consensus_queue.cc:1175] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92362bf8983f4a71a3511e987a2c6578" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:05.953737  8216 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:23:05.954128  8216 pending_rounds.cc:85] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:23:05.954382  8216 pending_rounds.cc:107] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:23:05.914634 12645 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:05.954591 12420 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:05.954936 12645 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:05.955353 12645 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.907783  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:05.912271  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:05.913085  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53820us
W20260709 12:23:05.957682  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45499us
I20260709 12:23:05.957840  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.958840  8036 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:05.887471 12647 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:23:05.920213  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:05.959781 12655 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.868767 12644 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:05.960493 12647 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:05.960701  8218 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.961091 12647 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.961229  8218 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:05.913736 12642 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:05.962060  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.889253 12639 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:05.901578 12436 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:23:05.913793 12618 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.962777  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3026) took 1087 ms. Trace:
I20260709 12:23:05.946820 12424 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.963296  8212 rpcz_store.cc:276] 0709 12:23:04.874913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.875611 (+   698us) service_pool.cc:224] Handling call
0709 12:23:05.962600 (+1086989us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b540016a3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:05.962723 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898572160}
I20260709 12:23:05.963649 12642 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:05.886857  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.884964  8213 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.964883  8219 raft_consensus.cc:2368] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12.
I20260709 12:23:05.966202 12436 consensus_queue.cc:1243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:05.966853  8219 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:05.967525 12655 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.968156  8219 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:05.969060  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 82284us
I20260709 12:23:05.969489 12424 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:05.969769  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:05.924185  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60019.9us
I20260709 12:23:05.919086 12668 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:05.970229 12424 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:05.970846 12668 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.960843 12644 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.971091  8070 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:05.971369  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:05.971807 12668 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.961320 12640 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:05.972906 12640 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:05.973031  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.891654 12660 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.973817 12640 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.962831 12618 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:05.977449 12618 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.978039 12456 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.978679 12618 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.978893 12436 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.979447 12655 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:05.979387 12696 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:05.981141 12662 raft_consensus.cc:2764] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:05.982538  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:05.970449  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54313.1us
I20260709 12:23:05.954614  8216 raft_consensus.cc:2889] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.984892  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:05.985451  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.959208  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:05.887707 12690 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.962074 12647 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.962081  8218 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:05.908957 12661 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:05.999758  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:05.964180 12639 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:05.991003 12378 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:05.992488  8756 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:05.964394 12642 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:05.998502  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:06.031512  8067 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:06.000865 12615 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:06.032004  8218 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.037242  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 718) took 1144 ms. Trace:
W20260709 12:23:06.037340  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52531.7us
I20260709 12:23:06.007884  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:06.040711 12441 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:06.041201 12441 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:06.037250 12615 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.042264 12615 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.042160 12441 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.042887 12456 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:06.002058  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.038295  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.036032 12610 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:06.044133 12725 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:06.046204  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:06.037789  8068 rpcz_store.cc:276] 0709 12:23:04.892669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.892810 (+   141us) service_pool.cc:224] Handling call
0709 12:23:04.893173 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.907509 (+ 14336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.907553 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.914344 (+  6791us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.131495 (+217151us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:05.131542 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.131609 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.780350 (+648741us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:06.030986 (+250636us) raft_consensus.cc:1685] finished
0709 12:23:06.031008 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.037174 (+  6166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15272,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23515,"spinlock_wait_cycles":8392960,"thread_start_us":206028,"threads_started":1,"wal-append.queue_time_us":326223}
I20260709 12:23:06.048087 12648 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:06.043488 12456 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:06.049203 12456 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:06.052740  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.055454  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.059206 12639 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.061578 12650 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:06.062216 12650 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:06.057595  8214 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:06.063289 12255 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.063340 12650 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.064962 12648 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:06.064918 12661 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:06.066639  8217 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:06.066498  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:06.067420  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68991.3us
I20260709 12:23:06.055609  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.036491  8213 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:06.061700  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.074076  8218 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:06.074380  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.065995 12661 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:06.090133  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.091202  8219 raft_consensus.cc:2410] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:06.086638  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.087543  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.008141 12420 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.036244 12642 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:06.058509 12644 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:06.114428  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46822us
I20260709 12:23:06.116788 12725 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:06.118884 12646 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:06.120023 12646 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:06.120348 12646 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:06.121265  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.121219 12646 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.121994  8211 raft_consensus.cc:2376] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8. Re-sending same reply.
I20260709 12:23:06.122483 12646 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.122920 12255 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:06.123732  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:06.124307  8214 raft_consensus.cc:2376] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10. Re-sending same reply.
I20260709 12:23:06.112053 12556 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.110131 12627 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.126174 12627 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.128253 12627 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:06.128295  8139 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:06.129014  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:06.129951  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.130439 12664 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.073424 12662 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.043793 12645 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.123767  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.133284  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.085242 12491 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:06.085595 12649 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.148344  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.149156  8140 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:06.150188  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.150835  8140 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:06.151839  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.166569  8216 raft_consensus.cc:2376] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:23:06.169186 12676 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:06.170760  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.171953  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:06.066144 12648 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.106791 12389 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.105789 12661 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:06.116379  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:06.182485  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66191.1us
I20260709 12:23:06.183399  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:06.184321  8756 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.142774  8138 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:06.145416  8220 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:06.137514  8035 leader_election.cc:400] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12.
I20260709 12:23:06.186872  8035 leader_election.cc:403] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:23:06.112135 12145 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.172607  8218 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:06.133556 12642 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.176450  8764 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:06.176995  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:06.177120  8763 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:06.183513  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.195232  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.142232  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:06.085374 12690 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:23:06.180246  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.196326  8139 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:06.174657  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:06.196046  8219 raft_consensus.cc:2376] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:23:06.188189  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:06.201387  8218 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:06.203976  8139 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:06.204387  8212 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:06.204458  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:06.181520 12626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.012s
I20260709 12:23:06.207278  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.211051  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3025) took 1165 ms. Trace:
I20260709 12:23:06.216141 12639 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.216359  8139 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:06.210680 12678 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.211439  8063 rpcz_store.cc:276] 0709 12:23:05.045516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.136691 (+ 91175us) service_pool.cc:224] Handling call
0709 12:23:05.156978 (+ 20287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.164186 (+  7208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.207195 (+1043009us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b540011e4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:06.210988 (+  3793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11348224}
I20260709 12:23:06.217463  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.230785  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:06.223017  8218 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:06.231789  8758 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:06.231067  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.188737 12432 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:06.234942  8138 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:06.237174  8138 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:06.205837 12665 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:06.236109  8220 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:06.211611 12626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.012s
I20260709 12:23:06.243633  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:06.226846  8756 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:06.260200  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:06.228892 12716 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:06.238035  8138 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.200568 12725 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:06.294410 12672 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.295158 12672 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.298005 12672 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:06.300673  8765 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:06.235476 12639 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:06.302819  8219 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:06.305861  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:06.306617  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:06.314431  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 206065us
I20260709 12:23:06.241129 12665 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:06.172657 12664 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.328126  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:06.249310 12726 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:06.324740  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.325548  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:06.324432  8219 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:23:06.320384  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 233711us
I20260709 12:23:06.337105  8760 raft_consensus.cc:2410] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:23:06.309326 12639 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.249075 12704 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:23:06.346869  8759 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:06.327461 12665 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:06.346104  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:06.350785  8219 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:06.350870  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.348285  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:06.358659  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:06.362900  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231254us
I20260709 12:23:06.316030 12432 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:23:06.248426 12661 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:06.412036  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53473.4us
W20260709 12:23:06.409077  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.408584  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.349131 12668 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:06.326821 12677 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:23:06.415211  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.353438 12655 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.352017 12639 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.337285 12676 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:23:06.355336 12726 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:06.407392 12145 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.417474 12668 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:06.422449  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53896.3us
I20260709 12:23:06.413908 12436 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:06.420188 12432 consensus_queue.cc:1243] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:06.432307  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.417851 12389 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.408584 12255 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:06.407935 12660 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.429792 12661 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.429533 12649 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.430778 12145 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.442523  8139 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:06.455673  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:06.451984 12730 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:23:06.453588 12645 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:06.436022 12668 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.494091  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:06.430493 12556 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:06.498234 12729 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:23:06.500803  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66594.9us
W20260709 12:23:06.501602  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46016.6us
W20260709 12:23:06.502825  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 156814us
I20260709 12:23:06.508575  8140 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:06.511221  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.435110 12436 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:06.523085  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.499159 12640 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:06.500147 12145 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.525097  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:06.530053  8064 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.525084  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.528012  8139 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:06.532934  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.536984  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:06.541554 12389 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.542207 12389 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.542822  8064 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:06.522920 12436 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.544595 12389 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:06.546641  8138 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:06.549849 12618 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 12:23:06.552793 12738 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:23:06.554105 12436 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.554958 12665 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.556985 12436 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:06.558964  8139 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:06.558789 12642 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:06.562886 12731 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:23:06.563716 12734 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:23:06.564436 12732 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:23:06.585426  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53151.9us
W20260709 12:23:06.586357  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 75254.1us
I20260709 12:23:06.586544  8064 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:06.589135  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64879.8us
W20260709 12:23:06.565384 12735 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:23:06.507247 12647 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 12:23:06.566623 12733 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:23:06.527690 12640 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:06.569366 12726 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.507865 12420 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:06.570675 12664 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:06.619922  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:06.584029  8146 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:06.602931 12255 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.600077  8064 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:06.604511  8219 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:06.620074  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:06.598349 12672 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:06.588949 12655 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:06.605664 12615 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.001s
I20260709 12:23:06.631081  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:06.599117  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.634414  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.636294  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:06.648249  8069 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:06.608295 12420 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.608058 12678 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12.
I20260709 12:23:06.635632  8138 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:23:06.594354 12650 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:06.576881  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.658633  8146 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:06.659644  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 82848.4us
I20260709 12:23:06.656549  8138 pending_rounds.cc:85] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 9
I20260709 12:23:06.660612  8138 pending_rounds.cc:107] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:23:06.661330  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:06.662675  8146 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:06.664613  8146 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:23:06.697419  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.661306  8138 raft_consensus.cc:2889] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:06.712015  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.712685  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.713117  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.713784  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:06.711225  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50939.2us
I20260709 12:23:06.636472 12672 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:06.719813  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58562.7us
I20260709 12:23:06.649410 12645 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:06.718128  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.653774 12420 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.757921 12642 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:06.724885  8146 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:06.730098  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:06.729914 12389 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:06.730449  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.662230 12655 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.759684  8070 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
W20260709 12:23:06.759847  8110 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.531s (SENT)
I20260709 12:23:06.794615  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:06.791795  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73908.3us
I20260709 12:23:06.716380 12618 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.800563  8138 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:23:06.805166  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45358.5us
I20260709 12:23:06.652839 12615 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.729236 12424 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.753634 12672 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:06.891989 12754 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 12:23:06.892503 12694 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.639s	user 0.004s	sys 0.000s
W20260709 12:23:06.894037 12712 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.190s	user 0.005s	sys 0.000s
I20260709 12:23:06.896893 12660 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:06.799724 12485 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.897823 12485 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:06.898285 12485 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.843498 12661 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:06.732753 12664 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.856360  8061 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:06.860308  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:06.761198 12678 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:06.760237 12665 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:06.926304  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66107us
I20260709 12:23:06.877636 12530 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:06.882221 12615 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:06.657998 12640 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.884316 12145 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.859088 12436 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:06.886415 12424 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:06.907359  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1830) took 1109 ms. Trace:
I20260709 12:23:06.908972  8065 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.792913 12622 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.931881  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 215484us
I20260709 12:23:06.816726 12618 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.944208  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:06.939294  8145 rpcz_store.cc:276] 0709 12:23:05.798341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.839190 (+ 40849us) service_pool.cc:224] Handling call
0709 12:23:05.844737 (+  5547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.237491 (+392754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.237522 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.262903 (+ 25381us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.531256 (+268353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:06.531304 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.531415 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:06.907129 (+375714us) raft_consensus.cc:1685] finished
0709 12:23:06.907150 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.907295 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59995,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":582213,"threads_started":2,"wal-append.queue_time_us":390920}
W20260709 12:23:06.954013  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 150240us
I20260709 12:23:06.959049 12650 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:06.966547  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:06.983228  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.013688  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:06.932333 12696 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:07.028204  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.072050  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.073513  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.082118  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.082773  8218 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:07.083568  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:06.947116 12618 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:07.087617  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 286382us
W20260709 12:23:07.092331  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.014534 12642 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:07.066759 12615 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:07.113212  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.113360  8065 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:23:07.070875 12696 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.115820  8065 pending_rounds.cc:85] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 9
I20260709 12:23:07.117051  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.015113 12622 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.086429 12672 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:06.943377 12530 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:07.121975 12639 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.005s
I20260709 12:23:07.121439 12696 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:07.124243 12615 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:07.134111  8220 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:07.123230  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.146803  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.147837  8218 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:23:07.148730  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 165574us
I20260709 12:23:07.148231  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.120398  8065 pending_rounds.cc:107] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:23:07.149935  8065 raft_consensus.cc:2889] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.145507  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.153385  8069 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:07.154349  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.155404  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:07.158790  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:07.159782  8069 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:07.160881  8218 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:07.161824  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.166711  8218 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:07.170764  8218 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:07.126119 12528 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:23:07.179520  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 720) took 1359 ms. Trace:
I20260709 12:23:07.181016  8065 rpcz_store.cc:276] 0709 12:23:05.819761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.819894 (+   133us) service_pool.cc:224] Handling call
0709 12:23:05.820180 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.970306 (+150126us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54000c0420. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca01a1d 00007f498c9e81a4 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca8eb49 00007f498ca8f416 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419
0709 12:23:06.908278 (+937972us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b58008570d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498c9e80aa 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca8eb49 00007f498ca8f416 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4
0709 12:23:07.178988 (+270710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.179457 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188570624}
I20260709 12:23:07.174731  8064 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:07.186993 12650 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.187707 12650 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.190258 12650 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.201617  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.136186 12639 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.173918 12615 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:07.199316 12436 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:07.253332 12737 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:23:07.254216 12755 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:23:07.256393 12424 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.256902 12145 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.208613 12649 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:23:07.158416 12690 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:23:07.211356 12642 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:07.270326  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61283.6us
W20260709 12:23:07.325672  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 211325us
W20260709 12:23:07.301898 12668 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.000s
I20260709 12:23:07.286027 12678 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:07.407646 12678 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.410182  8220 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.177282 12670 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:07.411832  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3021) took 2492 ms. Trace:
I20260709 12:23:07.412259  8067 rpcz_store.cc:276] 0709 12:23:04.919403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.110225 (+190822us) service_pool.cc:224] Handling call
0709 12:23:06.031249 (+921024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.036973 (+  5724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.411611 (+1374638us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540011d5d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:07.411765 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117411200}
I20260709 12:23:07.267940 12485 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.192221 12650 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 12:23:07.299664  8069 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:07.278201  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1834) took 1448 ms. Trace:
W20260709 12:23:07.291951 12420 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 12:23:07.415618 12420 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.415446  8144 rpcz_store.cc:276] 0709 12:23:05.829575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.893153 (+ 63578us) service_pool.cc:224] Handling call
0709 12:23:05.911006 (+ 17853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.983388 (+ 72382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.983421 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:05.983870 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.248672 (+264802us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:06.248706 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.254781 (+1006075us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b5400313654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:07.269532 (+ 14751us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.269581 (+    49us) raft_consensus.cc:1685] finished
0709 12:23:07.269598 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.278126 (+  8528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165875072,"thread_start_us":264423,"threads_started":1,"wal-append.queue_time_us":359347}
I20260709 12:23:07.417870 12420 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.277623 12615 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:07.419386  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 666) took 1812 ms (client timeout 2127 ms). Trace:
I20260709 12:23:07.419858  8220 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:07.420562  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 955) took 2652 ms. Trace:
W20260709 12:23:07.377238  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43655.5us
I20260709 12:23:07.421017  8765 rpcz_store.cc:276] 0709 12:23:04.768426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.768758 (+   332us) service_pool.cc:224] Handling call
0709 12:23:04.774529 (+  5771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.305494 (+1530965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.420233 (+1114739us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400447d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:07.420468 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481333504}
I20260709 12:23:07.423341 12424 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:07.419858  8760 rpcz_store.cc:269] 0709 12:23:05.607480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.607664 (+   184us) service_pool.cc:224] Handling call
0709 12:23:07.419139 (+1811475us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400477054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:07.419309 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654312832}
I20260709 12:23:07.426189 12668 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.427562  8066 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:07.431867 12618 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.432367  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 852) took 1657 ms. Trace:
I20260709 12:23:07.432751  8212 rpcz_store.cc:276] 0709 12:23:05.774702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.996715 (+222013us) service_pool.cc:224] Handling call
0709 12:23:05.998807 (+  2092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.204900 (+206093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.432136 (+1227236us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540016add4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:07.432300 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472358656}
W20260709 12:23:07.433349 12771 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:07.433725  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:07.434801  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.435535  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 676) took 1260 ms. Trace:
I20260709 12:23:07.436201  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:07.436755 12672 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:07.375219 12745 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.727s	user 0.000s	sys 0.002s
I20260709 12:23:07.215204  8065 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:23:07.333076 12642 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:07.397984 12713 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.585s	user 0.005s	sys 0.009s
W20260709 12:23:07.398972  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.403926 12659 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:07.406108 12639 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.417788  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:07.377375 12145 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:07.426239  8211 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:07.438999  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:07.439741  8760 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:23:07.441156  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:07.301920 12726 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:07.471524  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.382751 12436 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.435892  8764 rpcz_store.cc:276] 0709 12:23:06.175477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.218276 (+ 42799us) service_pool.cc:224] Handling call
0709 12:23:06.244239 (+ 25963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.317262 (+ 73023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.317310 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.323762 (+  6452us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.598554 (+274792us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:06.649739 (+ 51185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.649810 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.435301 (+785491us) raft_consensus.cc:1685] finished
0709 12:23:07.435325 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.435460 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43461,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8717,"thread_start_us":174994,"threads_started":1,"wal-append.queue_time_us":1011756}
I20260709 12:23:07.443535  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:07.428346 12668 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:07.445482  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.475600  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:07.467970  8757 raft_consensus.cc:1217] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Deduplicated request from leader. Original: 11.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:23:07.471097  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.373847 12655 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.481134  8757 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:07.474849  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:07.437150 12610 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.476768  8145 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:07.448041  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.452313 12642 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:07.474839  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:07.485034  8067 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.461903 12672 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.483192  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.487625  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.322947 12776 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.202s
I20260709 12:23:07.488394  8145 raft_consensus.cc:2368] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13.
I20260709 12:23:07.489526 12772 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.492426 12662 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:07.492425 12772 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.493350 12662 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:07.493990  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.494552  8138 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.494405 12662 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.495347 12378 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:07.475009 12424 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:07.499511  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.495944 12378 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.505713  8067 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:23:07.507198  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 478419us
I20260709 12:23:07.510241  8138 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:07.511361  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.514604  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.554893  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1948) took 1427 ms. Trace:
I20260709 12:23:07.557282  8137 rpcz_store.cc:276] 0709 12:23:06.127018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.129451 (+  2433us) service_pool.cc:224] Handling call
0709 12:23:06.129760 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.130094 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.130126 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.130598 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.511953 (+381355us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:06.512145 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.512341 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.261169 (+748828us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:07.554551 (+293382us) raft_consensus.cc:1685] finished
0709 12:23:07.554576 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.554806 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3705,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8224,"spinlock_wait_cycles":12053248,"thread_start_us":370754,"threads_started":1,"wal-append.queue_time_us":391565}
I20260709 12:23:07.558461  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.496765 12781 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.562247  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.476809 12650 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:23:07.486511 12610 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.570092 12378 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.572067 12639 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.513408 12622 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.573338 12783 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.580296  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.587710  8145 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:07.573311 12766 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:07.585538  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.477051 12726 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.581120  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.590700  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.498294 12672 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.593029  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:07.595328  8138 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:07.590520  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 230780us
I20260709 12:23:07.597887  8144 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:07.586647 12664 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.004s
I20260709 12:23:07.589674 12783 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.602044 12644 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.602453 12783 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.602638 12644 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:07.591820 12622 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.603749 12766 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:07.586843 12378 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.590013 12760 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.591863 12650 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.594174 12690 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.599921 12664 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:07.620880  8145 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:07.604097 12622 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.594111 12759 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:07.587096 12639 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.634097  8218 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.583537 12781 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.637372 12615 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:07.638024 12615 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:07.641075  8765 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:07.641273  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:07.641392  8138 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:07.630673 12760 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.619096 12378 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.632748 12530 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.639325 12618 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.661651  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:07.631358 12650 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.634555 12759 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.654035 12748 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:07.664192  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 181371us
I20260709 12:23:07.665307  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:07.663149  8144 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:07.632948 12690 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.673034  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:07.653728 12664 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:23:07.680560  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:07.681357  8764 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.682722  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.639015 12615 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.698048  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.698248  8212 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:07.667320 12678 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:07.699687  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:07.690423  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:07.707396  8069 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:07.710155  8065 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:07.674417 12618 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.714138  8212 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:07.723754  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:07.728087  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 130425us
I20260709 12:23:07.696993 12436 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:07.730957  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.681345 12677 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:07.636085 12766 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.733704  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.728830 12615 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:07.696141 12783 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:23:07.675024 12748 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.737980  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.751778  8212 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:07.762913  8065 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:07.734841  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.695794 12668 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:23:07.763927  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.765396  8764 raft_consensus.cc:2410] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:23:07.777755  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.737102 12696 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.005s
I20260709 12:23:07.764608  8212 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:23:07.816960  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 108223us
W20260709 12:23:07.817898  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 97704.9us
I20260709 12:23:07.749600 12436 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:07.737277 12778 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:07.766137 12662 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.761777 12659 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.762835 12796 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.829325  8142 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:23:07.831177  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.832641 12677 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:07.844846 12677 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.845527 12791 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.845826 12772 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.846073 12791 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.846518 12772 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:07.848798 12763 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:23:07.850539 12790 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.850648 12726 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.851162 12790 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.837400 12622 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.843369  8142 pending_rounds.cc:85] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 9
I20260709 12:23:07.852849 12796 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.853682 12659 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.855114 12802 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:07.855901 12802 consensus_queue.cc:1243] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:07.838672  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:07.858306 12622 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:07.858919 12789 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:23:07.852654 12677 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:07.860157  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1897) took 1246 ms (client timeout 1541 ms). Trace:
W20260709 12:23:07.860661  8061 rpcz_store.cc:269] 0709 12:23:06.613841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.619792 (+  5951us) service_pool.cc:224] Handling call
0709 12:23:07.859895 (+1240103us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54003237d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:07.860054 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216178048}
I20260709 12:23:07.729704 12618 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.863688  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.816694 12672 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.864269  8214 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:07.853377  8142 pending_rounds.cc:107] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:23:07.864861  8142 raft_consensus.cc:2889] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.848398 12760 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.866854  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 833) took 2622 ms. Trace:
I20260709 12:23:07.867015 12802 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:07.867261  8142 rpcz_store.cc:276] 0709 12:23:05.244843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.247739 (+  2896us) service_pool.cc:224] Handling call
0709 12:23:05.248059 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.865545 (+2617486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.866593 (+  1048us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54000523d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:07.866773 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5935505664}
I20260709 12:23:07.858878 12622 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.871920  8212 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:07.729120 12787 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.822788 12378 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.878772  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.888249  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:07.889809  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.888994  8212 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:07.891451  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1868) took 1872 ms. Trace:
I20260709 12:23:07.891860  8219 rpcz_store.cc:276] 0709 12:23:06.018674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.356760 (+338086us) service_pool.cc:224] Handling call
0709 12:23:06.362400 (+  5640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.632721 (+270321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.891192 (+1258471us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54001694d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:07.891382 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556242816}
I20260709 12:23:07.892174  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:07.893877  8212 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:07.896495  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.901208  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:07.905552 12726 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.906213 12726 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.907912 12618 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.879354 12639 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:07.908077 12794 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:07.914243  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.910032 12436 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.915792 12650 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.911298  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.824810 12786 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.247s
I20260709 12:23:07.912742 12778 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:07.842782 12662 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:07.906514 12791 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.825335 12696 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.912767 12610 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.913380 12726 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:07.909629 12760 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:07.917543  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:07.921697  8214 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:07.931277  8145 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:23:07.931928  8035 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.890s (SENT)
I20260709 12:23:07.923013  8141 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 3 to 7, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:23:07.927380  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 165926us
I20260709 12:23:07.933125  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:07.936128  8219 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:23:07.936497  8219 pending_rounds.cc:85] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 5
I20260709 12:23:07.936733  8219 pending_rounds.cc:107] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:23:07.936950  8219 raft_consensus.cc:2889] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.942505  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1896) took 1329 ms. Trace:
I20260709 12:23:07.942885  8066 rpcz_store.cc:276] 0709 12:23:06.613422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.619576 (+  6154us) service_pool.cc:224] Handling call
0709 12:23:07.942342 (+1322766us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54003953d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:07.942457 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854340992}
I20260709 12:23:07.948208 12690 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:07.929142 12778 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:07.948967 12790 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.949653 12778 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:07.953462  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 675) took 1778 ms (client timeout 2098 ms). Trace:
W20260709 12:23:07.953836  8759 rpcz_store.cc:269] 0709 12:23:06.175201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.176735 (+  1534us) service_pool.cc:224] Handling call
0709 12:23:07.953306 (+1776571us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54005000d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:07.953409 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352393472}
I20260709 12:23:07.957252  8217 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:07.960956  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.961787 12790 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:07.962288 12662 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:07.964807  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.969705  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:07.972500  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.972465  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.973219  8066 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:23:07.973251  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.974049  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.975522  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.980059  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:07.983218  8212 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:07.893784 12787 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:07.982709  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:07.943370 12650 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:07.967576 12645 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:08.001220  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 133521us
W20260709 12:23:08.025040  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.025543  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.966012 12790 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:07.966708 12659 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:08.027910  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45313.3us
W20260709 12:23:08.049726  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.985438 12658 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:08.026083 12726 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.050514 12432 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:07.997234 12650 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:08.062042 12642 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.004s
I20260709 12:23:08.053573 12795 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.051512 12805 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:08.056538 12658 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.056769 12645 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:08.050704 12787 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:08.089960 12645 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.093911  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.095165  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.095687  8065 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:08.077600  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.080561  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.082275  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:08.051136 12639 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:08.084913  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.067407 12432 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.086372 12378 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.103253  8213 raft_consensus.cc:2410] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:23:08.066256 12650 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.099305  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:08.127853 12378 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.141278 12696 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.142547  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.143215 12432 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.076615 12642 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.100778 12658 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:08.150483  8212 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:23:08.151654  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1870) took 2132 ms (client timeout 1890 ms). Trace:
I20260709 12:23:08.125727 12639 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:08.153115 12808 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:08.125101 12791 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.102649 12805 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:08.163236  8216 rpcz_store.cc:269] 0709 12:23:06.019335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.090230 (+ 70895us) service_pool.cc:224] Handling call
0709 12:23:08.151480 (+2061250us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:08.151580 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49226496}
I20260709 12:23:08.163820  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:08.096567 12776 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:08.160722  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61476.6us
I20260709 12:23:08.153663 12519 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:08.158093  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 332241us
I20260709 12:23:08.172739  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:08.156944 12618 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.067008 12726 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.164134 12801 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:08.156746 12622 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.160394 12615 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.156276 12766 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:08.180173  8217 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:08.177516  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:08.187882  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1817) took 2421 ms. Trace:
I20260709 12:23:08.161417  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:08.208271  8216 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:08.208706  8216 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:08.210188  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48865.7us
I20260709 12:23:08.205829  8143 rpcz_store.cc:276] 0709 12:23:05.766179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.766384 (+   205us) service_pool.cc:224] Handling call
0709 12:23:05.880475 (+114091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.881137 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.187683 (+2306546us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54001c2fd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:08.187826 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234170112}
W20260709 12:23:08.214636  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 339850us
I20260709 12:23:08.214747  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:08.173899 12805 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.185042 12801 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.161028 12795 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.227037 12824 raft_consensus.cc:2764] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:08.175114 12791 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:08.230222  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52861.1us
I20260709 12:23:08.216070 12432 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:08.219075 12727 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:08.235309  8186 leader_election.cc:400] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13.
I20260709 12:23:08.235714  8186 leader_election.cc:403] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:08.162727 12790 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.237047  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:08.238783  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:08.240237  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:08.234232  8216 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.244412  8216 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:08.246533 12791 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.247160 12791 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:08.247809 12791 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:08.237926 12727 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:08.249023 12727 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:08.249505 12623 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:08.233703 12432 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:08.251302 12432 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:08.216578 12766 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.215276 12615 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.225112 12801 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.220041 12716 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:23:08.213857 12618 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.178730 12776 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.223889 12622 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:23:08.230144 12659 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:23:08.269774  8216 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:23:08.270313  8216 pending_rounds.cc:85] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
W20260709 12:23:08.271236  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.271656  8216 pending_rounds.cc:107] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:23:08.271946  8216 raft_consensus.cc:2889] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.271065  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 832) took 3033 ms. Trace:
I20260709 12:23:08.241698 12824 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13.
I20260709 12:23:08.276288  8211 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:08.276407  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:08.277484 12809 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:23:08.279527 12795 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:08.280942  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:08.281342 12818 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:23:08.271034 12696 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 12:23:08.281796 12719 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 2.624s	user 0.000s	sys 0.007s
I20260709 12:23:08.282461 12696 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:08.282795  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.283461  8138 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:08.281663  8142 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:08.284350  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.284941  8145 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:08.285545  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.284931  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:08.289662  8068 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:08.290652  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:08.292394  8143 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:08.272702 12665 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.298362  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.301864  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.302389  8138 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:08.303550  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.282837 12696 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:08.304152  8142 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:23:08.307063  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.308411 12727 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.309135 12824 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:08.311904  8143 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:08.325978  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:08.322078 12819 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:08.322146 12726 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.297554 12791 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:23:08.321349 12820 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:08.374758  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 151487us
I20260709 12:23:08.376221  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:08.305106 12665 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.350562 12639 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.351687 12763 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:23:08.382735 12436 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:08.384694 12645 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.396072 12696 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.405853 12696 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:08.408761 12645 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:08.412271 12817 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:23:08.409219 12495 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:23:08.395599 12820 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.398371 12436 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.449126 12820 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.410208 12785 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.176s
W20260709 12:23:08.423748 12821 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:23:08.421015 12615 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.424220 12778 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:08.451349 12436 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:08.478811  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 124532us
W20260709 12:23:08.489687  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.481187  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 105051us
I20260709 12:23:08.491839  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:08.514314  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 188405us
I20260709 12:23:08.515429  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:08.523720  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.478504 12776 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.493788 12726 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:08.513494 12727 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.516863 12639 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:08.533038  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:08.479008 12778 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:08.553727 12778 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.554515 12432 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:08.533931 12821 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:23:08.554989 12778 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.560190 12424 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:08.567554 12639 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:08.541915 12820 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.532274 12827 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:08.547596 12726 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:08.583899 12424 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.596072 12432 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:08.597203 12424 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.580197 12436 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.529683 12829 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:23:08.589486 12827 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:08.606730 12726 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.570576 12650 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.644814  8762 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:08.648874 12625 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.587610 12639 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.653601 12625 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:08.654512  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 382065us
I20260709 12:23:08.672854  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:08.673707  8061 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:08.673993  8759 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:08.656052 12432 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:08.677827 12432 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:08.678237  8759 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:08.623399 12801 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:08.681244 12658 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.007s
I20260709 12:23:08.655167 12645 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.687969  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.688568  8764 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:08.688496  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.689292  8764 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:08.699199  8763 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:08.684455 12658 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.705484  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.709251  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.681119 12432 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.719981  8763 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:23:08.726722  8763 pending_rounds.cc:85] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 10
W20260709 12:23:08.725546  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 210175us
I20260709 12:23:08.685783 12827 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.727188  8763 pending_rounds.cc:107] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:08.736582  8763 raft_consensus.cc:2889] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.728039  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:08.773175  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 258146us
I20260709 12:23:08.718734 12645 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:08.779057  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51114.6us
I20260709 12:23:08.782079  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.783138  8763 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:08.769933 12432 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:08.826714  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.827513  8763 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:08.781901 12827 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:08.830687  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50296.8us
I20260709 12:23:08.790405 12645 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:08.841380  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:08.842166  8217 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:08.842301  8760 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:23:08.840900  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.819707 12844 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.829214 12436 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.851985  8760 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:23:08.857021  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.858500 12841 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:23:08.865149 12835 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:23:08.864990  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:08.865787  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:08.866715  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:08.867322  8217 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.850656 12650 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:08.840580 12676 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:23:08.877036  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:08.877882  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:08.878314  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:08.878679  8760 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:08.878816  8763 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.882148 12726 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.884330 12726 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:08.893059  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.900593 12645 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:08.901275  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.901804  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.907720 12840 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 12:23:08.914402 12805 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.690s	user 0.015s	sys 0.003s
I20260709 12:23:08.915060 12805 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:08.916865  8759 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 10: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:08.934499  8217 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:08.935060  8763 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:08.928078 12696 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.006s
I20260709 12:23:08.938299  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:08.939890 12805 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:08.944710  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.946694  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:08.949184  8214 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:08.942309 12658 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:08.948117 12842 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:08.974627 12671 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:23:08.982259  8214 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:23:08.983716  8214 pending_rounds.cc:85] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:23:08.984411  8214 pending_rounds.cc:107] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:23:08.984844  8214 raft_consensus.cc:2889] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:08.987421  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3059) took 2027 ms (client timeout 2194 ms). Trace:
I20260709 12:23:08.987576  8215 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:08.988121  8220 rpcz_store.cc:269] 0709 12:23:06.959485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.148029 (+188544us) service_pool.cc:224] Handling call
0709 12:23:08.987159 (+1839130us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400373554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:08.987339 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598515584}
I20260709 12:23:08.989954  8220 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:08.992822  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 733) took 1561 ms. Trace:
I20260709 12:23:08.993271  8765 rpcz_store.cc:276] 0709 12:23:07.431492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.432071 (+   579us) service_pool.cc:224] Handling call
0709 12:23:07.432546 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.642564 (+210018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.992523 (+1349959us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54004763d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:08.992755 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469161728}
I20260709 12:23:08.272572  8141 rpcz_store.cc:276] 0709 12:23:05.237233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.237358 (+   125us) service_pool.cc:224] Handling call
0709 12:23:05.240586 (+  3228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.240811 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:05.390962 (+150151us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.607861 (+1216899us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:07.895943 (+1288082us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b1800429400. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a
0709 12:23:08.063549 (+167606us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.270323 (+206774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:08.270396 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:08.270445 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.270875 (+   430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.271009 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204108,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1987,"raft.queue_time_us":25258,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2422,"spinlock_wait_cycles":115961856,"thread_start_us":435718,"threads_started":4,"wal-append.queue_time_us":263218,"wal-append.run_cpu_time_us":6229,"wal-append.run_wall_time_us":2250749}
I20260709 12:23:08.968206 12424 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.009809 12759 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.012089  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:09.014685  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:09.023617  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:09.027806 12618 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.029052 12781 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.030325  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.032610  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:09.036221  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.036094  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:09.040107 12424 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.035519 12690 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:23:09.047902  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:09.050722  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.017196 12255 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:23:09.034220 12759 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:09.052953 12781 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.059001  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.059895  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.062517  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.062803  8138 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:09.042027 12650 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:09.067642  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.033401 12763 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:23:09.053596 12436 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:09.068235  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:09.034672 12668 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:23:09.073874  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:09.067601 12626 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:09.071659 12842 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:09.068332  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:09.085366  8216 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:09.067408 12781 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.073606  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.074529  8220 raft_consensus.cc:2376] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10. Re-sending same reply.
I20260709 12:23:09.081288  8138 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:09.060708 12759 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.064254 12696 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:09.096967 12781 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.097517 12748 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.098129  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.123625  8216 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:09.101766  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:09.102242  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.083411 12658 raft_consensus.cc:2764] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:09.111915  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.073779 12528 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:09.107120 12665 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.127388  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.131973  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.129032  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.113322 12766 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.134790  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.135538  8216 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:09.136508  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.137068 12528 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.137238  8216 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:23:09.137542 12528 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:09.140905  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:09.147643  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1888) took 1444 ms. Trace:
I20260709 12:23:09.148154  8215 rpcz_store.cc:276] 0709 12:23:07.703411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.913206 (+209795us) service_pool.cc:224] Handling call
0709 12:23:08.987347 (+1074141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.988286 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.147402 (+159116us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400373550. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:09.147571 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469553024}
I20260709 12:23:09.149834  8215 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:09.151177  8215 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:09.153512  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.154160  8142 raft_consensus.cc:2376] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12. Re-sending same reply.
I20260709 12:23:09.154958  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:09.155622  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 954) took 4404 ms (client timeout 2045 ms). Trace:
I20260709 12:23:09.155912  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:09.156006  8762 rpcz_store.cc:269] 0709 12:23:04.751037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.751200 (+   163us) service_pool.cc:224] Handling call
0709 12:23:09.155430 (+4404230us) spinlock_profiling.cc:243] Waited 3.87 s on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:09.155533 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8910142848}
W20260709 12:23:09.157732  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.156546  8142 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:09.087296 12436 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:09.161191  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.134799  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.169580  8220 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
W20260709 12:23:09.162863  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.169914  8142 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:09.171839  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:09.172326  8142 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:09.164613  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.165925  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:09.168121  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 124959us
I20260709 12:23:09.174525  8137 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.175316  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:09.175733  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.114355 12759 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.167191  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.180589  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:09.181746  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:09.114212 12785 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:09.176083  8215 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:09.182579  8215 pending_rounds.cc:85] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:23:09.182843  8215 pending_rounds.cc:107] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:09.183110  8215 raft_consensus.cc:2889] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.184415  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:09.186161  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:09.188032  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:09.178176 12665 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:09.191769  8142 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:23:09.194252  8142 pending_rounds.cc:85] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 7
I20260709 12:23:09.194659  8142 pending_rounds.cc:107] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:23:09.195267  8142 raft_consensus.cc:2889] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:09.132807 12802 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:23:09.183889 12774 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.184232 12618 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.125941 12696 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.189749 12827 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.200253  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.204200  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:09.210893  8764 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:09.204970  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.192514 12785 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:09.189294 12671 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:09.206172  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.190029 12748 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.209319  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.209409  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.192044 12726 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:09.229945  8137 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:09.207690  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 119901us
I20260709 12:23:09.211095  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.189040 12441 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:09.193895 12665 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:09.216089 12832 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:09.217651 12783 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:09.219837 12791 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.257422  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.224828 12726 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:09.232452  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 122041us
I20260709 12:23:09.233345  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.214267 12806 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:23:09.214438 12646 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:23:09.244732 12827 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.254119 12665 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:09.261934 12726 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:09.252060  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.252497  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.253583  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:09.255038 12783 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:09.221596 12766 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.258076  8757 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:09.225098 12727 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.223846 12844 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:09.254690 12649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.895s	user 0.006s	sys 0.002s
I20260709 12:23:09.237788  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1895) took 2631 ms. Trace:
I20260709 12:23:09.222467 12671 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.224754 12436 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.257499 12791 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:09.285957  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.343003  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 863) took 1193 ms. Trace:
I20260709 12:23:09.357683  8217 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:09.357996  8068 rpcz_store.cc:276] 0709 12:23:06.606684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.606967 (+   283us) service_pool.cc:224] Handling call
0709 12:23:06.629566 (+ 22599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.289444 (+1659878us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54000c4f20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:08.290043 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.237470 (+947427us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b54000c4f20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8fa02 00007f498ca8bdd6 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:09.237723 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50884352}
I20260709 12:23:09.358800  8143 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 7: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:09.356269  8211 rpcz_store.cc:276] 0709 12:23:08.150019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.162245 (+ 12226us) service_pool.cc:224] Handling call
0709 12:23:09.342801 (+1180556us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:09.342924 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236486912}
W20260709 12:23:09.355513  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 122023us
I20260709 12:23:09.361570  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:09.362318  8109 connection.cc:256] RPC call timeout handler was delayed by -1.5612402609999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:23:09.365547  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.366724  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.367797  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.367949  8064 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:09.368913  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.370535  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.371403  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.372272  8063 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:09.353744 12649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.016s	user 0.006s	sys 0.005s
I20260709 12:23:09.273839 12861 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:09.307988 12646 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.356429 12865 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.393965  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.276274 12441 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.276433 12802 raft_consensus.cc:476] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:23:09.361064 12659 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:09.355060 12671 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:09.381541  8065 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.381165  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.388258  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.276847 12827 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.358577 12727 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.424955  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:09.391710 12758 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 2.017s	user 0.003s	sys 0.000s
I20260709 12:23:09.393101  8143 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:09.394742  8069 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:09.373848 12829 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:09.390738  8062 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:09.401912  8730 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.984s (SENT) [suppressed 31 similar messages]
I20260709 12:23:09.360322 12495 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.379621 12861 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.382207 12649 consensus_queue.cc:1243] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:09.282400 12759 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.447319 12650 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.423054 12659 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.448841 12759 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.450033 12668 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:09.450477 12668 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:09.451308 12668 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.357265 12766 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.461519  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.432456 12748 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.400791 12441 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.338022 12785 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.397989 12865 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.396000 12868 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.461673  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.431903 12696 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.463654  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:09.466048  8143 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:09.474516  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1975) took 1959 ms. Trace:
I20260709 12:23:09.493247  8144 rpcz_store.cc:276] 0709 12:23:07.515111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.697911 (+182800us) service_pool.cc:224] Handling call
0709 12:23:07.698225 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:07.698839 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:07.698869 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:07.699329 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.236007 (+1536678us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b180040e640. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:09.358840 (+122833us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:09.358879 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.358949 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.438593 (+ 79644us) raft_consensus.cc:1685] finished
0709 12:23:09.438612 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.474418 (+ 35806us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":258,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":21277,"spinlock_wait_cycles":7593728,"thread_start_us":122663,"threads_started":1,"wal-append.queue_time_us":1678978}
I20260709 12:23:09.496109  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.452386 12668 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.478437  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.481500 12796 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.483049  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.484225 12441 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.396129 12646 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.486946 12671 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.432693 12625 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.497002  8211 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.452898 12861 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:09.525867  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123974us
I20260709 12:23:09.502802  8062 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
W20260709 12:23:09.505220  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.473783 12649 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:09.462574 12389 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:23:09.457718 12495 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.428000 12791 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.535585 12671 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.538810  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.550719 12665 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.565820  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 744) took 1486 ms. Trace:
I20260709 12:23:09.566455  8061 rpcz_store.cc:276] 0709 12:23:08.079455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.080335 (+   880us) service_pool.cc:224] Handling call
0709 12:23:09.565501 (+1485166us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000fe1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:09.565716 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314988928}
I20260709 12:23:09.567862  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.569787 12625 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:09.536770 12649 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.574460 12649 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.576459  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:09.553642 12866 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:09.498891 12528 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:09.581473  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.596094  8212 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:09.581988  8064 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:09.584335  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.601073 12646 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.601692 12665 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.601935 12495 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:09.603689 12859 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.346s	user 0.001s	sys 0.003s
I20260709 12:23:09.604048 12528 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.606928  8759 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:23:09.611806  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:09.614483  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 244045us
I20260709 12:23:09.630039  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.630566  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.631385  8212 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:09.633512  8211 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:09.637233  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:09.638622 12665 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.639500 12665 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.640930  8211 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:09.642022 12665 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.634456  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.644090  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.648224 12665 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:09.649164 12696 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:09.649616 12696 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:09.650029 12696 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.653180  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.656668 12665 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.663776 12665 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:09.665642 12665 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:09.666332 12665 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:09.666160 12828 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:09.667217 12665 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.597221 12556 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.669080 12665 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.669538 12556 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.674698 12727 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:09.672394 12556 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.683075  8064 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:09.667112  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:09.686249 12869 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:09.686882 12869 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.687263 12869 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:09.690351  8061 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:09.696295  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.699169  8730 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:09.636219 12495 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.688987 12625 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:09.689158 12626 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:09.707001  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.692955 12843 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:09.709188  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.705261  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:09.702092 12796 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:09.719439  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:09.721815  8062 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:09.700413 12665 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:09.755389 12665 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:09.755787 12665 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:09.759605 12726 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.760947  8144 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:09.761571 12665 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.762832 12665 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.762848  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 846) took 3257 ms. Trace:
I20260709 12:23:09.767807  8139 rpcz_store.cc:276] 0709 12:23:06.505869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.574023 (+ 68154us) service_pool.cc:224] Handling call
0709 12:23:06.574365 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.721603 (+147238us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:06.721652 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.721712 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:06.721760 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.762618 (+3040858us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400312754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:09.762665 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.762794 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8822,"raft.queue_time_us":5188,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":29741,"spinlock_wait_cycles":326903680}
I20260709 12:23:09.769769  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:09.770455  8139 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:09.779392  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:09.780331  8070 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:09.784426  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:09.793267  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1957) took 3591 ms. Trace:
I20260709 12:23:09.793745  8140 rpcz_store.cc:276] 0709 12:23:06.202055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.202415 (+   360us) service_pool.cc:224] Handling call
0709 12:23:06.202779 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.510998 (+308219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.792933 (+3281935us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54000442d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:09.793190 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702618496}
I20260709 12:23:09.716248 12827 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:09.904654  8140 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:09.730345 12530 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.882593 12485 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:09.723304 12865 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:09.906112  8139 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:09.724913 12626 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:09.912075  8139 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:09.713855 12495 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.768427 12861 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:09.753060 12670 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 12:23:09.721386 12843 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:09.912482  8137 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:09.891567 12781 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.889525 12556 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.888648 12806 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.905666 12775 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:09.907594 12672 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.888131 12432 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:09.891408 12639 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:09.891481 12727 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.023974 12495 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:10.032970 12878 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:23:10.021934 12806 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.042541  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1885) took 2343 ms. Trace:
I20260709 12:23:10.043072  8219 rpcz_store.cc:276] 0709 12:23:07.696162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.892760 (+196598us) service_pool.cc:224] Handling call
0709 12:23:07.893071 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.968851 (+ 75780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.038822 (+2069971us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54001b9254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:10.039093 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98252672}
I20260709 12:23:10.022255 12658 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:10.046094 12658 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:10.021970 12749 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 3.260s	user 0.003s	sys 0.005s
W20260709 12:23:09.992523 12866 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:10.033936 12639 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.021874 12556 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.044035  8065 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:09.907757 12436 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.028290 12766 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.027046 12642 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:10.033788 12873 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:23:10.078280 12861 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.008723 12696 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.078926 12556 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.079758 12626 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.046420 12432 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.085453 12378 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.087108 12806 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.090373 12639 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.075096 12436 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.093473 12704 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:10.093938 12704 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:10.094718 12704 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.094970 12436 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.084501  8216 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:10.096777  8216 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:10.018167 12781 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.045336  8756 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:23:10.078773 12879 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:23:10.080533 12696 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:10.114089 12813 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.286s	user 0.003s	sys 0.003s
I20260709 12:23:10.056528  8062 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:10.119158  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.121196  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:10.122253  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.097596  8216 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.123294  8216 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.128450  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.129412  8211 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:10.129473  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:10.130290 12860 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.947s	user 0.003s	sys 0.000s
I20260709 12:23:10.131286 12718 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:10.131736 12718 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:10.132141 12718 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.132362  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.133242  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 862) took 1084 ms. Trace:
I20260709 12:23:10.133605  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:10.134262  8215 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.134459 12726 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.022684 12775 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.136871 12843 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.138325 12775 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.109206 12704 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.139755  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:10.141067 12696 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.141628 12696 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:10.143869 12668 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.001s
I20260709 12:23:10.143757  8215 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:10.146803  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.147662  8138 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:10.023137 12672 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.150241 12672 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.150738 12672 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.151332 12672 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.148556  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.152169  8138 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:10.153046  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.153242 12658 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.154107  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.154456 12658 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.155100  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.155174  8070 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:10.155736  8138 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:10.160172 12786 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:10.160856 12786 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:10.161554 12718 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.164868  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3053) took 3207 ms. Trace:
I20260709 12:23:10.165330  8218 rpcz_store.cc:276] 0709 12:23:06.957860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.217074 (+259214us) service_pool.cc:224] Handling call
0709 12:23:07.273077 (+ 56003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.635448 (+362371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.164561 (+2529113us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54002b5554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:10.164793 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829803392}
I20260709 12:23:10.166424  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 1967) took 3437 ms. Trace:
I20260709 12:23:10.166783  8146 rpcz_store.cc:276] 0709 12:23:06.729084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.791263 (+ 62179us) service_pool.cc:224] Handling call
0709 12:23:06.791665 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.792670 (+  1005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.792927 (+   257us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.826244 (+ 33317us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.484992 (+2658748us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b180042f280. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:09.885819 (+400827us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:09.885881 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.885989 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.166151 (+280162us) raft_consensus.cc:1685] finished
0709 12:23:10.166172 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.166370 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5442,"raft.queue_time_us":5853,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":56366,"spinlock_wait_cycles":2197760,"thread_start_us":400541,"threads_started":1,"wal-append.queue_time_us":3188470}
I20260709 12:23:10.167981  8216 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:10.168593  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1907) took 1153 ms. Trace:
I20260709 12:23:10.168917  8216 rpcz_store.cc:276] 0709 12:23:09.015218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.138122 (+122904us) service_pool.cc:224] Handling call
0709 12:23:09.138471 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.084407 (+945936us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400126220. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:10.168368 (+ 83961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.168540 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925592832}
W20260709 12:23:10.169524 12881 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:23:10.112859 12781 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.169860  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:09.907912 12530 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.173172  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.197521  8068 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.198501 12678 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:10.174180  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.205339  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.177589  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:10.181077  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.174990  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.191380  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.174530  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.194047  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.194132  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.228227  8146 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:10.194065  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.193686  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.205359  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:10.206421  8143 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:23:10.246618 12704 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:10.246454 12786 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.247517 12704 consensus_queue.cc:1243] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:10.248103 12704 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:10.248212 12786 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.257510  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:10.258131  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66823.5us
I20260709 12:23:10.252315  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.257387  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.265443  8069 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:10.257934  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 63500.6us
I20260709 12:23:10.256877  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:10.172583 12863 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.740s	user 0.000s	sys 0.001s
I20260709 12:23:10.265580  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.229383  8065 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:10.271636  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.254135  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 697) took 1023 ms. Trace:
I20260709 12:23:10.133641  8141 rpcz_store.cc:276] 0709 12:23:09.049247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.049390 (+   143us) service_pool.cc:224] Handling call
0709 12:23:09.062197 (+ 12807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.062560 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.062592 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:09.068039 (+  5447us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.176470 (+108431us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:09.176512 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.176577 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.129666 (+953089us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:10.132964 (+  3298us) raft_consensus.cc:1685] finished
0709 12:23:10.132987 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.133185 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1744,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":3042176,"thread_start_us":104947,"threads_started":1,"wal-append.queue_time_us":111927}
I20260709 12:23:10.122313  8764 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.254864  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.280012  8062 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:10.268010  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.144559 12668 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.191601 12775 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:23:10.274727  8756 rpcz_store.cc:276] 0709 12:23:09.230520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.553496 (+322976us) service_pool.cc:224] Handling call
0709 12:23:09.553944 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.101642 (+547698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.253848 (+152206us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400477054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:10.254068 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129446272}
W20260709 12:23:10.288398  8110 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.768s (SENT)
I20260709 12:23:10.305322  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.306222  8069 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:10.191489 12530 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:10.250924 12869 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:23:10.177277 12718 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.143934 12696 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.224392 12640 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.058009 12727 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.259385 12678 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.331255  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:10.332124  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.248533 12704 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:10.333202  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:10.331161  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.251801 12672 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.249284 12485 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:10.350261  8070 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:10.358400  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.313570 12780 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.365965  8764 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:10.335311  8066 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:10.356592  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.369359  8069 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:10.354564  8068 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.371011  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.380324  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.384963  8142 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:10.389889  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:10.192875 12844 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
I20260709 12:23:10.336843 12665 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:10.313609 12753 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:23:10.397392  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 873) took 1381 ms. Trace:
I20260709 12:23:10.397847  8070 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:10.351969 12678 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:10.436338  8761 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:10.328579 12781 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.399884  8764 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:10.420800  8068 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:10.438338  8214 rpcz_store.cc:276] 0709 12:23:09.015725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.141873 (+126148us) service_pool.cc:224] Handling call
0709 12:23:09.142230 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.142612 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.142644 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:09.143143 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.261235 (+118092us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:09.261291 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.261355 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.171778 (+910423us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:10.379394 (+207616us) raft_consensus.cc:1685] finished
0709 12:23:10.379425 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.397320 (+ 17895us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1345,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":104,"spinlock_wait_cycles":12311808,"thread_start_us":114495,"threads_started":1,"wal-append.queue_time_us":288979}
I20260709 12:23:10.333035 12869 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.390395 12671 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.368877 12780 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:10.392434  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.352263 12777 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:23:10.401804 12775 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.398015 12432 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.391376 12855 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.398413 12389 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:10.493216  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.511137  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 118833us
W20260709 12:23:10.511932  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 1879) took 2839 ms (client timeout 1761 ms). Trace:
I20260709 12:23:10.512295  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:10.512379  8213 rpcz_store.cc:269] 0709 12:23:07.672949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.673132 (+   183us) service_pool.cc:224] Handling call
0709 12:23:10.511698 (+2838566us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:10.511855 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929851136}
I20260709 12:23:10.514638  8756 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:10.442860 12678 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.389671 12485 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:10.528936  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.487322 12780 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.500756 12378 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.468511 12665 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.489091 12145 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.484856 12644 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:10.537446  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.540149  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.547889  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.540998  8215 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:10.548457  8218 raft_consensus.cc:2376] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13. Re-sending same reply.
I20260709 12:23:10.542042  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.525041 12738 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:10.544216  8062 raft_consensus.cc:1217] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Deduplicated request from leader. Original: 8.4->[10.5-10.5]   Dedup: 10.5->[]
I20260709 12:23:10.550724  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.550751  8062 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:23:10.545276  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:10.552188  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:10.552376  8219 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.552809  8218 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.529740 12774 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.537719 12642 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.543350  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.549238  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.556841 12644 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.557878  8213 raft_consensus.cc:2410] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:10.549957  8068 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:10.546770  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.560139 12644 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.552425  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:10.562214 12839 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:10.562697 12839 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:10.562858 12672 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:10.563472 12672 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.543545 12378 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.564697 12485 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.566251 12672 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.566491 12378 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.568606  8758 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:10.570333  8219 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:10.571460  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.571897 12783 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.573267  8220 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:10.520601 12775 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.575924 12783 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.577605 12775 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.578169 12530 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.581207  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.581893  8219 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:10.582078  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.580969  8218 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:10.538543 12671 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:23:10.551465 12145 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.594214 12781 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.593994 12378 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:10.595079 12378 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:10.595420 12145 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.595469 12378 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:10.583732 12727 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.597388 12378 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.598748 12378 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.601506 12869 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.583619 12738 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:10.611601  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 252902us
I20260709 12:23:10.608906  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:10.625985  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:10.626837  8110 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.811s (SENT)
I20260709 12:23:10.628038  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:10.630760  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.631590  8068 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.629684 12145 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:10.641613 12145 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:10.642074 12145 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.644699 12671 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.644986 12832 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:10.645205 12671 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.645447 12832 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:10.645629 12885 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:23:10.645710 12671 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.646961 12782 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:10.647449 12782 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:10.637065 12774 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.649348 12665 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.649405 12774 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.630563 12642 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:23:10.630735 12644 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:10.651678 12644 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.651852 12774 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.652123 12644 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.648453 12782 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.636264  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:10.654482  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.653141  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 867) took 1275 ms. Trace:
I20260709 12:23:10.668290  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.669209  8070 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:10.663750  8068 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:10.667004  8140 rpcz_store.cc:276] 0709 12:23:09.377856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.909973 (+532117us) service_pool.cc:224] Handling call
0709 12:23:09.910307 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.910639 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.910672 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.021415 (+110743us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.356336 (+334921us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:10.626212 (+269876us) log.cc:844] Serialized 14 byte log entry
0709 12:23:10.626504 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.626597 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.652937 (+ 26340us) raft_consensus.cc:1685] finished
0709 12:23:10.652956 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.653084 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297260,"raft.queue_time_us":354,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":40201,"thread_start_us":569370,"threads_started":2,"wal-append.queue_time_us":487175}
I20260709 12:23:10.644554 12780 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.679178  8070 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:10.670943 12738 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:10.674801 12782 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.691135  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.691892  8068 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:10.677678 12646 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.693037 12530 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.693113 12646 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.694592  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.694883  8758 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:10.695649  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.694814 12378 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.697048 12378 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.698351 12678 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.699113 12378 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.699054  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.700085  8068 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:10.700081 12644 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:10.682992 12888 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:23:10.683552 12886 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:23:10.673869 12642 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:23:10.685774 12389 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.711407 12389 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.711758 12780 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.705404 12832 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.713646 12389 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.707309 12668 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:10.714812  8069 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:10.700513 12678 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.713904 12832 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.715817 12671 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.672395 12774 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:23:10.718070 12887 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:23:10.719332  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 742) took 2740 ms. Trace:
I20260709 12:23:10.719741  8067 rpcz_store.cc:276] 0709 12:23:07.978828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.978978 (+   150us) service_pool.cc:224] Handling call
0709 12:23:07.979371 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.076751 (+ 97380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.076784 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.085933 (+  9149us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.120553 (+2034620us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180043cae0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:10.382536 (+261983us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:10.382594 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.382701 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.717471 (+334770us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:10.719042 (+  1571us) raft_consensus.cc:1685] finished
0709 12:23:10.719071 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.719252 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133424,"raft.queue_time_us":99251,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":108,"spinlock_wait_cycles":13068928,"thread_start_us":261739,"threads_started":1,"wal-append.queue_time_us":2441302}
I20260709 12:23:10.723717  8138 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:10.725437  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 696) took 1497 ms. Trace:
I20260709 12:23:10.726431 12704 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.727612 12704 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.725926  8763 rpcz_store.cc:276] 0709 12:23:09.230130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.365836 (+135706us) service_pool.cc:224] Handling call
0709 12:23:09.394085 (+ 28249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:09.394309 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:09.529516 (+135207us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.531790 (+  2274us) log.cc:844] Serialized 14 byte log entry
0709 12:23:10.126180 (+594390us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b180046f840. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:10.127381 (+  1201us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b180046f840. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:10.715476 (+588095us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b180046f840. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f498c642d70 00007f498c636293 00007f498c62bcea 00007f498c62c23a 00007f498ca96a2a 00007f498caa60bf 00007f498caa6038
0709 12:23:10.725014 (+  9538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:10.725079 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:10.725133 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.725228 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.725367 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15789,"prepare.queue_time_us":47223,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":1784,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2037,"spinlock_wait_cycles":37137920,"thread_start_us":106180,"threads_started":1}
I20260709 12:23:10.677357  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:10.734191  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57138.5us
I20260709 12:23:10.736786  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:10.740749  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.743559  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.746529  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.750571  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.751677  8068 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.723863 12145 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.756803 12378 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:10.759567  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.760615  8764 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:10.754382 12642 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.705689 12644 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.754817 12424 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.765930  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.732028 12528 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:10.743383 12665 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:10.744309 12432 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.754581 12672 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:10.750074 12727 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:10.768023 12642 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.773375 12145 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:10.777000 12432 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:10.778585 12672 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:10.780992  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.790243  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.791478  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.782581  8068 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:10.762543 12378 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.800392  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.801429  8212 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:10.803452  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.806183  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.806398  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:10.795469  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.804911 12378 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:10.810652 12872 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.332s	user 0.006s	sys 0.000s
W20260709 12:23:10.811605  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.813601  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.814432  8219 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:10.816190  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 870) took 1386 ms. Trace:
I20260709 12:23:10.816619  8144 rpcz_store.cc:276] 0709 12:23:09.431117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.495843 (+ 64726us) service_pool.cc:224] Handling call
0709 12:23:10.816032 (+1320189us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:10.816135 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598510976}
I20260709 12:23:10.818383  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.819406  8219 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:10.771065 12424 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.796252  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:10.792847 12718 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:10.821907  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.822196  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.796875 12726 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:10.827450  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:10.797513  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:10.833148  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.827665  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.796578 12389 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:10.829959 12774 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:10.834698 12774 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:10.835614  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.835765 12774 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:10.839430  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48000.7us
I20260709 12:23:10.806614 12671 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.834183  8063 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.795838  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.840745  8068 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.841272  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:10.841922  8215 raft_consensus.cc:2376] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:23:10.844527  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.845736 12718 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.821151 12665 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.815999 12738 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:10.849795  8763 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:10.849910  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.852397  8070 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:10.852712  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.855023  8764 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:10.857103  8063 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.859916  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:10.862452  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.864678  8068 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:10.865489  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:10.889240  8765 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:10.865912  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:10.871850  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.872498  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.890694  8144 raft_consensus.cc:2410] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:10.888025  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.891490  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.891749  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.873376  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.874650  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:10.878113  8137 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:10.880131  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.894780  8186 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.884258 12901 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:10.898427 12655 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:10.900105 12901 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:10.901095 12642 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:10.901430  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.901738 12738 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.901291 12901 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.903695  8144 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:10.904695 12726 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:10.886473  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 83994.9us
I20260709 12:23:10.894876  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.884567  8756 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:23:10.905727  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:10.896049  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.906405  8137 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.896656  8140 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:10.906649 12424 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:10.851075 12389 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.906605  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.907501  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.907868  8142 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:10.907995  8140 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.888230  8141 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:10.895009  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.900157 12655 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:10.905283 12726 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:10.879945 12801 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.898002  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:10.943742  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.908776  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.948661  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.949322  8142 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
W20260709 12:23:10.949514  8064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3053) took 1568 ms (client timeout 1953 ms). Trace:
I20260709 12:23:10.950176  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.889214 12665 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.949409  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.952232  8142 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:10.952419  8137 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:10.950022  8064 rpcz_store.cc:269] 0709 12:23:09.380846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.380957 (+   111us) service_pool.cc:224] Handling call
0709 12:23:10.949336 (+1568379us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400322dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:10.949447 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416370560}
I20260709 12:23:10.954613  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.956991  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.955399  8142 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:10.958308  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.958948  8142 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:10.963613  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.964567  8142 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.965539  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.967168  8142 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.966646  8141 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:23:10.968822  8141 pending_rounds.cc:85] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:23:10.968852  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.969251  8141 pending_rounds.cc:107] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:23:10.969614  8141 raft_consensus.cc:2889] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:10.970594  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72648.3us
I20260709 12:23:10.971381  8064 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.971405  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:10.973448  8140 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:10.974346  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:10.974855  8140 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.971765  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.972710  8141 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.978704  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:10.979287  8141 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:10.981209  8140 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:10.982690  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.898545 12727 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.983469 12389 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:10.983808 12727 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.983855 12823 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:10.984643 12727 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.862003 12672 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:10.986388  8063 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:23:11.014348  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:10.995460  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:10.947299 12642 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:11.024919  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53204.1us
I20260709 12:23:11.027136  8756 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:11.028558  8064 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
W20260709 12:23:10.986586  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91673.5us
I20260709 12:23:11.015874  8068 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 8.
I20260709 12:23:11.029145  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.031219  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:11.019821  8142 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:11.019737  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.984520 12726 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.041085 12718 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:11.041177  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.046857  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:10.985641 12704 raft_consensus.cc:2764] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:23:11.042661 12871 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.153s	user 0.000s	sys 0.002s
I20260709 12:23:10.978799 12649 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.060256 12642 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:11.043787  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:11.033852 12801 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:10.983804 12145 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:11.099499 12145 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.099895 12145 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.059347  8068 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:11.101274  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:10.987280 12678 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:11.061024  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.015516 12782 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.108664 12782 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.110983 12782 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.043536  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:11.032160 12665 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:11.111785 12665 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.112229 12665 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:11.099125 12900 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:11.115486 12900 consensus_queue.cc:1243] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:11.111785  8142 raft_consensus.cc:2376] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14. Re-sending same reply.
W20260709 12:23:11.118727 12912 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:23:11.119666 12665 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.060863 12780 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:23:11.015295 12389 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.122143 12432 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.060267 12823 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.124017  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:11.095000  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.124436  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.125062  8756 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:11.125095  8068 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:11.125496  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:11.126148  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:11.126502  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:10.985435 12899 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:23:11.096648  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51888.6us
I20260709 12:23:11.062438 12655 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:11.108134 12902 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:23:11.077256 12774 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:11.129992  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.134619  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.127198  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.063670  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.133003  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 694) took 1955 ms. Trace:
I20260709 12:23:11.133486  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:11.135921  8064 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.135319  8762 rpcz_store.cc:276] 0709 12:23:09.178005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.178323 (+   318us) service_pool.cc:224] Handling call
0709 12:23:09.192068 (+ 13745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.192996 (+   928us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:09.271985 (+ 78989us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.524502 (+252517us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:09.525272 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.525468 (+   196us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:09.525523 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.525631 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.042082 (+1516451us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:11.123843 (+ 81761us) raft_consensus.cc:1685] finished
0709 12:23:11.132801 (+  8958us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.132939 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468,"prepare.queue_time_us":240043,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":26338,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":8961,"spinlock_wait_cycles":28445952,"thread_start_us":194611,"threads_started":2,"wal-append.queue_time_us":393137}
I20260709 12:23:11.097654 12642 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.139127  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.060534 12783 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 12:23:11.141594  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 78007.7us
I20260709 12:23:11.140609  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.150712  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.060649 12668 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:23:11.226055  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.154568  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:11.148566 12823 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:11.177619 12738 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:11.330479 12485 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:11.332734 12823 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:11.333316 12823 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:11.337046  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 182643us
I20260709 12:23:11.338027  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.177084  8068 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [12.6-15.8]
I20260709 12:23:11.148830 12642 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:11.190676 12424 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:11.145984 12832 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:11.133699 12774 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.168499 12801 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:11.206053  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.155792  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.174280  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.093732 12671 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:23:11.147689 12780 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.235147 12145 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.268612  8064 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:23:11.324540 12915 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:23:11.328732  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 95236.4us
W20260709 12:23:11.471380  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 297193us
I20260709 12:23:11.473711  8142 pending_rounds.cc:85] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 10
I20260709 12:23:11.474140  8142 pending_rounds.cc:107] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:11.474450  8142 raft_consensus.cc:2889] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.477085  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:11.480854  8064 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:11.482452  8064 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.485445  8064 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:11.486896  8064 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.489753  8064 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:11.460233  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.457405 12649 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:11.459507 12901 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:11.505275 12145 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:11.460351 12801 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.461650 12774 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.516875 12649 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:11.500800 12869 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.460078 12738 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:23:11.494800 12677 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:11.498749 12718 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:11.495126 12704 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.500324 12485 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:11.521354  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:11.543509 12649 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.507542 12432 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:11.545148  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.522926 12801 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:11.507517 12901 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:11.557034  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.558550  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.549154 12677 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:11.555320 12485 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.556077 12738 consensus_queue.cc:1243] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:11.546588 12869 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.566768 12901 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:11.607366 12891 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.968s	user 0.009s	sys 0.000s
I20260709 12:23:11.566655 12432 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.588917 12485 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.555665 12704 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.586439 12677 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:11.589474 12727 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.595s	user 0.000s	sys 0.012s
I20260709 12:23:11.592255 12919 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.608108 12923 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:11.638604  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 141484us
I20260709 12:23:11.643085  8145 raft_consensus.cc:2376] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14. Re-sending same reply.
I20260709 12:23:11.617530 12659 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.647338 12671 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.651062 12916 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.638552 12727 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.614326 12718 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.644035 12923 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.661435 12659 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:11.690155 12658 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:11.642580 12919 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:11.696648  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 223754us
I20260709 12:23:11.697248  8137 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:11.687435 12839 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.707728  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.668731 12671 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.713186 12783 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:11.695132 12658 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:11.694824 12925 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.696875 12668 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:23:11.731526  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1927) took 1383 ms. Trace:
I20260709 12:23:11.733772  8065 rpcz_store.cc:276] 0709 12:23:10.348265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.348467 (+   202us) service_pool.cc:224] Handling call
0709 12:23:10.348842 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.361466 (+ 12624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.361509 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:10.361563 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:10.361608 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.731264 (+1369656us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54001072d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:11.731309 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.731464 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28573568}
W20260709 12:23:11.729336  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60092us
I20260709 12:23:11.675036 12916 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.727174  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:11.740270  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:11.740358  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.702046 12659 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.722285 12775 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.731978 12839 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:11.742235 12764 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:11.737061 12843 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:11.735112 12806 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.745617 12780 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:11.747135 12759 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.732170 12925 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.758185 12869 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.775602  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.758131 12843 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:11.765038 12922 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:23:11.765314 12432 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.750602 12775 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.785382  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 878) took 1114 ms. Trace:
W20260709 12:23:11.786281  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46104.3us
I20260709 12:23:11.767640 12806 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:23:11.786938  8138 rpcz_store.cc:276] 0709 12:23:10.671083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.671229 (+   146us) service_pool.cc:224] Handling call
0709 12:23:10.722273 (+ 51044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.724484 (+  2211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.785145 (+1060661us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b54002bf7d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:11.785309 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116353280}
I20260709 12:23:11.770108 12780 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:11.787593  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.787590  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:11.793862  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.772086 12927 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.770771 12932 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.795497  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.779225 12919 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:11.786970 12920 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:23:11.785063 12926 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.802068 12759 raft_consensus.cc:2764] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:11.805207 12668 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.805128 12926 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.802263 12775 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.807698 12923 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:11.808403  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1943) took 1046 ms. Trace:
I20260709 12:23:11.799379 12727 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:11.809157 12924 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:23:11.808924  8068 rpcz_store.cc:276] 0709 12:23:10.768660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.455963 (+687303us) service_pool.cc:224] Handling call
0709 12:23:11.456386 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:11.475772 (+ 19386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.475813 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:11.476346 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 12:23:11.640617 (+164271us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:11.641393 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.641507 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.808122 (+166615us) raft_consensus.cc:1685] finished
0709 12:23:11.808144 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.808330 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217782,"raft.queue_time_us":298,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10254,"thread_start_us":130116,"threads_started":1,"wal-append.queue_time_us":238183}
I20260709 12:23:11.811755  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:11.812361  8145 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.812601  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:11.788960 12936 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:11.813025  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3062) took 2423 ms (client timeout 1719 ms). Trace:
W20260709 12:23:11.822122  8066 rpcz_store.cc:269] 0709 12:23:09.389188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.461343 (+ 72155us) service_pool.cc:224] Handling call
0709 12:23:11.812861 (+2351518us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54001f7054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:11.812956 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508420992}
I20260709 12:23:11.794994 12869 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:11.814906 12935 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:11.815366  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 982) took 1244 ms. Trace:
I20260709 12:23:11.817130 12791 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:11.807711 12926 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.774456 12783 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:23:11.789862 12832 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.852538  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:11.823016  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.853672  8142 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:11.854421  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.854897  8142 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:11.855556  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.855615  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.856313  8142 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:11.826174  8758 rpcz_store.cc:276] 0709 12:23:10.571106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.571217 (+   111us) service_pool.cc:224] Handling call
0709 12:23:11.815203 (+1243986us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54005f0fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:11.815305 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282377600}
I20260709 12:23:11.798799 12905 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.830152 12780 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.800531 12932 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.777015 12658 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.833019 12925 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.836872 12935 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:11.827400 12869 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.822032 12936 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.844303 12659 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.845202  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.845407  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:11.846393  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3071) took 1305 ms. Trace:
I20260709 12:23:11.826329 12843 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.873901  8144 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:11.849205  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.874511 12843 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:11.874951 12832 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:11.875041  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.850999  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:11.875720  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:11.875715 12832 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:11.876478 12832 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.853199  8213 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.878635 12832 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.879155 12832 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.879869 12658 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.848973 12671 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:11.859119  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.855902  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.881132 12935 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.852365 12916 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.857995  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:11.869351  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.870605  8145 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:11.871609  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76161.5us
I20260709 12:23:11.873836  8146 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.886443  8138 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:11.876013  8214 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.851815  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1929) took 1493 ms. Trace:
I20260709 12:23:11.887763  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.887665  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.875770  8144 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:11.799082 12927 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.882475  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.862252  8219 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.891263  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.857510  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.895253  8142 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:23:11.883682  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.873780  8220 rpcz_store.cc:276] 0709 12:23:10.540862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.541030 (+   168us) service_pool.cc:224] Handling call
0709 12:23:11.846203 (+1305173us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5400168fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:11.846317 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50408832}
I20260709 12:23:11.895756  8213 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:11.890043  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.887151  8062 rpcz_store.cc:276] 0709 12:23:10.358245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.358409 (+   164us) service_pool.cc:224] Handling call
0709 12:23:10.401616 (+ 43207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.551380 (+149764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.851599 (+1300219us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001f5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:11.851758 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327695744}
I20260709 12:23:11.893930  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:11.897140  8219 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:11.894093  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:11.896359  8144 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:11.897982  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.898186  8219 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.900377  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.903926  8146 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:11.904839  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46894.4us
I20260709 12:23:11.905004  8068 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:11.905099  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.905617  8068 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:11.905926  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:11.906905  8142 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:11.885120 12671 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:11.913408  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.872972 12936 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:11.907089  8144 pending_rounds.cc:85] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:23:11.915134  8144 pending_rounds.cc:107] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:23:11.915215  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:11.915488  8144 raft_consensus.cc:2889] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.915823  8220 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:23:11.872313 12938 consensus_queue.cc:1175] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c70d5020db543caa986f80b0adaa8d2" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 12:23:11.907944  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:11.908380 12659 raft_consensus.cc:2764] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:23:11.909402 12485 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.909976 12528 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:11.911304  8145 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:11.911379  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:11.886116 12837 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:11.899686 12925 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:11.918619  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:11.895023 12916 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:11.906404  8068 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.920954  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:11.914623 12783 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:11.937680 12869 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.938382 12825 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:23:11.926220 12843 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:11.940320 12843 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.940780 12843 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:11.945086  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1932) took 1569 ms. Trace:
I20260709 12:23:11.945451  8069 rpcz_store.cc:276] 0709 12:23:10.376178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.376446 (+   268us) service_pool.cc:224] Handling call
0709 12:23:10.377090 (+   644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.715202 (+338112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.944819 (+1229617us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54003228d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:11.945030 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776118016}
I20260709 12:23:11.945849  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:11.946393 12642 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.947388 12668 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:11.947952  8215 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.863266 12905 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:11.948978 12759 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:11.950484 12905 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:11.917263  8142 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:11.954038  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.927413  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:11.928107  8220 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:11.955195  8142 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:11.914028 12649 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.914734 12671 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:11.931341  8068 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.896508 12832 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:11.926393 12837 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.934821 12665 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.934917 12927 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:11.920845 12926 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:11.893044 12801 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.971706  8068 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:11.924340 12775 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:11.925506  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:11.960808  8214 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:11.932842 12528 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:11.971055 12926 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:11.981604 12926 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:11.981968 12528 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:11.961494 12671 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:11.988447  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 63026.8us
I20260709 12:23:11.988729  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.990553  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.991545  8065 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:11.928520 12925 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:11.921087 12934 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:23:11.947960 12668 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:12.019152  8067 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:12.018918 12774 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.019701 12668 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.020195  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.937280 12932 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:11.961836 12424 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 12:23:12.021025 12774 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.021108 12424 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:12.021522  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:12.022384 12823 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.000s
I20260709 12:23:11.968940 12647 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:11.968930 12942 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:23:11.969767 12837 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:11.974581 12655 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.929379 12919 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:12.036739 12894 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.458s	user 0.007s	sys 0.006s
I20260709 12:23:11.997092  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:12.038161  8064 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:12.009783 12665 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:12.006491  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.011629 12925 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.957367 12916 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:12.012651  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 117852us
W20260709 12:23:12.013468  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 113136us
I20260709 12:23:11.961274 12649 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.044091  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:12.045382  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:12.018637 12934 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:12.022595  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:11.977854  8214 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:23:11.926417 12939 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:12.028532 12929 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.067557  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3065) took 2374 ms. Trace:
I20260709 12:23:12.067392 12929 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.067989  8061 rpcz_store.cc:276] 0709 12:23:09.693675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.693867 (+   192us) service_pool.cc:224] Handling call
0709 12:23:10.950345 (+1256478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.968889 (+ 18544us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:10.987624 (+ 18735us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.151429 (+163805us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.151674 (+   245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:11.151735 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:11.151793 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.151891 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.809981 (+658090us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18003fd540. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:12.067361 (+257380us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400322dd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:12.067495 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18133,"prepare.queue_time_us":677640,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":21920,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":47894,"spinlock_wait_cycles":2878496256,"thread_start_us":102427,"threads_started":1,"wal-append.queue_time_us":193157}
I20260709 12:23:11.993137 12775 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.033293  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.070266  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:12.000137  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.039389  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.076218  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.033129  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:12.006531  8063 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:12.045624  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:12.047016  8764 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:12.047205  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:12.078284  8760 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:12.047482  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:12.047425  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:12.079816  8214 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:12.079725  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:12.049021  8067 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:23:12.023491 12900 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.024763 12647 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:12.025218  8144 raft_consensus.cc:1217] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Deduplicated request from leader. Original: 8.4->[11.5-15.8]   Dedup: 12.6->[13.7-15.8]
I20260709 12:23:12.053390  8064 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:12.053856 12955 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:12.040333 12665 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:12.059825 12780 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:12.055208  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:12.055305  8765 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:12.055783  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:12.106163  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.054816  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.107960  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:12.055495  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:12.055555  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:12.048777 12934 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:12.075090  8069 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:12.081420  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.082033  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:12.109208  8756 raft_consensus.cc:2376] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10. Re-sending same reply.
I20260709 12:23:12.083371  8144 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [11.5-15.8]
I20260709 12:23:12.084839 12953 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:12.086236 12649 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.079097 12775 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.039877 12655 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:12.087312 12943 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:23:12.135196 12946 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:23:12.135941  8143 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:23:12.136197 12944 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:23:12.136894  8146 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:12.055452 12916 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.140808 12937 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:12.142238 12937 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:12.088157  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.088546  8214 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:12.058440 12485 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.060382 12843 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.089689 12647 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.092962 12900 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.096271  8216 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:23:12.057443 12901 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.129916 12718 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:12.097280 12658 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:12.025983 12823 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.099783 12646 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.088194  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1938) took 1355 ms. Trace:
I20260709 12:23:12.114434 12677 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.102246 12926 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.104827 12665 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:12.109375  8758 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:12.109956  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:12.110522  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:12.210960  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 100567us
I20260709 12:23:12.114611  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:12.213037  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98516.7us
I20260709 12:23:12.213946  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:12.122612  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.217204 12932 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:12.217670 12932 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.218048 12932 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:12.219110  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 869) took 2816 ms. Trace:
I20260709 12:23:12.130590  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.117820  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:12.222965  8144 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:12.223855  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:12.070271 12929 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.104874 12780 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:12.225528 12780 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.225932 12764 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:12.129215 12671 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.226588 12764 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.227090 12704 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.228106 12671 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.150528 12936 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.229014 12764 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.229579 12764 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.230465 12936 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.231060 12936 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.231488 12936 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.231910  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:12.152801 12655 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.153501  8061 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:23:12.233563  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1867) took 1349 ms. Trace:
I20260709 12:23:12.234120  8137 rpcz_store.cc:276] 0709 12:23:10.884409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.953161 (+ 68752us) service_pool.cc:224] Handling call
0709 12:23:10.953392 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:11.699848 (+746456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.233232 (+533384us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400041fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.233479 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710140672}
I20260709 12:23:12.142611 12937 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:12.236037  8137 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:12.097018 12941 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:12.236213 12937 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.236896 12941 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.237531 12941 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:12.176131  8146 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:12.190804  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.230170 12764 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.241698 12764 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.242221 12764 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:12.243606 12764 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:12.243927 12764 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:12.244729 12764 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.245865 12764 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.248957  8220 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:12.216806 12927 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:12.251231 12927 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:12.252125 12927 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.101516 12378 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.174932  8070 rpcz_store.cc:276] 0709 12:23:10.732824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.733024 (+   200us) service_pool.cc:224] Handling call
0709 12:23:12.088041 (+1355017us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000fdcd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:12.088142 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248603520}
I20260709 12:23:12.257010 12642 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:12.258175  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.258669  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1881) took 1302 ms. Trace:
W20260709 12:23:12.259091  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.219688  8139 rpcz_store.cc:276] 0709 12:23:09.402944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.931957 (+529013us) service_pool.cc:224] Handling call
0709 12:23:10.014837 (+ 82880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.149435 (+134598us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:10.524197 (+374762us) log.cc:844] Serialized 14 byte log entry
0709 12:23:10.607618 (+ 83421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:10.607675 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:10.607729 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.197104 (+589375us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b18000f5380. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:12.218086 (+1020982us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18000f5380. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419
0709 12:23:12.218639 (+   553us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001c34d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.218697 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.219027 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":472891,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":125,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":11367,"spinlock_wait_cycles":324829696,"thread_start_us":457429,"threads_started":2,"wal-append.queue_time_us":172408,"wal-append.run_cpu_time_us":1053,"wal-append.run_wall_time_us":1001079}
I20260709 12:23:12.224424  8144 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:12.237608 12937 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:12.270637  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.270920 12642 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:12.272027  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.259127  8140 rpcz_store.cc:276] 0709 12:23:10.956481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.982000 (+ 25519us) service_pool.cc:224] Handling call
0709 12:23:10.982259 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.982400 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:11.026539 (+ 44139us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.243758 (+1217219us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800367180. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:12.258314 (+ 14556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:12.258373 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:12.258424 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.258490 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.258614 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34018,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":338,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":3643776,"thread_start_us":14300,"threads_started":1,"wal-append.queue_time_us":1218286}
I20260709 12:23:12.282346 12786 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:12.283025 12936 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.121536 12955 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:23:12.284963  8218 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:12.286499 12145 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:12.332475 12145 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:12.159436 12644 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.307410  8144 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:12.298755  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.333814  8140 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:12.325176  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.338433  8220 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:12.287551  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.340097  8137 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:12.169045 12718 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.361577 12644 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.362743 12704 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.173166 12837 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.387429 12704 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.363271 12145 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:12.363909  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.173504 12647 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:12.171402 12934 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.366628  8141 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:12.367202  8212 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:12.174655 12424 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.392812  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.390322 12145 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:12.392370  8069 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:12.392135  8068 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:12.172149 12925 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.427107  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:12.433552  8140 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:12.369019 12718 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:12.465113  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.463075  8070 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:12.389899 12843 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.389479 12837 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.391100 12901 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.389920 12704 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.388550 12823 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.368672 12658 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:23:12.492334  8219 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:12.495213  8213 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:23:12.500496  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 288085us
W20260709 12:23:12.496958  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 384523us
W20260709 12:23:12.505736  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 236740us
I20260709 12:23:12.424156 12953 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:12.474061 12786 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:23:12.522672  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:12.553368  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:12.428241 12424 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.568387  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:12.570943 12962 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:23:12.571842  8061 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:12.604663  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:12.606294  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.607048  8138 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.610935  8143 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:12.613283  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.614156  8137 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:12.621326  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:12.622517  8144 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:12.624039  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57202.3us
I20260709 12:23:12.625469  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:12.642784  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:12.669088  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.670933  8144 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:12.687508  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.691877  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.693780  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.513406 12941 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.698001  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.696836  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.705724  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:12.706583  8145 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:12.711010  8138 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:12.588867 12665 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.714558  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:12.715790 12424 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.717797  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.718521  8215 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:12.716843 12677 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:12.727118 12932 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:23:12.668573 12905 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.742812 12905 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.745041 12905 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.748896  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:12.749717 12764 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.005s
I20260709 12:23:12.750299  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.750986  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:12.751287 12938 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:12.752195  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.753842  8218 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:12.754957  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.756014  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.757306  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.758049  8218 raft_consensus.cc:2376] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12. Re-sending same reply.
I20260709 12:23:12.680697 12668 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:12.734112 12966 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:23:12.735016 12961 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:23:12.759182  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:12.735880 12964 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:23:12.589493 12968 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.168s
I20260709 12:23:12.565835 12781 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 12:23:12.736799 12975 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:23:12.737655 12955 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:12.740916 12926 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:12.741341  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:12.742240 12919 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.707s	user 0.004s	sys 0.005s
I20260709 12:23:12.720117 12665 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.732743 12528 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:12.759737  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 232138us
I20260709 12:23:12.760040  8218 raft_consensus.cc:2368] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:12.727803 12932 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.770862  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.758095 12941 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:12.772261  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 165877us
I20260709 12:23:12.775177  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.752132 12938 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:12.765944 12960 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.559s	user 0.000s	sys 0.006s
I20260709 12:23:12.768997 12900 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:12.779419  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 256830us
I20260709 12:23:12.774459 12919 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:12.779313 12953 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.773895 12955 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:12.764262 12718 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:12.794667 12938 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.797194 12935 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:12.797655 12935 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:12.784232 12941 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:23:12.797983 12718 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:12.798522 12935 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:12.799830 12935 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:12.799705 12955 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:12.806609 12937 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
I20260709 12:23:12.818257 12801 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.814528 12981 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:23:12.846606 12925 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:12.848600 12932 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:12.820315 12963 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
W20260709 12:23:12.886878  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 249340us
W20260709 12:23:12.889870  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.896414  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.896910  8065 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:12.902732  8144 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:12.903385  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1878) took 1947 ms. Trace:
I20260709 12:23:12.763523  8145 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:12.906137  8146 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 6. Current term is 8. Ops: []
I20260709 12:23:12.906694  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:12.907240  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3068) took 2370 ms (client timeout 1768 ms). Trace:
I20260709 12:23:12.907819  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1892) took 1088 ms. Trace:
W20260709 12:23:12.907754  8216 rpcz_store.cc:269] 0709 12:23:10.536968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.537082 (+   114us) service_pool.cc:224] Handling call
0709 12:23:12.906757 (+2369675us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540017c0d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:12.906999 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560091520}
W20260709 12:23:12.909355  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.909837  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 764) took 1006 ms. Trace:
I20260709 12:23:12.909925  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.910926  8216 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 7.
I20260709 12:23:12.911769  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:12.910322  8066 rpcz_store.cc:276] 0709 12:23:11.903710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.903856 (+   146us) service_pool.cc:224] Handling call
0709 12:23:11.904066 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:11.951199 (+ 47133us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:11.951497 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.139170 (+187673us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:12.139246 (+    76us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:12.139305 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.909164 (+769859us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.909281 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.909601 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1933,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":47,"raft.queue_time_us":116,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":107929344,"thread_start_us":182051,"threads_started":1,"wal-append.queue_time_us":175768}
I20260709 12:23:12.913239  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.908288  8146 rpcz_store.cc:276] 0709 12:23:11.819602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.238763 (+419161us) service_pool.cc:224] Handling call
0709 12:23:12.239059 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.906774 (+667715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.907515 (+   741us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400311d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.907746 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532664192}
I20260709 12:23:12.906004  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.922461  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.828534 12780 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:12.908223  8220 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:12.837042 12926 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:12.832377 12934 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.024300 12926 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:13.025079 12649 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.026108 12649 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.026670 12926 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:12.843413 12967 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:23:12.842022 12970 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.597s	user 0.002s	sys 0.000s
I20260709 12:23:12.914845  8218 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:23:12.904300  8142 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:12.912405  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:12.982664  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:12.985885  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1927) took 1090 ms. Trace:
I20260709 12:23:12.987946  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 899) took 1136 ms. Trace:
I20260709 12:23:12.903972  8141 rpcz_store.cc:276] 0709 12:23:10.955592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.981217 (+ 25625us) service_pool.cc:224] Handling call
0709 12:23:10.981489 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.391989 (+1410500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.902729 (+510740us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.903175 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184990464}
W20260709 12:23:13.007221  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78653.6us
I20260709 12:23:13.016417  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.015885 12900 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:13.029140  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:13.031422  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.041718  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 147954us
I20260709 12:23:13.065116 12932 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.066064 12932 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.067699 12869 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.062515  8219 rpcz_store.cc:276] 0709 12:23:11.851479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.899544 (+ 48065us) service_pool.cc:224] Handling call
0709 12:23:11.899793 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.499709 (+599916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.987226 (+487517us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400134054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.987704 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362221312}
I20260709 12:23:13.062070  8213 rpcz_store.cc:276] 0709 12:23:11.894863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.958141 (+ 63278us) service_pool.cc:224] Handling call
0709 12:23:11.973658 (+ 15517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.497445 (+523787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.985013 (+487568us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400316ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:12.985589 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198848256}
I20260709 12:23:13.080590  8216 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:13.091272 12677 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.092242 12677 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.092849  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.093945  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.095239  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.095731  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.096891  8141 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:13.098479  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.098628 12649 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:13.099102  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.101323  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.100893 12869 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.101639 12145 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.103463 12145 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.106081 12926 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.106594  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1924) took 1212 ms. Trace:
I20260709 12:23:13.107020  8212 rpcz_store.cc:276] 0709 12:23:11.894078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.938832 (+ 44754us) service_pool.cc:224] Handling call
0709 12:23:11.939154 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.392271 (+453117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.106029 (+713758us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54002b4154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:13.106390 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983967616}
I20260709 12:23:13.108240 12145 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.103490 12823 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:13.109484  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.110114 12823 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.110869  8213 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:13.112922  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.113382 12823 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:13.114434  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.110751 12677 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.117151  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.118497  8140 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:13.118979  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.121096  8216 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:13.108721 12432 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.116976 12953 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:13.132965  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.125255 12953 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:13.160059  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3092) took 1044 ms. Trace:
I20260709 12:23:13.146409  8212 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:13.135957  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 143009us
I20260709 12:23:13.128311 12932 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.144940  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.161067 12801 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:13.148864  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.166381  8146 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:13.145125 12618 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:13.136229 12432 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.178687 12618 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:13.181222  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.182557 12655 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.183292 12655 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:13.184893  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.184726  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.147957 12649 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:13.186729 12649 consensus_queue.cc:1243] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:13.188184 12937 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:13.172812 12823 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:23:13.189126 12937 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.190013 12644 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:13.160739 12640 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:23:13.192211 12640 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:23:13.156755  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 309585us
I20260709 12:23:13.168447 12145 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:13.180393 12432 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.161545 12975 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.161994 12938 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.192286 12937 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.192696 12640 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:13.170748  8067 rpcz_store.cc:276] 0709 12:23:12.115240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.216105 (+100865us) service_pool.cc:224] Handling call
0709 12:23:12.216428 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.258773 (+ 42345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.258802 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:12.913733 (+654931us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b2c000014c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:12.914517 (+   784us) log.cc:844] Serialized 26 byte log entry
0709 12:23:13.042953 (+128436us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:13.044793 (+  1840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.051306 (+  6513us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.159415 (+108109us) raft_consensus.cc:1685] finished
0709 12:23:13.159447 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.159800 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164052864,"thread_start_us":126344,"threads_started":1,"wal-append.queue_time_us":169494}
I20260709 12:23:13.208712 12801 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.179924 12953 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.215134  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:13.224457 12927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.006s	sys 0.027s
W20260709 12:23:13.225011 12927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.006s	sys 0.027s
W20260709 12:23:13.225198  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.226341  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:13.228765  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 416954us
I20260709 12:23:13.231781 12668 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.238040  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.238692  8215 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.212155 12432 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.240593 12432 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.241071 12938 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.242395 12646 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.243121 12432 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.243221 12646 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.244100 12938 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.248502 12801 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.258040  8216 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:13.258425  8216 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.259429  8216 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.228757 12647 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:13.261420 12647 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.265902 12655 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.267109  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.268932 12975 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.276888  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:13.278039  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80247.4us
I20260709 12:23:13.278225 12432 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:13.278755 12432 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.279181 12432 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:13.279454 12647 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:13.280115  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.283674  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 57587us
I20260709 12:23:13.234215  8218 raft_consensus.cc:1217] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Deduplicated request from leader. Original: 8.4->[9.5-12.6]   Dedup: 9.5->[12.6-12.6]
I20260709 12:23:13.285315  8218 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [9.5-12.6]
I20260709 12:23:13.293323  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3083) took 1024 ms. Trace:
W20260709 12:23:13.295686  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 144536us
W20260709 12:23:13.289813  8110 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.719s (SENT)
I20260709 12:23:13.280908 12975 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.293744  8217 rpcz_store.cc:276] 0709 12:23:12.269263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.127611 (+858348us) service_pool.cc:224] Handling call
0709 12:23:13.157346 (+ 29735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.292964 (+135618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.293001 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:13.293056 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:13.293097 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.293162 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.293269 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32656,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":131683,"threads_started":1}
I20260709 12:23:13.287279 12618 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:13.306685 12780 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:13.309386  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.309899 12646 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:13.310587  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.313293  8061 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:13.287212 12668 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.319062 12668 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:13.319977  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 147118us
I20260709 12:23:13.320894  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.321367  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:13.323415 12738 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:13.323868 12738 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:13.324282 12738 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.324899 12927 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.325915 12927 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:13.327129 12662 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:13.328362  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2015) took 1538 ms. Trace:
I20260709 12:23:13.328879  8142 rpcz_store.cc:276] 0709 12:23:11.790296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.015003 (+224707us) service_pool.cc:224] Handling call
0709 12:23:12.017793 (+  2790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.085108 (+1067315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.328039 (+242931us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400255654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:13.328288 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036995968}
I20260709 12:23:13.329401 12869 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.329805 12932 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:13.330070 12981 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:13.330250 12932 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:13.330901 12981 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:13.333033  8216 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.333323 12640 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.335079 12640 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:13.335186 12145 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:13.338608  7967 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.008908  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.341450  8067 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 12:23:13.341300 12932 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:13.347559  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.348809  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:13.349437 12993 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:13.349761  8211 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:13.350481  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1933) took 1382 ms. Trace:
I20260709 12:23:13.348315 12655 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:23:13.351333 12823 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:13.347484  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:13.354122 12953 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.348980  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.350922  8214 rpcz_store.cc:276] 0709 12:23:11.902418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.144005 (+241587us) service_pool.cc:224] Handling call
0709 12:23:12.164902 (+ 20897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.165386 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:12.550418 (+385032us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.835273 (+284855us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b18003050e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:12.911223 (+ 75950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:12.912382 (+  1159us) log.cc:844] Serialized 26 byte log entry
0709 12:23:12.928794 (+ 16412us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:13.049526 (+120732us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.051160 (+  1634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.069468 (+ 18308us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.233766 (+164298us) raft_consensus.cc:1685] finished
0709 12:23:13.233801 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.237083 (+  3282us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18003050e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:13.284615 (+ 47532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3509,"prepare.queue_time_us":162590,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":129,"raft.queue_time_us":129803,"raft.run_cpu_time_us":858,"raft.run_wall_time_us":120620,"spinlock_wait_cycles":114353280,"thread_start_us":561341,"threads_started":2,"wal-append.queue_time_us":494570}
I20260709 12:23:13.358269  8218 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:23:13.310616 12646 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:13.307766  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:13.358700  8218 pending_rounds.cc:85] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
I20260709 12:23:13.345170  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.372051 12823 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.381667 12823 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.384883 12942 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.356206 12932 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.389935  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.377800  8218 pending_rounds.cc:107] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:23:13.394379  8218 raft_consensus.cc:2889] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.385577 12942 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.384557 12823 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.353127 12938 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.366044 12646 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.408599 12145 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.410956 12432 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.412138 12942 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.332204 12981 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.413106  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.414659  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.415906  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.417088  8141 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:13.419705  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72416us
I20260709 12:23:13.420001  8216 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:13.420832 12665 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.421965  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:13.423430 12916 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:23:13.423560  8140 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:23:13.428439  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.437703  8211 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:13.440507  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:13.441262  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 98944.3us
I20260709 12:23:13.409624 12646 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.446007  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:13.457060 12989 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.005s
I20260709 12:23:13.461273  8142 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:13.462757 12145 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:13.463523 12997 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.467546  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.476858  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.478422  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.439978 12938 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.482748 12145 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.447916 12738 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.482589 12655 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:13.489042 12655 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.489522 12655 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.487115 12432 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.492591  8757 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:13.495872  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 99657.1us
W20260709 12:23:13.495988  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 213717us
I20260709 12:23:13.477732 12926 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:23:13.512210  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 61170.1us
I20260709 12:23:13.518395 12780 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.519022  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.519300 12780 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.520047  8062 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:13.519941  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.520990 12996 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:13.521251 12942 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.521948  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.523000  8063 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:13.521991 12942 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.501267 12145 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.483807  7967 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.502067  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:13.532299  7966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 175) took 19399 ms (client timeout 15000 ms). Trace:
W20260709 12:23:13.546257  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.539829  8067 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:13.536845  8063 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:23:13.548290  8065 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:13.521190  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.514951  8215 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
W20260709 12:23:13.525866 12775 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.371s	user 0.018s	sys 0.013s
I20260709 12:23:13.528803  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.529124  8062 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:13.529420 12996 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.529855 12668 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.560566  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.563808 12668 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.557765  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.567946  8756 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:13.553504 12937 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:13.553874  8069 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.568922 12668 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.569967  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.570739  8064 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:23:13.572332  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43727.1us
I20260709 12:23:13.573378  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.572433 12662 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:13.574410 12662 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.575663 12662 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.576858 12916 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:13.577706 12916 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.568814 12775 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.562830 12996 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.578766 12916 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.505108 12975 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 12:23:13.578524  8110 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.790s (SENT)
I20260709 12:23:13.565204  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.583426  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.594172  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.596451  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.598090  8140 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:13.581175 12775 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.585464 12644 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:13.599490  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.609647  8145 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.594537  7967 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:13.605465  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46670us
I20260709 12:23:13.609529 12975 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:13.614491  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.615001 12975 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.616746 12938 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.617471  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:13.618417 12432 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:13.619117 12432 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:13.622789 12424 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.623613 12424 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.624294 12990 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:13.624797 12990 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.624940  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.625252 12990 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.625710  8065 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.626273 12424 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.626704 12942 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.627264  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.629843 12975 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.631462 12646 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.632000 12926 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:13.632346  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:13.632933  8140 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:13.633107 12775 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.633651  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.620287 12432 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.633671 12942 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:13.634460  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.633694  8143 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:13.663106  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:13.632958  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:13.635070 13005 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:23:13.634143 12937 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:13.634922  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.636766  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:13.639334  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.609666 12644 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:13.642782  8065 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
I20260709 12:23:13.643901 12655 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.634933  8756 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:23:13.679136  8756 pending_rounds.cc:85] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 9
I20260709 12:23:13.679404  8756 pending_rounds.cc:107] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:23:13.679667  8756 raft_consensus.cc:2889] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:13.646906  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.658083  8063 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:13.665737  8139 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:13.665859  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.666980  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.682049  8069 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:13.668042  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.682327  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.669050 12942 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:13.669250  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.670974  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.669883  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.659561 12926 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:13.668939  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.681885  8757 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:13.682437  8144 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:13.659435 12649 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:13.671772  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.689975  8143 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:13.691520  8220 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:13.693140  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114658us
I20260709 12:23:13.698947  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.699515  8218 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:23:13.545387  7966 rpcz_store.cc:269] 0709 12:22:54.133126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.133450 (+   324us) service_pool.cc:224] Handling call
0709 12:22:54.556572 (+423122us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54001a5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f6090 00007f498ca94f3a 00007f499284ae9c 00007f499294904e 00007f4990e0a2a4 00007f4990e0a232 00007f4990e0a161 00007f4990e0a0dc 00007f4990e09392 00007f498adc748c 00007f498adc68c6
0709 12:23:13.532007 (+18975435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:01.465780 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:01.477129 (+ 11349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:01.477203 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:23:01.477224 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:01.677215 (+199991us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:01.677293 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:01.677324 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:23:01.854133 (+176809us) tablet.cc:701] Row locks acquired
0709 12:23:01.854199 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:23:01.854429 (+   230us) write_op.cc:270] Start()
0709 12:23:01.854615 (+   186us) write_op.cc:276] Timestamp: P: 1783599781854343 usec, L: 0
0709 12:23:01.854644 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:23:01.855629 (+   985us) log.cc:844] Serialized 6657 byte log entry
0709 12:23:03.205088 (+1349459us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:03.648927 (+443839us) op_driver.cc:464] REPLICATION: finished
0709 12:23:03.770457 (+121530us) write_op.cc:301] APPLY: starting
0709 12:23:03.770604 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:04.511309 (+740705us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b54001a5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8932a 00007f498ca0ef14 00007f498ca0eec3 00007f498ca0ee38 00007f498ca0edf3 00007f498ca0e0dc 00007f498ca37e16 00007f498ca1fcbb 00007f498ca0a39d 00007f498ca0dd75
0709 12:23:04.718433 (+207124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:04.718477 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:05.353835 (+635358us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b1800349c60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f557 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:05.611621 (+257786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:05.612063 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:23:05.612134 (+    71us) write_op.cc:312] APPLY: finished
0709 12:23:05.612762 (+   628us) log.cc:844] Serialized 156 byte log entry
0709 12:23:05.716146 (+103384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:05.735454 (+ 19308us) write_op.cc:454] Released schema lock
0709 12:23:05.735546 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:05.736085 (+   539us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:05.736118 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1464079,"reported_tablets":31,"spinlock_wait_cycles":51633536,"child_traces":[["op",{"apply.queue_time_us":104653,"apply.run_cpu_time_us":116604,"apply.run_wall_time_us":1965611,"cfile_cache_hit":66,"cfile_cache_hit_bytes":69036,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":104377,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":9,"num_ops":17,"prepare.queue_time_us":332282,"prepare.run_cpu_time_us":29474,"prepare.run_wall_time_us":609950,"raft.queue_time_us":203455,"raft.run_cpu_time_us":9028,"raft.run_wall_time_us":915516,"replication_time_us":1794032,"spinlock_wait_cycles":45174784,"thread_start_us":505266,"threads_started":5,"wal-append.queue_time_us":585269,"wal-append.run_cpu_time_us":15653,"wal-append.run_wall_time_us":3247176}]]}
I20260709 12:23:13.699641  8139 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:13.700330  8070 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.702212 12655 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:13.702975 12678 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:13.677865 12937 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:13.704856  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68347.8us
I20260709 12:23:13.678404  7967 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.715788  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.717823  8067 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:13.722033  8213 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:13.721858  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.682494 12647 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.722927  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.730813  8062 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:13.734696  8062 pending_rounds.cc:85] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 6
I20260709 12:23:13.734935  8215 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:13.734989  8062 pending_rounds.cc:107] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:13.735626  8062 raft_consensus.cc:2889] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.684571 12942 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:13.742821  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.743495  8140 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:13.743628  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 96890.8us
W20260709 12:23:13.728963  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 96715.6us
I20260709 12:23:13.738706  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.738883  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:13.708281 12665 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:13.739966  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.747278  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.748070  8761 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:13.751030  8143 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
W20260709 12:23:13.751307  8110 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.812s (SENT)
I20260709 12:23:13.751905  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:13.718708 12938 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:13.756862  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:13.759510  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.766144  8756 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:13.770905  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:13.771740  8069 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:13.775525  8143 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:23:13.748840 12678 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:13.770272  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.745666 12738 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:13.749372 12665 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.743391 12780 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.775974  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.779673  8063 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:13.710867 12649 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.781879  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.807973  8065 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 8: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:13.785838  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:13.791050  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.812218  8070 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:13.763279 12668 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:13.821045  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.731842 12990 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.772203 12938 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:13.783051  7967 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 9, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.827183  8213 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:13.779068 12678 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.844883 12678 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:13.845186 13006 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:23:13.827081 12668 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:13.846019 12668 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.848323  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.827772  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:13.840688  8756 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:13.840941  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:13.787276 12644 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.841995  8067 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:13.887040  8757 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
W20260709 12:23:13.843278 13008 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:13.806468 12665 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.817220 12432 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.844904 12646 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:13.845036 13007 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:23:13.844883 12926 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.837400  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:13.858685 12916 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:13.865396  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114124us
I20260709 12:23:13.867614 12938 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.838398 12927 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:13.899259  7967 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 9, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.869831 12649 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:13.871243 12942 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.754894 12647 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.827729 12677 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:23:13.842348 12935 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.965s	user 0.020s	sys 0.004s
I20260709 12:23:13.823475 12981 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.889091  8218 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:13.899279  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.903105  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.927122  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.910162  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:13.905592 12644 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.933980  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:13.935837  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:13.935925 12145 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.899356 12869 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:23:13.932994 12424 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.916797 12975 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.939556  8220 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.936906 12145 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.914507 12780 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:13.917085 12646 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.940512  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:13.936914  7967 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:13.955080  8140 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:13.957430  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 142242us
I20260709 12:23:13.976367  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:13.972714  7967 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:23:13.983923  8110 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.838s (SENT)
I20260709 12:23:13.984494  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:13.921304 12927 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:13.996915  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.933456 12981 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.978034 12662 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:14.011579  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:13.953024 12738 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:23:14.019477  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.020955  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:14.022010 12145 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:13.999118 12996 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:13.941442 12649 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:23:14.010272  7967 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 11, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.023865  8213 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:13.975246 12424 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:13.968851 12916 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.986706 12780 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.033195  8067 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.011291 12662 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.987179 12646 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:13.994071 12975 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:14.043128  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 128917us
I20260709 12:23:14.020720 12658 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:23:14.062341  7967 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 11, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.063721 12869 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:14.037827 12618 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:14.030844 12996 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:14.068938 12996 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.067714  7967 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:23:14.071220  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 87205.7us
I20260709 12:23:14.071440  7967 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:23:14.047847 12640 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.003s
I20260709 12:23:14.073779  7967 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.079545 12981 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.009310 12997 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:14.080724  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.080955 12997 consensus_queue.cc:1243] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:14.081403  8758 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:14.081919  8214 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:23:14.082329  8214 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:23:14.082484  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:14.082592  8214 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:23:14.083086  8214 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:14.083159  8213 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.088442 13030 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:14.093016  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:14.093739  8212 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:14.095709 12424 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.103590 12937 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.095772  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.105852  8219 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:14.106703  8215 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:14.081480 12997 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:14.109594  8220 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:14.104519 12646 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.047200 12662 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:14.112212  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 95725.9us
I20260709 12:23:14.044806 12990 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:14.116411  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 117369us
I20260709 12:23:14.122691  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.068068 12618 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.080307 12981 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:23:14.130491  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:14.132617  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:14.134404  8219 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:14.093067 13027 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.138198  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.111265 12997 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:14.143719 13016 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:23:14.145107 13027 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.147490 13027 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.149367 13029 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:14.162094  8067 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:14.168356  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.136456 12640 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.172562  8063 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:14.111776  7967 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 9, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 9 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:14.175500  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.165275  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:14.182782  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60166us
I20260709 12:23:14.183779  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:14.158890 12658 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:14.178673  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.181635  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.193420  8141 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.194813  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.186004  7967 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 11, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.207983  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.182236 12647 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.216400  8212 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:14.209930  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.208863  8139 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:23:14.218326  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53200.2us
I20260709 12:23:14.193054 12927 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.212690  8068 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:14.220245  7967 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 10, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 10 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:14.219213  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.203874 12981 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:14.205111 12869 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.212239 12990 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.222600  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.180866 12932 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:23:14.196936 12640 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.243518  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.242928  8068 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:14.243132  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.224303 12775 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:14.246615  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.245353  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.250787  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.227684 12658 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:23:14.264969 12801 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:14.277272  8144 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:14.244025 12738 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:14.279570  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69771.4us
I20260709 12:23:14.231781 12869 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.241146 12981 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:14.247617 12927 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:14.288067  8139 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:14.293586  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.259105 12780 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.259446 12647 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:14.298177  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 145284us
I20260709 12:23:14.277812 12655 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:14.296399  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.194s (SENT)
I20260709 12:23:14.295754  8062 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:14.278986 12775 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:14.301047  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:14.289109 12937 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.302809  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.295883 12869 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.260818 12990 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.306449  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:14.310132  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 86748.9us
I20260709 12:23:14.290385 12916 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:14.313647  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:14.317039  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76864.7us
W20260709 12:23:14.320050  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.317999  8141 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:14.301848 12975 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:14.323504  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.329866 12646 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:14.333506 12646 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.334131 12646 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:14.337494 13028 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
W20260709 12:23:14.339884 13020 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:23:14.354712 12942 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.295686 12738 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.379472  8066 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:14.309404 12424 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:14.364753 13029 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:14.364883  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 71177.4us
I20260709 12:23:14.297884 12678 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.372169 12640 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:14.375771  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55678.5us
I20260709 12:23:14.423822 12990 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.424367  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.425806 12738 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:14.427738 12934 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.428284 12934 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.412213 12662 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.430888 12934 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.431164 12662 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.376744 13035 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:14.307258 12927 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:14.438548 13035 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:14.438978 12927 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.439854 13035 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:14.441617  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.443359  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.444108  8137 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:14.448522  8140 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:14.444453  8144 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:23:14.364195 12668 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.004s
I20260709 12:23:14.382143  8211 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:14.249430 12997 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.383461  8213 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 8.
W20260709 12:23:14.391333  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:14.388185  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64738.6us
W20260709 12:23:14.395684 13039 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:23:14.395937 13033 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:23:14.459524  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 142509us
I20260709 12:23:14.412158 12981 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.393218 12937 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.387425 12780 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:14.416898 13013 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.516s	user 0.004s	sys 0.000s
I20260709 12:23:14.324702 12618 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.418649 12678 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.500900  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.501718  8142 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.418814 13032 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:14.419334  8061 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:14.401508 12775 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:14.420357 13014 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 12:23:14.465472 12926 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:14.507423 12869 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.520103 12869 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.465907  8138 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:14.521576  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.522207  8214 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:14.522526  8138 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:14.465530  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.523702  8140 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 8.
I20260709 12:23:14.452368  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.525104  8146 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:14.524966 12618 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:14.466553 12145 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.526032  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.526108 12145 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.526638 12618 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:14.502588 12937 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.527842 12916 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:14.408656 12646 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.469280  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.478755  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.483242 12738 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.481837  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.482257  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:14.451612 12665 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:23:14.486673  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.488703  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.468541 12647 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.494112  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.499800  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.500192  8144 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:23:14.559141  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.467815 12801 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:14.499392  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.480266  8137 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:14.499930 13033 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:14.508816 12432 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.508320 13024 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:14.509544 13032 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:14.510095  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 85912.4us
W20260709 12:23:14.513657  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 220121us
I20260709 12:23:14.534854  8141 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:14.528553 12145 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.493660 12780 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.507697  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:14.561535  8215 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:14.567345  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 262842us
I20260709 12:23:14.473299 12668 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.571334  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:14.528724 12916 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:14.573066  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 103897us
I20260709 12:23:14.529175 13043 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:14.581488  8211 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:14.581315  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.529626 12937 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.574113  8217 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:23:14.538825 12655 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:14.507491 12644 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:23:14.585747  8034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.989s (SENT) [suppressed 22 similar messages]
I20260709 12:23:14.599733  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:14.563361 12647 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.599920  8220 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:14.564250 13029 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.604239  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.583034 12780 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.621556  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:14.622290  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.533068 12996 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.622959 13051 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:23:14.623294  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:14.638540  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.612258 13029 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.624301 12937 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:14.625638  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118036us
I20260709 12:23:14.626397 13033 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:14.627518  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.628355 13032 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.586715 12678 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:14.586865 12932 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.631325  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.670684  8144 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.635354  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 1961) took 1099 ms. Trace:
I20260709 12:23:14.671448  8066 rpcz_store.cc:276] 0709 12:23:13.518022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.519596 (+  1574us) service_pool.cc:224] Handling call
0709 12:23:14.617594 (+1097998us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:14.617744 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275644800}
I20260709 12:23:14.589898 12916 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:14.640067  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.640729 13040 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:14.643891  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:14.598374 12738 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:14.685846  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45857.8us
I20260709 12:23:14.644408  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:14.645262  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.646044  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:14.590539 13043 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:14.687017  8758 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.648584 12145 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:14.615020 13023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.026s	sys 0.066s
I20260709 12:23:14.566083 12665 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.605516 12647 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.603370 12432 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.614347 12658 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.665827  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:14.650754 12644 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.656872 12937 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:14.595274 13030 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.690719  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.693362  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:14.585503 12942 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:23:14.575098 13024 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:14.693163  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54757.2us
I20260709 12:23:14.947141 12997 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.958173  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:14.950600  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 262070us
W20260709 12:23:14.832994  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.699126  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:14.840993  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.760028  8758 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:14.973223  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 282567us
W20260709 12:23:14.951035  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 346895us
I20260709 12:23:14.811054  8762 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:23:14.793754  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 147784us
W20260709 12:23:14.974192  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.977291  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:14.937518  8142 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:14.939188  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.978174  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.981876  8757 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:14.979071 12145 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:14.975914  8035 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.980829  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.982071  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:14.808964  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.808197  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:14.690421 13023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.026s	sys 0.066s
I20260709 12:23:14.697623 13051 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:15.067342  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.685772 12916 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.995903  8139 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:14.991982  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:15.001427  8142 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:14.970086 12644 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.988394  8143 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:14.821151 13055 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:23:14.984856  8763 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
W20260709 12:23:15.021214  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45386.8us
I20260709 12:23:14.990490  8034 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:15.047271  8144 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
W20260709 12:23:14.991576  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 317787us
I20260709 12:23:14.982820 12738 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:14.969048 12937 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.099905  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:14.988649  8219 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:23:15.087617  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.761483 13032 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.697853 12640 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:14.990599 13057 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:14.987565  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.706513 12649 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:15.031229  8140 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:15.113165  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.988147  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:14.669292 12869 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.419s
I20260709 12:23:15.096339  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:14.978081 12678 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:15.100688  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 118706us
I20260709 12:23:14.989106 12668 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.967063 12658 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:14.950587 12646 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:14.996505 12665 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.999712 12934 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:14.988694 13048 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:15.081332 13027 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.977658 13030 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.197929  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:15.106220  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 125428us
I20260709 12:23:15.090337  8758 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:15.108259  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.095403 12644 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.988204 12764 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:23:15.126785  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.808576 13043 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.128384  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:15.131121  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:15.134135  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:15.098766 12738 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:15.108218 12640 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:15.105587 12996 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:14.987077  8761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:15.278012  8760 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:15.109650 13023 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.830348 12655 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.115556  8764 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:15.278174  8761 raft_consensus.cc:606] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:15.288157  8139 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:15.279454  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 145433us
I20260709 12:23:15.136402 12649 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:15.277688  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 90248us
I20260709 12:23:15.279666  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:15.334322  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 343884us
W20260709 12:23:15.334975  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 203904us
I20260709 12:23:15.335060  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.266111  8757 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:23:15.342999  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 357011us
I20260709 12:23:15.276844 12925 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:15.344010  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.382911  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:15.342343  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54704us
W20260709 12:23:15.383728  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 104152us
I20260709 12:23:15.345706  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.383924  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:15.359552  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.285212 12738 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:15.285533 13023 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.345019  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:15.391196  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46286.4us
I20260709 12:23:15.391434 12145 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:15.392252 12145 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:15.285739 13048 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:15.384502  8762 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:15.384497  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:15.392927  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:15.393736  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:15.341460 12677 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:15.192137 12934 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.422386  8140 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:15.423102  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:15.276654 13025 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.275s
I20260709 12:23:15.390691 12996 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:15.430027  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.395452 13043 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.396839 13023 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.395308 13033 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.445915  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.419736 12677 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:15.428198 12942 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:15.460997  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 336866us
I20260709 12:23:15.448235 12145 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.432899 12927 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:15.478842  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:15.482602 13060 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:23:15.457163 13046 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:15.456502 12677 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:15.488581 12935 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:15.489362  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.492884 13047 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:15.493171  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66775.2us
I20260709 12:23:15.493251 13037 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
W20260709 12:23:15.495467 13069 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:23:15.387488 12678 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:15.497819  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.458182 13024 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:15.514637  8139 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:15.507654  8063 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:15.508955  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:15.470110 12432 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:15.469921 12925 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:23:15.566766 13068 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
I20260709 12:23:15.516129  8065 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:15.517059  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.520774  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:15.524278  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.510775 13047 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.512264 12935 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.460780 12649 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.564652 12916 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.525919 13030 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:15.644062  8762 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:15.531960 13031 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:15.533300 12662 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:15.534463  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 993) took 1630 ms. Trace:
I20260709 12:23:15.648448  8756 rpcz_store.cc:276] 0709 12:23:13.904527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.904712 (+   185us) service_pool.cc:224] Handling call
0709 12:23:13.912022 (+  7310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:14.998661 (+1086639us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:14.998696 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:14.998740 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:14.998791 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.534161 (+535370us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540064e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:15.534216 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.534360 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14148,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7889,"spinlock_wait_cycles":2497988864}
I20260709 12:23:15.446254 12640 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.650919 12640 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:15.537626 12647 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.538892  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:15.519685 12646 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:15.542292 12658 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:15.497690 13033 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.554924 12644 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:15.559054 13062 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:23:15.499063 13046 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:15.677618  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:15.560997 12780 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.000s
I20260709 12:23:15.561343  8765 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:15.562460  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.564988  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.688275  8757 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:15.565189 12934 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:15.565729 13073 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:15.594466  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.644021  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3107) took 1045 ms. Trace:
W20260709 12:23:15.643891  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.501830 12775 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:15.662441  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 89795.9us
W20260709 12:23:15.676019  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 288436us
I20260709 12:23:15.643802 13047 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:15.687389  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 294557us
I20260709 12:23:15.648207 13031 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:15.693367  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 292999us
I20260709 12:23:15.694144  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 762) took 1077 ms. Trace:
I20260709 12:23:15.701901  8213 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:23:15.705968  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.677663 13024 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.713382  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:15.692716 12937 consensus_meta.cc:287] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
I20260709 12:23:15.687357 13046 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:15.672654 12658 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.662786 12662 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:15.684238 13058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.016s
I20260709 12:23:15.700949  8070 rpcz_store.cc:276] 0709 12:23:14.598991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.599124 (+   133us) service_pool.cc:224] Handling call
0709 12:23:14.629666 (+ 30542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:14.759628 (+129962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.759669 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:14.859034 (+ 99365us) log.cc:844] Serialized 52 byte log entry
0709 12:23:15.127751 (+268717us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:15.187814 (+ 60063us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.272821 (+ 85007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.272933 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.566195 (+293262us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:15.569183 (+  2988us) raft_consensus.cc:1685] finished
0709 12:23:15.643771 (+ 74588us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.643946 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130192,"prepare.queue_time_us":59725,"prepare.run_wall_time_us":11333,"raft.queue_time_us":160462,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":60550784,"thread_start_us":191503,"threads_started":1,"wal-append.queue_time_us":329633}
I20260709 12:23:15.841408  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.734911  8765 rpcz_store.cc:276] 0709 12:23:14.610539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.666683 (+ 56144us) service_pool.cc:224] Handling call
0709 12:23:15.688052 (+1021369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:15.843614  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.844683  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:15.687230 13030 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:15.700572 13073 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:15.784548  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:15.946393  8069 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
W20260709 12:23:15.928078  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.927690  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:15.948177  8065 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:15.668138 12646 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:15.936969  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 398125us
I20260709 12:23:15.853075  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:15.954434  8758 raft_consensus.cc:2376] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14. Re-sending same reply.
I20260709 12:23:15.851963 13031 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:15.918906 13075 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.405s	user 0.002s	sys 0.000s
W20260709 12:23:15.938040 13058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.001s	sys 0.017s
I20260709 12:23:15.841809 13035 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:15.693737 12780 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.699201 13023 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:15.957728  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 234427us
I20260709 12:23:15.974452  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1939) took 1414 ms. Trace:
W20260709 12:23:15.974733  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 261462us
I20260709 12:23:15.981444  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:15.717978 13080 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.245s
I20260709 12:23:15.899773 13037 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 12:23:15.954602 13073 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:15.915803 12937 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.915473 13024 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:15.981058  8138 rpcz_store.cc:276] 0709 12:23:14.560312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.560708 (+   396us) service_pool.cc:224] Handling call
0709 12:23:14.561249 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.567502 (+  6253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.567530 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.595098 (+ 27568us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.765688 (+170590us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:14.765747 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.765844 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.558483 (+792639us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:15.960305 (+401822us) raft_consensus.cc:1685] finished
0709 12:23:15.960334 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.974366 (+ 14032us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5924,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":10748,"spinlock_wait_cycles":61422464,"thread_start_us":143723,"threads_started":1,"wal-append.queue_time_us":487611}
I20260709 12:23:16.006196 12916 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.037142 12916 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:16.037675 12916 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:16.038899 12916 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.041572 13033 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:15.944415 12658 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.037798 12677 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:23:16.046893 12677 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.048782 13035 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:15.896281 12775 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.011449  8137 raft_consensus.cc:2368] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:15.997797  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:16.019927  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 284872us
W20260709 12:23:16.036290 13032 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.000s
I20260709 12:23:16.033998 13029 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.079216  8757 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:23:16.070034  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:16.082909  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.056s	sys 0.172s
W20260709 12:23:16.083328  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.056s	sys 0.172s
I20260709 12:23:16.040388 12916 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:16.044417 12658 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.093272  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.095067  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.096027  8069 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:16.098453  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.099313  8212 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:23:16.100996  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.036420 13024 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:16.123127  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:16.085354 13027 consensus_meta.cc:287] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.000s
I20260709 12:23:16.130043  8070 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:16.132871  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48920us
I20260709 12:23:16.083557 12655 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:16.136765  8065 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:16.137560  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.137727  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.142735  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:16.143536  8138 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.086941 12668 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:16.146910  8216 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:16.090528 13029 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:16.141366  8217 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:16.145901  8140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2067) took 1549 ms (client timeout 1556 ms). Trace:
I20260709 12:23:16.091593 13032 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.150132  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3109) took 1546 ms. Trace:
W20260709 12:23:16.148828  8140 rpcz_store.cc:269] 0709 12:23:14.592082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.598213 (+  6131us) service_pool.cc:224] Handling call
0709 12:23:16.141221 (+1543008us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002f0b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:16.141318 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914877184}
I20260709 12:23:16.126878 12658 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.097796 13035 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.138722 13027 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:16.166090  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 184726us
W20260709 12:23:16.167155  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 179408us
W20260709 12:23:16.167371  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 172911us
I20260709 12:23:16.150589  8062 rpcz_store.cc:276] 0709 12:23:14.599551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.613893 (+ 14342us) service_pool.cc:224] Handling call
0709 12:23:14.643872 (+ 29979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.951328 (+307456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.951383 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.986468 (+ 35085us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.423834 (+437366us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.423879 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.423947 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.568454 (+144507us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:16.131665 (+563211us) raft_consensus.cc:1685] finished
0709 12:23:16.131701 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.145410 (+ 13709us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80948,"raft.queue_time_us":315517,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11021,"spinlock_wait_cycles":9430272,"thread_start_us":298383,"threads_started":1,"wal-append.queue_time_us":359009}
I20260709 12:23:16.144757 13091 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:16.139760 12655 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:16.172123  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:16.176784  8758 raft_consensus.cc:606] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.177265  8758 raft_consensus.cc:614] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:16.174389  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:16.149709 12647 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:16.170377 13081 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:23:16.225939  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51650.6us
W20260709 12:23:16.227036  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55433.6us
I20260709 12:23:16.228281  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.228732  8211 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 12:23:16.231089  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:16.231745  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:16.233121  8212 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:16.233842  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:16.235543  8760 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:16.164059 13037 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.167320 12935 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.240310  8218 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:23:16.241870  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67563.4us
I20260709 12:23:16.160712 13032 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.179634 12655 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:16.242803  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:16.255764  8756 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:16.248983  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.251575  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.257009  8215 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:16.257305  8069 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:23:16.251080  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:16.253234  8062 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:16.254825  8067 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:16.260244 13101 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:16.260882 13098 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.261466 13098 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.237221 12649 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.262708 12649 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.263898 13098 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.179245 13091 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.255048 12662 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.273147  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.274103 12780 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.274837 12780 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:16.170382 12658 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.289109  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62321.3us
I20260709 12:23:16.293476  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:16.291301  8066 raft_consensus.cc:2410] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:16.254419  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.295210 12647 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:16.295897 12647 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.297008 13086 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
W20260709 12:23:16.297420  8036 connection.cc:256] RPC call timeout handler was delayed by -1.1378658119997453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 12:23:16.298497 12647 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.298619  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:16.300386  8138 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:16.302698  8061 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:23:16.293475 13043 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.844s	user 0.006s	sys 0.006s
I20260709 12:23:16.302239 13029 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.299257 12647 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:16.331696  8216 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:16.331818  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.337795  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:16.341768  8061 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:16.315102 12925 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:16.349754  8759 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:16.300061 12780 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.314280 13023 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:16.349754  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110959us
I20260709 12:23:16.300664 12935 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:23:16.324558 12646 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.312937 12668 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:16.239681 13037 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.369187 12937 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.370111 12937 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:16.370740 13037 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.370693 12937 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.372731 13090 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:23:16.374182 13090 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:16.375535 13090 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:16.375855 13090 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.322065 13046 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.378986 13046 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:16.380074  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 48347.3us
I20260709 12:23:16.381479  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.355023 12925 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.361886 12942 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:16.362130 13083 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:23:16.349298 12649 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:16.367333 13067 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.915s	user 0.006s	sys 0.015s
I20260709 12:23:16.367892 13106 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.368392  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:16.412714  8758 raft_consensus.cc:606] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.368250 12668 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.356189 12738 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.957s	user 0.012s	sys 0.000s
I20260709 12:23:16.376168 13090 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:16.403347  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 328432us
W20260709 12:23:16.363198 13089 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:23:16.429841  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73964.2us
I20260709 12:23:16.405923  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.341061 13035 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:23:16.364888 13043 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.404994 12942 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:16.397454 12662 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.433723  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.437180  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.438081  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:16.403884 12647 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:16.439877  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1941) took 1815 ms. Trace:
I20260709 12:23:16.409114 12775 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:16.454456  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 155672us
I20260709 12:23:16.450347  8145 rpcz_store.cc:276] 0709 12:23:14.624838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.655119 (+ 30281us) service_pool.cc:224] Handling call
0709 12:23:14.687097 (+ 31978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.708224 (+ 21127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.708274 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.974366 (+266092us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.127521 (+153155us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:15.127559 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.127618 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.362727 (+1235109us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:16.429207 (+ 66480us) raft_consensus.cc:1685] finished
0709 12:23:16.429233 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.439804 (+ 10571us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":473,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":70647,"spinlock_wait_cycles":42937088,"thread_start_us":139968,"threads_started":1,"wal-append.queue_time_us":403020}
I20260709 12:23:16.431638 12996 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:23:16.461678 12925 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.431911 12738 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.464267 12738 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.465345  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.465942 13080 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:16.467845 12997 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.493s	user 0.011s	sys 0.000s
I20260709 12:23:16.468946 13112 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:16.469799 12662 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:16.486744 12662 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:16.486924 12640 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.002s
I20260709 12:23:16.487246 12662 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:16.455557 12937 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.487749  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:16.488374  8758 raft_consensus.cc:606] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:16.491889  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:16.492476  8758 raft_consensus.cc:606] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.478228  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.480537  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:16.478124  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:16.493862  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.494655  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.496145 13074 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.496989 13026 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:16.496743 13074 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.497444 13026 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.497928 13026 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.498805  8760 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:16.501063 12937 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:16.496284  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.478350 12647 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.480103 13033 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:16.481488 12665 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:16.482100 13085 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:16.484939  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.439806 13111 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:16.507109  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.507460  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:16.422961 13073 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:16.542052  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68692.6us
I20260709 12:23:16.549804  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:16.545327  8763 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:16.540426  8211 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.546161  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:16.546617  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:16.548039  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.552714  8145 raft_consensus.cc:2410] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:23:16.496475 13023 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:16.424867 13106 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.550881  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:16.561409  8142 raft_consensus.cc:2368] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15.
I20260709 12:23:16.539042 12640 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:16.553113  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44336us
I20260709 12:23:16.512104  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:16.550021  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:16.566107  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:16.567512  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 130414us
I20260709 12:23:16.568292 13095 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:16.562633  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.570420  8063 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
W20260709 12:23:16.562966  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.474051 12942 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.513088 12932 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:16.545065 13085 consensus_queue.cc:1243] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:23:16.564927 13031 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.004s
I20260709 12:23:16.552857 13112 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:16.568353  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.575752  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.560462 13023 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:16.569161 13088 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:23:16.560321 12775 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:16.582460  8211 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:16.565058 12640 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:16.594762  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:16.594798  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.595099  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.596287  8067 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
W20260709 12:23:16.598109  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 86091.9us
I20260709 12:23:16.599421  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.569294 13110 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:16.596271  8214 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:16.558614 12937 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:23:16.568977 12997 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:23:16.576408 13032 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.641415  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.642277  8211 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:23:16.602644 12780 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.603484 12806 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:16.603698  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.603830  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1945) took 1209 ms. Trace:
I20260709 12:23:16.601950 12640 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.614415  8142 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:16.615082  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:16.577250 13095 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:16.640475  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.678740  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.591769 13023 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.646907  8761 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:16.595371 12775 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.581611 13035 raft_consensus.cc:2764] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:23:16.656862  8141 rpcz_store.cc:276] 0709 12:23:15.394189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.466451 (+ 72262us) service_pool.cc:224] Handling call
0709 12:23:15.503722 (+ 37271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.519968 (+ 16246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.519998 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.550276 (+ 30278us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.708549 (+158273us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:15.708615 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.708713 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.603603 (+894890us) raft_consensus.cc:1685] finished
0709 12:23:16.603622 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.603754 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4649,"raft.queue_time_us":5113,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":157851,"threads_started":1,"wal-append.queue_time_us":405880}
I20260709 12:23:16.683292  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.646355 12665 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:16.665272  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.592224 12932 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.679208  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64236.2us
I20260709 12:23:16.592348 13111 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:23:16.684063  8211 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:16.686038  8214 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:16.670703  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.684286 12806 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:16.684123 12775 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:16.750202  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.589933 13031 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.685129 12432 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:16.759665  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.772979  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.774096  8141 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:16.689504 12925 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.776351  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.773613  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:16.755134 12801 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.778770  8142 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:16.794947 13030 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:16.795475 13030 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:16.795892 13030 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:16.801031 13033 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:23:16.801506  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 218914us
I20260709 12:23:16.650767 13110 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.759230 13050 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.810783  8142 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:16.793018 12432 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.773052 13035 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:16.746824 12662 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.804992 12926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.011s	sys 0.006s
I20260709 12:23:16.817888 12806 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.762157 13112 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.819952 12932 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:16.811820 13103 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.352s	user 0.012s	sys 0.000s
I20260709 12:23:16.837184  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:16.838054  8146 raft_consensus.cc:2368] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15.
I20260709 12:23:16.806905 12801 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.839066  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.839665 13023 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.825773 13051 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:16.841029 13051 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:16.841135 12801 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.842106  8138 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:16.842052 13051 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.843370 13051 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.843972  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.845288 13023 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.845674  8142 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:16.846814  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.847885  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.849013  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.850467  8141 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:16.851785  8141 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:16.853330  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:16.853767 13047 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.934s	user 0.011s	sys 0.000s
I20260709 12:23:16.854185  8139 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:16.816560 12432 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:16.810899 13122 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.832335  8145 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:23:16.832928  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.825291 13031 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.833854  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 919) took 1857 ms. Trace:
I20260709 12:23:16.815157 13095 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.809979 13073 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.840291  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:16.824574 13116 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:23:16.876938  8213 rpcz_store.cc:276] 0709 12:23:14.976851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.976989 (+   138us) service_pool.cc:224] Handling call
0709 12:23:14.977313 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.735744 (+758431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.833599 (+1097855us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:16.833797 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665817984}
I20260709 12:23:16.877054  8146 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:16.871296  8214 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:16.869762  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.803212 12925 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.881937  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:16.882866  8140 raft_consensus.cc:2410] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:23:16.818217 12926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.012s	sys 0.006s
W20260709 12:23:16.887127  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2966056049999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 12:23:16.854216 13047 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:16.889662  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2174056050002946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:23:16.891382  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1895056050002495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:23:16.891855  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1850056050002422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:23:16.892174  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1742056050002248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 12:23:16.892588  8110 connection.cc:256] RPC call timeout handler was delayed by -1.1220056050001403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:23:16.892249  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:16.894286  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:16.895906 13102 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.341s	user 0.003s	sys 0.000s
I20260709 12:23:16.896065 12662 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.897234 13133 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:16.897974  8144 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:16.898914 13128 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:23:16.897364  8143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2058) took 3112 ms (client timeout 1529 ms). Trace:
W20260709 12:23:16.902165  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:16.901782  8143 rpcz_store.cc:269] 0709 12:23:13.784602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.815655 (+ 31053us) service_pool.cc:224] Handling call
0709 12:23:16.897089 (+3081434us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400256054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:16.897257 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496453888}
W20260709 12:23:16.891458 12655 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 12:23:16.904814  8731 leader_election.cc:400] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15.
I20260709 12:23:16.885378 13023 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:16.891063 12932 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.915755  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.889686 13073 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:16.916788  8211 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:16.813264 13050 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.912958 12780 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:16.917443 13023 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.919955 12780 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.877799 13122 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.921918 13023 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.922613  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.922878 13122 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.923379  8069 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:16.924079  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:16.925197  8066 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:23:16.924327  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.929908  8069 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:16.922008 12780 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.913261 13128 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:16.912592 12806 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.889153 12934 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:23:16.904608 13114 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:23:16.934247  8066 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:16.936738  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.908854 13047 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.901583 13098 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:23:16.938016  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.889297 13032 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:23:16.937598  8214 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:16.940276  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1000) took 1235 ms. Trace:
I20260709 12:23:16.944132  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.945629  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.945847  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:16.942845  8764 rpcz_store.cc:276] 0709 12:23:15.704502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.704775 (+   273us) service_pool.cc:224] Handling call
0709 12:23:15.916994 (+212219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:16.312279 (+395285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.312321 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:16.340753 (+ 28432us) log.cc:844] Serialized 26 byte log entry
0709 12:23:16.475678 (+134925us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:16.475900 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.476005 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.940051 (+464046us) raft_consensus.cc:1685] finished
0709 12:23:16.940074 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.940213 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109664,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":149,"thread_start_us":490151,"threads_started":2,"wal-append.queue_time_us":222599}
I20260709 12:23:16.948031 12925 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:16.918828 12655 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.950820 12655 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:16.912304 12775 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:16.951189 13109 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:23:16.952039 13097 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:16.938146 12806 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.954620 12806 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.915375 12649 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:23:16.956925  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:16.936939 13040 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.936033 13023 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:16.959474 13050 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:16.931443 12932 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:16.960139 13136 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:16.961498  8214 raft_consensus.cc:2410] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:16.961548  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.964612  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.965893  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.974748  8219 raft_consensus.cc:2368] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
W20260709 12:23:16.974884 13137 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:23:16.975178  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:16.975987  8219 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:16.966013  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:16.977672  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:16.977813 13030 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:16.978446 13070 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.501s	user 0.000s	sys 0.009s
I20260709 12:23:16.978811  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:16.975979  8216 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:16.966012  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:16.982604  8067 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:16.982630  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3106) took 2381 ms. Trace:
I20260709 12:23:16.981703  8069 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:16.981261  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.001623  8214 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:17.001621  8219 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:16.967944 13023 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:16.980921 12618 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:16.986555  8068 rpcz_store.cc:276] 0709 12:23:14.598691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.598801 (+   110us) service_pool.cc:224] Handling call
0709 12:23:14.599123 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.988971 (+389848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.989001 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.989570 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.131816 (+142246us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:15.131860 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.131944 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.977584 (+1845640us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:16.979450 (+  1866us) raft_consensus.cc:1685] finished
0709 12:23:16.979473 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.979712 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374594,"raft.queue_time_us":376462,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":90,"spinlock_wait_cycles":74403712,"thread_start_us":141842,"threads_started":1,"wal-append.queue_time_us":410748}
I20260709 12:23:16.967180 13040 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.010268 12618 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:17.012028 13059 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.821s	user 0.003s	sys 0.006s
I20260709 12:23:17.011520 12618 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.012866 12618 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.020762 12775 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.026093  8220 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:17.002614 13026 consensus_meta.cc:287] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
I20260709 12:23:17.028131  8218 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:17.032522  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.000231 13035 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:17.009305 13090 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.005s
I20260709 12:23:17.034970 13026 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:17.038638 13142 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:17.039747 13026 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.023757 13023 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.037509 13040 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.045995  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.128054  8219 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:23:17.132174  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 194737us
I20260709 12:23:17.140594 13026 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.141466 13026 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.046921 13090 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.155500 12649 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.180258 12432 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.222173  8064 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:17.228057  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:17.183346 12649 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.286573 13030 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.290567 12932 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:17.296512 12640 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.005s
I20260709 12:23:17.297092 12640 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.299703 12640 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.303396  8063 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:17.393187  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.397908 13133 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:17.222886 13090 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.412847 13146 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:17.400143 12932 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:17.416414 13146 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:17.433323 12932 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.440027 13090 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:17.448140 13090 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:17.442548 13149 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:23:17.458297 13090 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.489611 12649 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.497503 12432 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:17.508900  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.469854 13146 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.523399  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:17.506574 13144 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:23:17.541421  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.551568  8220 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:17.536119 13146 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:17.564463  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:17.565348  8220 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:17.561707 13148 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:23:17.624511  8220 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:17.604420 12932 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.609759 13026 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.639091 12932 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.635006 13033 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:17.644688 12932 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.645332 13033 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.646930 12932 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.647364 13033 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.634298 13030 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:17.649363 13097 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:17.649675 13030 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.650624 13149 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:17.650993 13149 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:17.651839 13106 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.651916 13149 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.662561 12145 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.663488 12145 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.651857 13030 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.672536 12145 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:17.653132 13149 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:17.658219 12644 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.718245  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.718978  8142 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:17.723783  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:17.724654  8144 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:17.678066  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.680205  8214 raft_consensus.cc:1217] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[11.5-16.8]   Dedup: 12.6->[14.7-16.8]
I20260709 12:23:17.726531  8214 pending_rounds.cc:85] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:23:17.726948  8214 pending_rounds.cc:107] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:23:17.727293  8214 raft_consensus.cc:2889] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:17.727432  8142 raft_consensus.cc:2410] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:17.657944 12649 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:17.685298  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.731695  8145 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:17.690515 13117 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:17.691076 13150 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:23:17.691619  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:17.695680  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:17.695984  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:17.697216 13152 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:23:17.662525 13023 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.704118  8070 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:17.750463  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:17.750681 12942 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:17.751101  8070 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:17.751574 13023 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:17.752143  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:17.754325  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:17.755111  8070 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:17.756327  8070 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:17.757611  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 788) took 1666 ms. Trace:
I20260709 12:23:17.758054  8064 rpcz_store.cc:276] 0709 12:23:16.091490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.091649 (+   159us) service_pool.cc:224] Handling call
0709 12:23:16.132036 (+ 40387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.222790 (+1090754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.757386 (+534596us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:17.757537 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506599680}
I20260709 12:23:17.763052  8145 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:17.729511  8138 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:17.730170  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.733108  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:17.765159  8139 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:23:17.652581 13090 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.736734  8216 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:17.737059  8067 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:17.742729  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47147.6us
I20260709 12:23:17.747555  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:17.748982 13030 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:17.752905  8146 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:17.749260  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:17.707724  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1942) took 2314 ms (client timeout 1640 ms). Trace:
W20260709 12:23:17.877766  8137 rpcz_store.cc:269] 0709 12:23:15.393327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.393465 (+   138us) service_pool.cc:224] Handling call
0709 12:23:17.707485 (+2314020us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540008f7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:17.707641 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415017728}
I20260709 12:23:17.767761 12145 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:17.731793 12644 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.879174 12644 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.881485 12644 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:17.767064  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:17.887698  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 120745us
I20260709 12:23:17.886978 12145 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:17.753016 13061 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 2.505s	user 0.010s	sys 0.020s
I20260709 12:23:17.889456 12145 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.897097  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:17.899166  8137 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:17.913741  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:17.943245  8216 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:17.944733  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.946041  8137 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:17.904124 12432 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:17.895222 13133 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:17.966629  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:17.736532 12649 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:17.969292  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 764) took 3315 ms (client timeout 2092 ms). Trace:
I20260709 12:23:17.969931 12649 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:17.970611 12649 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.971096 12649 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:17.952790 12145 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:17.958197 13090 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:17.961529  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64537.8us
W20260709 12:23:17.969928  8759 rpcz_store.cc:269] 0709 12:23:14.654367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.692939 (+ 38572us) service_pool.cc:224] Handling call
0709 12:23:17.968978 (+3276039us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54006086d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:17.969153 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570283904}
I20260709 12:23:17.975167  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:17.929651 12644 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:23:17.966919 13133 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:17.894899 13104 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:17.967396  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.831658 13117 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:17.950625 13023 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:17.965127  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.993191  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.994037  8139 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:17.977468  8729 connection.cc:256] RPC call timeout handler was delayed by -2.4079644570001619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:23:18.003233  8729 connection.cc:256] RPC call timeout handler was delayed by -2.0232645109995246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:23:18.003786  8729 connection.cc:256] RPC call timeout handler was delayed by -2.0161384809998708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
I20260709 12:23:18.013206  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:17.966661 12658 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:18.018479  8729 connection.cc:256] RPC call timeout handler was delayed by -1.6863424319999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
I20260709 12:23:18.022575  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:17.986563 13104 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.034672 13104 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.983147  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.984733  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.041016  8145 raft_consensus.cc:2376] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15. Re-sending same reply.
I20260709 12:23:17.985528  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:17.988063  8138 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:17.980818 13080 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.974226 12432 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.025226  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.025889  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.045248  8140 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:17.980804  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:18.032516  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57443.8us
I20260709 12:23:18.033394 13133 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.046176  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:18.019996  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:18.048058  8216 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.048619  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:18.020327 13090 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.053174  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 164341us
I20260709 12:23:18.054672  8110 leader_election.cc:400] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:18.053278 13080 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:18.057399  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.059095  8140 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:18.049906 13101 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:18.062350 12432 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.051803 12658 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:18.055505 13133 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.066658  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.068012  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:18.069468  8140 raft_consensus.cc:2410] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:23:18.058260 12649 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:18.073899  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:18.074748  8220 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:18.075667  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:18.053642 13149 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 12:23:18.079327  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 105565us
I20260709 12:23:18.055871 13090 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.082314  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:18.083097 12432 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:18.094513  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:18.096170 13072 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 2.625s	user 0.017s	sys 0.038s
I20260709 12:23:18.077016  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:18.348798  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.194914  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3124) took 1607 ms. Trace:
I20260709 12:23:18.100611 13074 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:18.076781 13151 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:23:18.080773 13099 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:23:18.348340  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3119) took 1786 ms. Trace:
I20260709 12:23:18.356065  8063 rpcz_store.cc:276] 0709 12:23:16.587566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.587829 (+   263us) service_pool.cc:224] Handling call
0709 12:23:16.588320 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.303927 (+715607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.194625 (+890698us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400322dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:18.194837 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643946752}
I20260709 12:23:18.350037  8216 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:18.350831  8220 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:18.141528 13105 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.341005  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 278917us
W20260709 12:23:18.352794  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.345887  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 292065us
I20260709 12:23:18.353979  8140 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:18.155141 13163 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.146505  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.074542 12677 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.347935  8212 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:18.417658 13117 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:18.357540  8061 rpcz_store.cc:276] 0709 12:23:16.561741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.561879 (+   138us) service_pool.cc:224] Handling call
0709 12:23:16.572229 (+ 10350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.814710 (+242481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.814741 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:16.814777 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:16.814805 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.202939 (+1388134us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400346054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:18.348101 (+145162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.348256 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557240192}
I20260709 12:23:18.400820  8215 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:23:18.402063 13114 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:18.419309  8215 pending_rounds.cc:85] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:23:18.419461 13114 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:18.420334 13074 raft_consensus.cc:2764] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:18.420900 13163 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.411661 12926 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:18.422631 12926 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:18.423884 13163 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:18.396745 13030 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.012s
I20260709 12:23:18.426695 13105 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.425806 13090 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.405138 13104 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.419899  8215 pending_rounds.cc:107] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:23:18.444815  8215 raft_consensus.cc:2889] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:18.443364 13030 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:18.446285 13104 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:18.380877  8216 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:18.419349 12145 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:18.450439 12145 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:18.359977  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 265973us
I20260709 12:23:18.360119 12432 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:23:18.451959  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:18.350654 12942 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.440958  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:18.423660 12926 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.351679 12934 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:18.463898 12432 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.359660 13023 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.468333 12145 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.472654 12145 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:18.466223 13090 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:18.462566 13180 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:18.455679 12934 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:18.485520  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.492231  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.493309  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:18.483981 13109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.500s	user 0.031s	sys 0.058s
I20260709 12:23:18.498262  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 1995) took 1559 ms. Trace:
I20260709 12:23:18.497974  8137 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:18.462159 12942 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.467674 13146 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 12:23:18.507362  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.484341 13090 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.482434 12665 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:18.512746  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:18.514895  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.520434  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.520752  8761 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:18.522961  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:18.523798  8216 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:18.515674  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.524968  8758 raft_consensus.cc:2376] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15. Re-sending same reply.
I20260709 12:23:18.526103  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.520459  8760 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:18.533447  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 1972) took 2349 ms. Trace:
I20260709 12:23:18.533952  8217 rpcz_store.cc:276] 0709 12:23:16.156637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.165797 (+  9160us) service_pool.cc:224] Handling call
0709 12:23:16.177292 (+ 11495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.306478 (+129186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.306525 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:16.306600 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:16.306651 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.505815 (+2199164us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002b4654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:18.505904 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.506103 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296468864}
I20260709 12:23:18.498920  8066 rpcz_store.cc:276] 0709 12:23:16.938872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.939040 (+   168us) service_pool.cc:224] Handling call
0709 12:23:16.946588 (+  7548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.946746 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:16.966962 (+ 20216us) log.cc:844] Serialized 14 byte log entry
0709 12:23:17.963697 (+996735us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b180022d9e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:18.190131 (+226434us) log.cc:844] Serialized 14 byte log entry
0709 12:23:18.497683 (+307552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:18.497760 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:18.497827 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.497997 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.498164 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20863,"prepare.queue_time_us":364722,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":102,"raft.queue_time_us":87652,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":9451,"spinlock_wait_cycles":11566336,"thread_start_us":352179,"threads_started":3,"wal-append.queue_time_us":1444049}
W20260709 12:23:18.498762 13109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.031s	sys 0.059s
I20260709 12:23:18.448683 13114 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:18.499686  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47857.2us
I20260709 12:23:18.537953  8761 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:18.540793  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.546507  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.548731  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:18.558571  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:18.565816  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:18.566171 12927 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.566699 12927 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.566977 12942 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.569150  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.570032  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.571446  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.509594 12677 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:18.569067  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:18.535516 13090 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:18.587641  8212 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.577003  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:18.614723  8757 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.574182 13080 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.589570  8762 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:18.590291 13105 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.499593 13180 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.591447 12934 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.594561 12927 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.545400 12665 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.623799 12665 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:18.597353  8764 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:18.597837 12677 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.599663  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.601006  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.601862  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:18.630180  8215 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:18.629626  8757 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:18.604940  8145 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:18.605558 12981 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.639094 13127 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.886s	user 0.017s	sys 0.009s
I20260709 12:23:18.639788 12677 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.607779  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.613116 12432 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.621692 12927 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:18.623699 12934 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.632674  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.637635  8212 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:18.638727  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.651522  8144 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:18.639492 12981 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.606931  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.644701  8140 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:18.654739  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.655462  8142 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:18.651346  8146 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:18.666028  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.670302  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.672842  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.670387  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.674463  8140 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:18.675410  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.677407  8141 raft_consensus.cc:2368] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:18.677960  8186 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:18.678192  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.678615  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:18.679476  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 602500us
I20260709 12:23:18.684018  8146 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:18.685243 12145 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:18.686120 12145 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:18.687971  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:18.689023  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.689251  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.690012  8145 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:18.651077 12927 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:18.619607 13080 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.699062  8145 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:18.699863  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:18.716033  8186 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:18.701284 12927 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:18.746377  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.747292  8070 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:18.688310 13074 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:18.769838  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.771728  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.775211  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.775955  8066 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:18.776654 12981 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.734666 12644 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:18.777312 12644 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.777745 12644 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.780031  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.781038  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.781991  8141 raft_consensus.cc:2410] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:18.782882  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.783629  8141 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:18.757539 13180 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:18.785351  8140 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:18.785848 13133 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:18.786296 13080 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:18.787221  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.788111  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.788406  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.789196 13182 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:18.789532  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.788210  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.790397  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.790501  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.786548  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:18.791246  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.784479  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:18.790977  8145 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:18.775367 12764 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:18.792251  8141 raft_consensus.cc:2376] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14. Re-sending same reply.
I20260709 12:23:18.791324  8069 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:18.802887 12145 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:18.803671 12145 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.807444  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:18.809387  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:18.789693 13182 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:18.812295  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:18.813575  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.812994  8066 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:18.829145  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.786311 13133 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.781031 13181 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.829504  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 265001us
I20260709 12:23:18.832429  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:18.811508  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3129) took 1861 ms (client timeout 1859 ms). Trace:
I20260709 12:23:18.835563  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:18.843148  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.843483  8068 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.831569  8212 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.794116 12764 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.773844 13179 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:18.795674 12677 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:18.844614  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:18.846060  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:18.851687  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 293966us
W20260709 12:23:18.840725  8218 rpcz_store.cc:269] 0709 12:23:16.934556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.934697 (+   141us) service_pool.cc:224] Handling call
0709 12:23:18.795807 (+1861110us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54002b4b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:18.795956 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162828544}
I20260709 12:23:18.810593 12942 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:18.870393  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.829963 13096 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:18.867086 12145 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:18.872212 12145 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:18.872788 12145 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.873724  8212 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:18.874845 12145 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:18.874991 12981 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:18.875392 12145 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:18.875793 12981 consensus_queue.cc:1243] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:23:18.875963 12145 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:18.876389 12145 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.877951  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.878732  8067 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:18.856510  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.880038  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.880661 12432 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:18.881120 12432 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:18.881999 12432 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:18.885898  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:18.887045 12145 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:18.889273  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.888793  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.890048  8069 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:18.890887  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.890808  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:18.892019  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.892280  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.893190  8069 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:23:18.893261  8064 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:18.896493  8069 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:18.897763  8069 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:18.898648  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:18.899852  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:18.900540  8069 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.903354  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:18.899132  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:18.903855 12145 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:18.904748 12145 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:18.905200 12145 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.905622 12145 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:18.842789 13133 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:18.845367 13182 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:18.853332 13105 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.847903 13023 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:18.853222 13184 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:18.830139 13117 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.078s
W20260709 12:23:18.944279  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52422.2us
I20260709 12:23:18.847698 12677 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:18.943657  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 80580.9us
I20260709 12:23:18.909194 13178 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.846061 12764 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:18.845763 12665 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:23:19.023550  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:19.012477 12145 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:19.035183  8069 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:18.846077 13181 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.084880 12145 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:18.938318 13186 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:18.935633 13096 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:19.102341  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 330710us
W20260709 12:23:19.102931  8034 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.709s (SENT)
I20260709 12:23:19.110369  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:19.112130  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:19.073009 12677 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:19.114507  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:19.115590  8069 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:19.115458  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 226589us
I20260709 12:23:19.118110  8110 leader_election.cc:400] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:19.119527  8110 leader_election.cc:403] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:19.118920  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 219841us
I20260709 12:23:19.120710  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:19.083612 13192 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:19.110760 13186 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:19.070921 13105 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:19.133430 13179 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:19.137686  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:19.071472 13074 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:19.168206  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:19.137981  8067 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:23:19.171775  8067 pending_rounds.cc:85] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 10
I20260709 12:23:19.172117  8067 pending_rounds.cc:107] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:23:19.172410  8067 raft_consensus.cc:2889] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:19.139185 12145 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:19.164680  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.173501  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.166139  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 323534us
I20260709 12:23:19.023214 13184 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.177198  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:19.178315  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:19.202548  8069 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:19.079989 13178 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.156015 13192 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:19.155694 13186 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:19.226985  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 106384us
I20260709 12:23:19.167348 13179 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:19.137215  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:19.407825  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:19.163756 13187 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:23:19.198246 13074 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.265457 13110 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:19.283198 13185 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:23:19.283901 13183 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:23:19.231712 13117 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:23:19.263551 13096 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.280782 13205 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
W20260709 12:23:19.312888 13191 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:23:19.313478 13193 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:23:19.314131 13200 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:19.294251 13188 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:19.356971 12996 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:19.460744 12996 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:19.357856 13029 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:19.352286  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3147) took 1682 ms. Trace:
I20260709 12:23:19.360510 13146 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:19.360533 13136 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:19.314776 13213 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.364419  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:19.366223 13207 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:23:19.380010  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.399407  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 375931us
I20260709 12:23:19.207794 13091 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:19.517357  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:19.417450  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 345386us
W20260709 12:23:19.425770  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 248642us
I20260709 12:23:19.425969 12981 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.426215  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:19.429579  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 296646us
I20260709 12:23:19.431738  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:19.410701  8757 pending_rounds.cc:85] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 12
I20260709 12:23:19.434537  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:19.970484  8757 pending_rounds.cc:107] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:23:19.970808  8757 raft_consensus.cc:2889] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:19.437306  8068 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.593s	user 0.015s	sys 0.006s
W20260709 12:23:19.971026  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 536646us
I20260709 12:23:19.971318  8068 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:19.442792  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:19.971858  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3132) took 1137 ms. Trace:
I20260709 12:23:19.427078 12926 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:19.444054  8764 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:19.442932  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:19.406201 13179 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:19.975219  8109 connection.cc:256] RPC call timeout handler was delayed by -1.0010608449997562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:23:19.450922  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:19.436095 13105 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:19.438277 13043 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:19.480682  8069 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:19.467888  8219 rpcz_store.cc:276] 0709 12:23:17.670037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.670201 (+   164us) service_pool.cc:224] Handling call
0709 12:23:18.796084 (+1125883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.884687 (+ 88603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.884718 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.885146 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:23:19.086385 (+201239us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:19.086455 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.351227 (+264772us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54002b4b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:19.351277 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:19.351324 (+    47us) raft_consensus.cc:1685] finished
0709 12:23:19.351338 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.352113 (+   775us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002b4b50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:19.352224 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19906,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":2787037312,"thread_start_us":200737,"threads_started":1,"wal-append.queue_time_us":312403}
I20260709 12:23:19.482583 12996 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:19.484542  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:19.486903 13104 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:19.311143 13192 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.502519 13074 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:19.489137 13101 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:19.513451  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:19.521284  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 383669us
W20260709 12:23:19.513774  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.580520 13149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.023s	sys 0.051s
I20260709 12:23:19.559304  8145 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:19.558089 12981 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.660392 13222 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:19.559689 12942 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:19.547724  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:19.506932 13029 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:19.622146  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:19.558362  8218 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:19.796939  8184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.062s (SENT) [suppressed 36 similar messages]
W20260709 12:23:19.592495 13206 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:23:19.551578  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:19.831056 12432 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:19.660539 13219 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.643244 13221 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.201s
I20260709 12:23:19.737638 13214 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:19.961642 13196 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 12:23:19.823426 13090 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.202s	user 0.014s	sys 0.002s
I20260709 12:23:19.639256 13025 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:23:19.516386 13213 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:19.621573 13184 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:19.971058  8186 leader_election.cc:400] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:19.442879  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.084566  8186 leader_election.cc:403] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:20.084916  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:19.972285  8068 rpcz_store.cc:276] 0709 12:23:18.834972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.835220 (+   248us) service_pool.cc:224] Handling call
0709 12:23:19.971799 (+1136579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:19.973666  8070 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:19.869223 13117 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:19.931334 13189 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.979324  8064 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:19.983270  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:19.983819  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:19.983331  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:20.036396  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.980052 12934 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.326s	user 0.010s	sys 0.013s
I20260709 12:23:20.050706  8212 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:20.051582  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.054924  8139 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:20.076189 12432 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:19.978188 13218 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:20.051043 13149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.479s	user 0.048s	sys 0.098s
I20260709 12:23:19.985230  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:20.092201  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 121263us
I20260709 12:23:20.093398  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.094832  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:20.097790  8069 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:20.098474  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 800) took 1207 ms. Trace:
I20260709 12:23:20.047142 13101 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:20.105201  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.098778  8069 rpcz_store.cc:276] 0709 12:23:18.891287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.097324 (+1206037us) service_pool.cc:224] Handling call
0709 12:23:20.097626 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.098229 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.098420 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.111447  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.112416  8761 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.114774  8069 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:20.115667  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3139) took 1168 ms. Trace:
I20260709 12:23:20.116112  8069 rpcz_store.cc:276] 0709 12:23:18.947402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.113939 (+1166537us) service_pool.cc:224] Handling call
0709 12:23:20.114345 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.115333 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.115594 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.117476  8139 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
W20260709 12:23:20.078387 12644 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.298s	user 0.020s	sys 0.001s
I20260709 12:23:19.977617 13187 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:20.108130 12432 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.126102 12432 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:20.122785  8068 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:20.124269  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.131371  8761 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.131402  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3140) took 1142 ms. Trace:
I20260709 12:23:20.131990  8068 rpcz_store.cc:276] 0709 12:23:18.988702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.122121 (+1133419us) service_pool.cc:224] Handling call
0709 12:23:20.122533 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.131144 (+  8611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.131348 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.134490  8069 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:19.983958 13104 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:20.103566 13184 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:20.103225 13074 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:20.197301  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.200768  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.197716  8070 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:20.203480  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2024) took 1025 ms. Trace:
I20260709 12:23:20.204643  8070 rpcz_store.cc:276] 0709 12:23:19.178233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.425877 (+247644us) service_pool.cc:224] Handling call
0709 12:23:20.203388 (+777511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.085711 13090 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.223083  8145 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:20.072443 13222 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.228473  8070 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:20.207513  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.103564 13117 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:20.223476 13196 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:23:20.238633  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.242758  8761 raft_consensus.cc:2376] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13. Re-sending same reply.
I20260709 12:23:20.080890 13219 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.245339  8758 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:20.226104  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 429175us
I20260709 12:23:20.132957 12644 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.208694 13187 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:20.249346  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.085942 13214 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.257153  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.237617 13228 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.103456 13189 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.271756  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 741) took 1760 ms. Trace:
I20260709 12:23:20.274017  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 790) took 1385 ms. Trace:
I20260709 12:23:20.272291  8759 rpcz_store.cc:276] 0709 12:23:18.511781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.511976 (+   195us) service_pool.cc:224] Handling call
0709 12:23:18.512447 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.512942 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.512988 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.623729 (+110741us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b2c00012668. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:18.624189 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:23:18.935659 (+311470us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:19.021284 (+ 85625us) log.cc:844] Serialized 14 byte log entry
0709 12:23:19.284768 (+263484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.287059 (+  2291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:20.265771 (+978712us) raft_consensus.cc:1685] finished
0709 12:23:20.270486 (+  4715us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.271682 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12209,"prepare.queue_time_us":86160,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":401870,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":9576,"spinlock_wait_cycles":12274048,"thread_start_us":565630,"threads_started":2,"wal-append.queue_time_us":976143}
I20260709 12:23:20.274464  8067 rpcz_store.cc:276] 0709 12:23:18.888608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.889153 (+   545us) service_pool.cc:224] Handling call
0709 12:23:18.889472 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:19.199582 (+310110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.273760 (+1074178us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540011dad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:20.273951 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565613952}
W20260709 12:23:20.278836  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 302977us
I20260709 12:23:20.143733 13029 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.241523 13221 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:23:20.265296 13226 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:20.285421  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.292155  8212 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:20.287822  8184 leader_election.cc:336] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.092s (SENT)
W20260709 12:23:20.288821  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 88128.4us
W20260709 12:23:20.281196  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 206264us
I20260709 12:23:20.295734  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:20.296351  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.297590 12432 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:20.299090 12432 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:20.299605 12432 consensus_queue.cc:1243] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:20.303058  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.304039  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.304685  8219 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:20.229817 13101 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.318565  8215 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:20.319049  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.317246  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.319965  8218 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.321151  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.324995 13226 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:20.330212 13238 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:23:20.330497 13184 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:20.330983 13222 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:20.331622 12981 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.332185  8213 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:20.253785 13104 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.335134  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.335812  8213 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:20.337428  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.338027  8214 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.342631  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.345253 12432 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:20.345913  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.347546  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.348928  8218 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:20.350713  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:20.351027  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:20.353780  8216 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:20.354799  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.355412  8215 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:20.355580  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:20.356894  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.357524  8220 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 8.
I20260709 12:23:20.360843  8217 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.361141  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.361795  8759 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:20.363720  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 75994.3us
I20260709 12:23:20.303143 13110 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:23:20.338749 13101 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:20.396425  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.397182  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.371703 13199 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:23:20.412418  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:20.427371  8213 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:20.430287  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:20.493054  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80706.8us
W20260709 12:23:20.474984  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.364701 13237 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:23:20.360162 13104 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:20.507675  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.522282  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:20.441612 12927 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.673s	user 0.016s	sys 0.009s
I20260709 12:23:20.526455  8759 raft_consensus.cc:2376] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11. Re-sending same reply.
I20260709 12:23:20.529970  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.527601  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.529079  8214 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:20.522734 13184 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:20.490566 13213 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.504189 13245 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:20.532992 12916 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.364490 13241 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.184s
W20260709 12:23:20.536932 12677 consensus_meta.cc:287] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.393s	user 0.016s	sys 0.008s
W20260709 12:23:20.539047 13133 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.585s	user 0.017s	sys 0.013s
I20260709 12:23:20.534858 12927 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.335785 13187 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.538267 13090 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:20.539626 13074 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.584167 13074 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.567554  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.586688 13074 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.559033 13245 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.582901  8140 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:20.557279 12916 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.569089 13216 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:20.579686 12926 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 12:23:20.590389 13205 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:20.592070 13243 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:23:20.592165 13181 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:20.565145 13184 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:20.592576 13214 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:20.565716 13133 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.602099  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.627581  8214 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:20.617935 13245 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.620193 12916 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.620899 13205 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:20.621145 13179 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 12:23:20.573319 12644 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.622690  8763 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:20.595427 13186 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.159s	user 0.013s	sys 0.001s
I20260709 12:23:20.566498 13255 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:20.582479 12927 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:20.646149  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1954) took 2144 ms. Trace:
I20260709 12:23:20.647378  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1006) took 1237 ms. Trace:
I20260709 12:23:20.646596  8137 rpcz_store.cc:276] 0709 12:23:18.503139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.503650 (+   511us) service_pool.cc:224] Handling call
0709 12:23:18.504123 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.504411 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:18.561394 (+ 56983us) log.cc:844] Serialized 14 byte log entry
0709 12:23:20.553463 (+1992069us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180029d700. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:20.642944 (+ 89481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:20.643019 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:20.643083 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.643182 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.643358 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23089,"prepare.queue_time_us":70075,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4303,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":24852864,"thread_start_us":85683,"threads_started":1}
I20260709 12:23:20.647765  8757 rpcz_store.cc:276] 0709 12:23:19.409756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.410062 (+   306us) service_pool.cc:224] Handling call
0709 12:23:19.410473 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:19.971339 (+560866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:19.971379 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:19.971782 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:23:20.248469 (+276687us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:20.248509 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.248581 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:20.647168 (+398587us) raft_consensus.cc:1685] finished
0709 12:23:20.647190 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.647319 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":168448,"threads_started":1,"wal-append.queue_time_us":307557}
I20260709 12:23:20.648757  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:20.649282  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.649852  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:20.651226  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 300306us
I20260709 12:23:20.565879 12677 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.654228  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.655037  8137 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
I20260709 12:23:20.645882  8217 raft_consensus.cc:2368] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:20.661255  8759 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:20.627290 13216 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:20.665359  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2128) took 1065 ms. Trace:
I20260709 12:23:20.665813 13216 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.644683 13179 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.646176 13205 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.668741 13189 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:20.669271  8756 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:20.676971 13205 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:20.643934 13218 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:20.682298  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.665809  8143 rpcz_store.cc:276] 0709 12:23:19.599942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.086646 (+486704us) service_pool.cc:224] Handling call
0709 12:23:20.087294 (+   648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:20.247249 (+159955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:20.247283 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:20.248985 (+  1702us) log.cc:844] Serialized 26 byte log entry
0709 12:23:20.288282 (+ 39297us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:20.288327 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.288410 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:20.665141 (+376731us) raft_consensus.cc:1685] finished
0709 12:23:20.665161 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.665296 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6203,"raft.queue_time_us":131866,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":157363,"threads_started":2,"wal-append.queue_time_us":373224}
I20260709 12:23:20.684710  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.679159  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:20.671458 13182 consensus_meta.cc:287] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.683s	user 0.010s	sys 0.012s
I20260709 12:23:20.693207  8066 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.694587  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:20.691215 13188 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 1.214s	user 0.018s	sys 0.000s
W20260709 12:23:20.693609 12764 consensus_meta.cc:287] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.623s	user 0.013s	sys 0.014s
I20260709 12:23:20.707369  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:20.708019  8214 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:20.709700  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.709195  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:20.685714 13178 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:20.731227  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.732085  8757 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 11: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.651844 13186 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.709720 13188 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.726797 13179 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.702919 13023 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.739132 13225 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:20.755283  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.748716  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.702633 13241 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.778190  8760 raft_consensus.cc:2368] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:20.781914  8065 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:23:20.783317  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.785000  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.786073  8214 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:20.777390  8757 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:20.792754  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 782) took 1296 ms. Trace:
I20260709 12:23:20.793380  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.794031  8757 rpcz_store.cc:276] 0709 12:23:19.496413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.753101 (+1256688us) service_pool.cc:224] Handling call
0709 12:23:20.792673 (+ 39572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.701979 13182 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.776537 13114 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:20.803009  8137 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.805663  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1959) took 2249 ms. Trace:
I20260709 12:23:20.823079  8138 rpcz_store.cc:276] 0709 12:23:18.556128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.556280 (+   152us) service_pool.cc:224] Handling call
0709 12:23:18.565934 (+  9654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.624837 (+ 58903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.624870 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:18.624913 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:18.624945 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.805330 (+2180385us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:20.805404 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.805580 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134975360}
I20260709 12:23:20.803490  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.755373 13225 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:20.711812 12764 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.835479  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.835005  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.703891 13184 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.803752 13032 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:20.803877 13133 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.775280 13023 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.846349  8062 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:20.905791  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.910710  8214 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.841733  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.913690  8213 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:20.906641  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.913328  8219 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:20.837829  8757 raft_consensus.cc:2376] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16. Re-sending same reply.
I20260709 12:23:20.780651 13241 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.918473  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:20.919574  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:20.920219  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
W20260709 12:23:20.920353  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.011s
W20260709 12:23:20.920871  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.008s	sys 0.011s
I20260709 12:23:20.921639  8142 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.906116 13032 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:20.923923  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 568433us
I20260709 12:23:20.929651  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:20.932003  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:20.934275  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:20.936138  8144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1951) took 2454 ms (client timeout 2183 ms). Trace:
I20260709 12:23:20.923676 13030 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:20.936596  8144 rpcz_store.cc:269] 0709 12:23:18.481599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.481734 (+   135us) service_pool.cc:224] Handling call
0709 12:23:20.935937 (+2454203us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400351e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:20.936059 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364578048}
I20260709 12:23:20.924067 12677 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:20.937206 12665 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:20.925693 13032 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.941027 12665 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.941434 12665 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:20.938187 13154 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:20.942898  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:20.943743  8758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 751) took 2427 ms (client timeout 1577 ms). Trace:
I20260709 12:23:20.944113  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:20.944178  8758 rpcz_store.cc:269] 0709 12:23:18.517028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.525874 (+  8846us) service_pool.cc:224] Handling call
0709 12:23:20.943529 (+2417655us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54002f8854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:20.943678 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3952200576}
W20260709 12:23:20.945093 13251 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.357s	user 0.004s	sys 0.000s
I20260709 12:23:20.945251  8757 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:20.945511  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.946115  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:20.946502 13261 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:23:20.946732  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.947304  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.947520  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 786) took 1449 ms. Trace:
I20260709 12:23:20.948104  8757 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.948755  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2127) took 1377 ms. Trace:
I20260709 12:23:20.947928  8758 rpcz_store.cc:276] 0709 12:23:19.497831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.946487 (+1448656us) service_pool.cc:224] Handling call
0709 12:23:20.947465 (+   978us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:20.949014  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.951015  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.951653 13043 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.952152 13043 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.953481  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 794) took 2063 ms. Trace:
I20260709 12:23:20.953845  8064 rpcz_store.cc:276] 0709 12:23:18.889686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.894503 (+  4817us) service_pool.cc:224] Handling call
0709 12:23:18.894791 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.087013 (+1192222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.953233 (+866220us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400321ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:20.953421 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493689600}
I20260709 12:23:20.954344 13043 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.954876 13179 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.955470 13092 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.955382 13179 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:20.956010 13092 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:20.957641 13179 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:20.958134 13092 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:20.949146  8141 rpcz_store.cc:276] 0709 12:23:19.571751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.075030 (+503279us) service_pool.cc:224] Handling call
0709 12:23:20.091445 (+ 16415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:20.248099 (+156654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:20.248128 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:20.253761 (+  5633us) log.cc:844] Serialized 26 byte log entry
0709 12:23:20.288812 (+ 35051us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:20.288893 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.678483 (+389590us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400255654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:20.678530 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:20.921786 (+243256us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:20.948526 (+ 26740us) raft_consensus.cc:1685] finished
0709 12:23:20.948546 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.948699 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378199040,"thread_start_us":34621,"threads_started":1,"wal-append.queue_time_us":316515}
I20260709 12:23:20.959332  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2125) took 1392 ms. Trace:
I20260709 12:23:20.959479  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:20.959753  8145 rpcz_store.cc:276] 0709 12:23:19.569639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.072782 (+503143us) service_pool.cc:224] Handling call
0709 12:23:20.073227 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.227769 (+154542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.959088 (+731319us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400313154. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:20.959271 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343977216}
I20260709 12:23:20.962234  8145 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:20.962589  8219 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:20.958177 13179 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:20.966321  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.966936  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:20.967911  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.969059  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.970081  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.970304  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.971798  8215 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:20.974045  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.974695  8212 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:20.975659  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.976529  8216 raft_consensus.cc:2410] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:23:20.977427  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2020) took 2135 ms (client timeout 2008 ms). Trace:
W20260709 12:23:20.977972  8066 rpcz_store.cc:269] 0709 12:23:18.841538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.844327 (+  2789us) service_pool.cc:224] Handling call
0709 12:23:20.964553 (+2120226us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54000fcdd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:20.977326 (+ 12773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4249227648}
I20260709 12:23:20.979437  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:20.980340  8219 raft_consensus.cc:2410] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:20.982239  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:20.949134  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.983691  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:20.983361  8757 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:20.985991  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:20.990249  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:20.991503  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:20.992254  8066 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:20.935824 13259 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:20.996407  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.997148  8758 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:21.001770  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:21.002022  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.946578  8171 heartbeater.cc:646] Failed to heartbeat to 127.6.182.190:33539 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.182.190:33539 timed out after 15.000s (SENT)
I20260709 12:23:20.993005 13097 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:21.003446  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.004127  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:20.933303 13216 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:23:21.000082  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.014459  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.015170  8758 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:21.007990  8219 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:21.016537  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:21.018006  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:21.022527  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.025511  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.026448  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.028015  8758 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:21.028601  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:20.996764 13110 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:21.029409  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.032202  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.032994 13214 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.033519  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:21.036188  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 779) took 1562 ms. Trace:
I20260709 12:23:21.038823  8216 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:21.039263  8758 rpcz_store.cc:276] 0709 12:23:19.466332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.027417 (+1561085us) service_pool.cc:224] Handling call
0709 12:23:21.027698 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.028327 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.028482 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:20.939664 13255 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:23:20.993055 13226 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:21.013643 13097 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.987181 13248 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:23:20.996491 13105 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:21.026027 13246 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.937316 13225 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.049188  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.034799 13110 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:20.993425 13228 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:23:20.997767 13109 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:23:21.071882  8144 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:21.031531 13186 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.054478  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:20.993829 13179 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.047169 13097 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:21.065448  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81828.7us
I20260709 12:23:21.046695 13260 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:21.096391  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.037401 13029 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.073566 13181 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:21.041560 13214 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:21.026530 12927 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:23:21.076570  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 48049.4us
I20260709 12:23:21.102121  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:17.905115  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.096568 12916 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:21.075014  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.050158 13092 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:23:21.100176  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.076213 13110 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.074280 12764 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:21.050010 13133 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:23:21.105310  8757 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:21.052919 13272 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.078095 13023 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:21.107623  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 83439.9us
I20260709 12:23:21.122587 13104 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:21.123363 13266 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:23:21.123117 13104 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:21.125231 13265 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:21.125365 13104 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:21.126463  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.127064  8764 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:21.127508  8764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 790) took 1628 ms (client timeout 1908 ms). Trace:
W20260709 12:23:21.127898  8764 rpcz_store.cc:269] 0709 12:23:19.499107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.096224 (+597117us) service_pool.cc:224] Handling call
0709 12:23:21.126302 (+1030078us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:23:21.127439 (+  1137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7789952}
I20260709 12:23:21.129547  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1988) took 1027 ms. Trace:
I20260709 12:23:21.129943  8143 rpcz_store.cc:276] 0709 12:23:20.102240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.705325 (+603085us) service_pool.cc:224] Handling call
0709 12:23:20.705605 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:20.705975 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:20.706006 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:20.733145 (+ 27139us) log.cc:844] Serialized 26 byte log entry
0709 12:23:20.919821 (+186676us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:20.919878 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.919975 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.129320 (+209345us) raft_consensus.cc:1685] finished
0709 12:23:21.129343 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.129481 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4091,"thread_start_us":119399,"threads_started":1,"wal-append.queue_time_us":239243}
I20260709 12:23:21.131742  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:21.132330  8143 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.129053  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2122) took 1574 ms. Trace:
I20260709 12:23:21.137416  8146 rpcz_store.cc:276] 0709 12:23:19.555042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.555211 (+   169us) service_pool.cc:224] Handling call
0709 12:23:19.555587 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:19.611514 (+ 55927us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:19.666414 (+ 54900us) log.cc:844] Serialized 14 byte log entry
0709 12:23:20.803777 (+1137363us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b180045a000. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:20.918349 (+114572us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:20.918858 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:23:20.920055 (+  1197us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:20.920114 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.920208 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.128716 (+208508us) raft_consensus.cc:1685] finished
0709 12:23:21.128822 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.128986 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70380,"prepare.queue_time_us":55060,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":15505,"raft.queue_time_us":66938,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8500,"spinlock_wait_cycles":61519744,"thread_start_us":114325,"threads_started":1,"wal-append.queue_time_us":1255663}
I20260709 12:23:21.139719  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.139885  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1986) took 1040 ms. Trace:
I20260709 12:23:21.140367  8139 rpcz_store.cc:276] 0709 12:23:20.099662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.100372 (+   710us) service_pool.cc:224] Handling call
0709 12:23:21.139682 (+1039310us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54001c2fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:21.139812 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26686336}
I20260709 12:23:21.141585  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:21.142913  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:21.095609 13255 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:21.143675 13255 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.097383 13228 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.076265 13247 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:23:21.104300 13225 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.143020 13271 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:21.145426  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:21.104912 13186 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:21.103696 13214 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.119374  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 781) took 1640 ms. Trace:
I20260709 12:23:21.191551  8757 rpcz_store.cc:276] 0709 12:23:19.479506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.079442 (+1599936us) service_pool.cc:224] Handling call
0709 12:23:21.104989 (+ 25547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:21.118986 (+ 13997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.119297 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:21.148891  8184 leader_election.cc:336] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.640s (SENT)
I20260709 12:23:21.127969 12665 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.199995 12665 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.150378  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.106498 12916 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:21.098875 12942 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:23:21.111511 13181 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:21.201929 12916 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:21.202744 13181 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.107820 13182 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:21.165715  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.187613  8146 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.193604  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2026) took 1615 ms. Trace:
I20260709 12:23:21.208999  8068 rpcz_store.cc:276] 0709 12:23:19.577842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.136418 (+558576us) service_pool.cc:224] Handling call
0709 12:23:20.136717 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.254396 (+117679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:20.254429 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:20.254472 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:20.254502 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.193291 (+938789us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001da6d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:21.193350 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.193543 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270172928}
I20260709 12:23:21.212082  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.213047  8139 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:21.214205  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:21.193789  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44957.6us
I20260709 12:23:21.121023 13272 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:21.216918 13272 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.220181 13074 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.220750 13074 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.222469 13255 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.222859 13074 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:21.196303  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.121824 13273 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:21.228986 13273 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:21.229532 13273 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:21.229875  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 758) took 1177 ms. Trace:
I20260709 12:23:21.230316  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.231609  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.232381 12764 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:21.232920 12764 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:21.233103 13092 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.234081 12764 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.235989  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.236991  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.237977  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.228504  8757 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:21.238720  8066 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:21.238972  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 788) took 1740 ms. Trace:
I20260709 12:23:21.236974  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.239411  8757 rpcz_store.cc:276] 0709 12:23:19.498445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.227869 (+1729424us) service_pool.cc:224] Handling call
0709 12:23:21.228205 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.238710 (+ 10505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.238908 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.245970  8146 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:21.246599  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.250047  8137 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:21.252136  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.250065  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.253283  8142 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:21.230288  8759 rpcz_store.cc:276] 0709 12:23:20.052137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.529699 (+477562us) service_pool.cc:224] Handling call
0709 12:23:21.229717 (+700018us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54005000d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:21.229819 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276442880}
I20260709 12:23:21.253765  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.255674  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.257732  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:21.259157  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.188056 13241 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:21.258282  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.262598  8064 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:21.259969  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.259984  8070 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:23:21.262610  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 166287us
I20260709 12:23:21.259171  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:21.265357  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.264420  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.269188  8142 raft_consensus.cc:2410] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:21.270720  8146 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:21.270627  8068 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:21.276158  8143 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:21.190130 13186 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:21.283394  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.284901  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.288736  8068 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:21.284102  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 182041us
I20260709 12:23:21.250907 13133 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.300275  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:21.304322  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:21.310050  8217 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:21.302304  8216 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:23:21.305812  8211 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:21.305902  8220 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 12:23:21.257261 13074 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:21.256812 13092 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.324553  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.323252  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.315038 13260 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:23:21.330351  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:21.331225  8218 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:21.264811 13104 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.293254 13244 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.308393 13248 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.340646  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:21.290733 12665 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.341871  8757 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:21.314882 12644 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:21.351650  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:21.364521  8220 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.346150  8070 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:21.347929  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:21.308166 13241 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:21.350554  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1014) took 1904 ms (client timeout 1619 ms). Trace:
I20260709 12:23:21.350903  8064 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:21.368894  8063 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:21.367918  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 791) took 1868 ms (client timeout 1640 ms). Trace:
W20260709 12:23:21.369830  8760 rpcz_store.cc:269] 0709 12:23:19.499441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.984906 (+485465us) service_pool.cc:224] Handling call
0709 12:23:21.367719 (+1382813us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54005ef954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:21.367845 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577861504}
I20260709 12:23:21.314582 13043 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:23:21.368925  8763 rpcz_store.cc:269] 0709 12:23:19.436445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.484233 (+ 47788us) service_pool.cc:224] Handling call
0709 12:23:21.340733 (+1856500us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54005f1c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:21.340876 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477522688}
I20260709 12:23:21.380474  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.382203  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.382920  8763 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:21.383997  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:21.387724 13114 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.006s
I20260709 12:23:21.376153 13241 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.349756 13244 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.390347 13241 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.391166 13244 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.351610 12644 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.328007 13274 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:21.397238  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:21.400612  8220 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
W20260709 12:23:21.401571  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105354us
W20260709 12:23:21.399856  8731 connection.cc:256] RPC call timeout handler was delayed by -1.804584739999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 12:23:21.403687  8763 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:21.412272  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.412984  8763 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:21.414146  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:21.403872  8731 connection.cc:256] RPC call timeout handler was delayed by -1.7730847399998311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 12:23:21.416751  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.376294 13280 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.430936  8763 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:21.428771  8731 connection.cc:256] RPC call timeout handler was delayed by -1.6353847400000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:23:21.402767 12644 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.363893 12665 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:21.433437  8731 connection.cc:256] RPC call timeout handler was delayed by -1.5075847399998565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:23:21.434499  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 149763us
W20260709 12:23:21.417263 13187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.010s	sys 0.024s
W20260709 12:23:21.437727  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 412265us
I20260709 12:23:21.366122 13186 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:21.463351  8731 connection.cc:256] RPC call timeout handler was delayed by -1.3482847400000537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:23:21.487922  8731 connection.cc:256] RPC call timeout handler was delayed by -1.2393847399998776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
I20260709 12:23:21.436043  8763 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:21.483424  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:21.431595 13216 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.490375  8763 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:23:21.492576  8763 pending_rounds.cc:85] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 10
I20260709 12:23:21.492885  8763 pending_rounds.cc:107] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:23:21.493178  8763 raft_consensus.cc:2889] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:21.482466 13187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.011s	sys 0.024s
W20260709 12:23:21.502269  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92946.2us
I20260709 12:23:21.422761 13244 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:23:21.493525  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:21.483310 13259 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:21.530323  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:21.500437 13252 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:23:21.527216  8729 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.511024  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.524581  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.532352  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.529367  8144 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:21.538213  8035 leader_election.cc:400] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:21.438825 13272 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.538087  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.521298  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.541173  8035 leader_election.cc:403] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:21.551525  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.521253 13182 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:21.563038  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.557149  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.539137 13181 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:21.539315 13247 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.539131 13228 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:21.550534 13074 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:21.628033 13275 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:23:21.629709 13278 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:23:21.551338 13179 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:21.569204 12764 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:21.558897 13182 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.533562 13274 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:21.559294 13186 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.500799 13280 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:23:21.513221 13292 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 12:23:21.770711  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 213640us
W20260709 12:23:21.789405 13279 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.296s	user 0.005s	sys 0.008s
W20260709 12:23:21.788905  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 267689us
I20260709 12:23:21.768715 13284 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:21.816215 13097 consensus_meta.cc:287] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.007s
W20260709 12:23:21.816298 13273 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.586s	user 0.015s	sys 0.004s
W20260709 12:23:21.789705  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 262596us
I20260709 12:23:21.775732 13293 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:21.772320 13288 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:21.775542 13188 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:21.770033  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231934us
I20260709 12:23:21.789196 13074 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.839627  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:21.813463 13276 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.239s	user 0.004s	sys 0.009s
W20260709 12:23:21.811836 13281 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.258s	user 0.002s	sys 0.011s
W20260709 12:23:21.821815 13283 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.271s	user 0.005s	sys 0.006s
W20260709 12:23:21.813354 13271 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.010s
I20260709 12:23:21.887176  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.821542 13274 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:21.835161  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:21.901188  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66139.4us
I20260709 12:23:21.811585 13181 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:21.817320 12764 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.824115 13182 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.822753 13296 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:21.899544  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 59992.1us
I20260709 12:23:21.885826 13179 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.888908 13097 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.893189 13273 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:21.917109  8731 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.146s (SENT)
I20260709 12:23:21.938411  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.917191  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:21.940380  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.919173 13181 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.913165 13308 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:21.905280 12764 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.921756 13043 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:21.904728 13274 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:21.965165  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 780) took 2489 ms. Trace:
I20260709 12:23:21.957968 13308 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:21.965761  8758 rpcz_store.cc:276] 0709 12:23:19.475415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.040213 (+1564798us) service_pool.cc:224] Handling call
0709 12:23:21.040538 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:21.042115 (+  1577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.042161 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:21.043643 (+  1482us) log.cc:844] Serialized 26 byte log entry
0709 12:23:21.151398 (+107755us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:21.192581 (+ 41183us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.192870 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.192964 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.964933 (+771969us) raft_consensus.cc:1685] finished
0709 12:23:21.964956 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.965103 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1034,"prepare.queue_time_us":41348,"raft.queue_time_us":1262,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":4103,"spinlock_wait_cycles":31112576,"thread_start_us":73900,"threads_started":1,"wal-append.queue_time_us":238390}
I20260709 12:23:21.966531 13308 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.967882  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:21.968199 13308 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.904560 13303 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.925060 12665 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:21.927332 13214 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.685s	user 0.016s	sys 0.002s
I20260709 12:23:21.969305 13288 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.984046 13302 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:21.932118 13246 consensus_meta.cc:287] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.852s	user 0.009s	sys 0.009s
I20260709 12:23:21.896987 13074 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.986194 13246 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.986917  8139 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:21.933614 13272 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.916671 13296 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.990571 13296 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.991245  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2138) took 1241 ms. Trace:
I20260709 12:23:21.891571 13293 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.991668  8146 rpcz_store.cc:276] 0709 12:23:20.749808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.271770 (+521962us) service_pool.cc:224] Handling call
0709 12:23:21.272070 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:21.307400 (+ 35330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.307430 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:21.323703 (+ 16273us) log.cc:844] Serialized 26 byte log entry
0709 12:23:21.488393 (+164690us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:21.488443 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.488504 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.991040 (+502536us) raft_consensus.cc:1685] finished
0709 12:23:21.991063 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.991190 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34968,"raft.queue_time_us":35457,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":18082,"thread_start_us":118269,"threads_started":1,"wal-append.queue_time_us":636983}
I20260709 12:23:21.992961 13293 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.920377 13188 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:21.902082  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:21.942622 13179 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:21.944144 13216 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.893456 13284 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:21.944387 13097 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:21.945152 13273 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:21.945657  8143 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:21.947428 12644 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:21.933653 13225 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.007s
I20260709 12:23:21.914134 13271 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:21.948733 13248 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:23:21.948923 13151 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:21.949226 13110 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.827s	user 0.006s	sys 0.014s
W20260709 12:23:21.950812  8731 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.267s (SENT)
I20260709 12:23:22.030241  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:21.960079  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2135) took 1630 ms. Trace:
I20260709 12:23:21.839356 13247 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:21.968497  8758 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:21.979543  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.982800 13214 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:21.930217 12916 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.006s
W20260709 12:23:22.001277  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 99296us
I20260709 12:23:22.030922  8145 rpcz_store.cc:276] 0709 12:23:20.329990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.962868 (+632878us) service_pool.cc:224] Handling call
0709 12:23:20.963176 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:20.999641 (+ 36465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:20.999687 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:21.015025 (+ 15338us) log.cc:844] Serialized 78 byte log entry
0709 12:23:21.349113 (+334088us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:21.490945 (+141832us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.493940 (+  2995us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.497102 (+  3162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.497219 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.959851 (+462632us) raft_consensus.cc:1685] finished
0709 12:23:21.959873 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.960021 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41531,"prepare.queue_time_us":238723,"prepare.run_cpu_time_us":10371,"prepare.run_wall_time_us":157422,"raft.queue_time_us":81859,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":51563,"spinlock_wait_cycles":18688,"thread_start_us":395070,"threads_started":2,"wal-append.queue_time_us":395423}
I20260709 12:23:21.995122 13182 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.011567 13274 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:22.020951  8765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1011) took 2590 ms (client timeout 3203 ms). Trace:
W20260709 12:23:22.045291  8765 rpcz_store.cc:269] 0709 12:23:19.430958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.431107 (+   149us) service_pool.cc:224] Handling call
0709 12:23:22.020701 (+2589594us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400447d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.020871 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3267780480}
I20260709 12:23:22.022536  8759 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:22.032948  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:22.033753  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 82987.6us
I20260709 12:23:22.016314 13260 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:22.036669 13097 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:22.047691  8064 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 12:23:22.048787 13091 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.049291 13091 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.050632 13274 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.051275 13091 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.030375 13248 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:22.052387  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:22.052788 13284 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.053668  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.054409  8765 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.055310  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.055866  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:22.057627  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 767) took 1092 ms. Trace:
I20260709 12:23:22.058425 12644 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.059933 13214 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.035554 13110 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.068996 13110 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.071024  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:22.071674  8758 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.057934  8765 rpcz_store.cc:276] 0709 12:23:20.965228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.056789 (+1091561us) service_pool.cc:224] Handling call
0709 12:23:22.057082 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.057258 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.057283 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.057338 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:22.057378 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.057437 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.057536 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.071676  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:22.036615  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78065.4us
I20260709 12:23:22.073916  8064 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.075331  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.077243  8066 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.077255  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.078809  8061 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:22.083120  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.085978  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.086476  8066 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.090663  8069 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.090946  8066 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:22.092950  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.094831  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:22.095181  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.096203  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.096319  8068 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:22.096400  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.070598 13179 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.096973  8066 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:22.102695  8758 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:22.146951  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.145494  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:22.149071  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 49471.1us
I20260709 12:23:22.149971  8066 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.151249  8068 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:22.084892 13295 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.157558  8069 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:22.157876  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.154079  8066 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:22.157635  8758 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:22.152531  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.159552  8765 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:22.160048  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.160130  8068 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.161194  8758 raft_consensus.cc:2410] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:23:22.160190  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 769) took 1194 ms. Trace:
I20260709 12:23:22.161713  8765 rpcz_store.cc:276] 0709 12:23:20.965829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.095872 (+1130043us) service_pool.cc:224] Handling call
0709 12:23:22.159385 (+ 63513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.159979 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.160142 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.162984  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.097738 13091 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.168963  8067 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.070951 12916 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.095054 13260 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:22.085609 13097 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:23:22.167668 13189 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.085371 13151 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:23:22.188278 13254 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.599s	user 0.009s	sys 0.004s
W20260709 12:23:22.190618  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1013) took 2759 ms (client timeout 1635 ms). Trace:
I20260709 12:23:22.180536 13091 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.192814 13313 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:23:22.194461 12916 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.090289 13188 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 12:23:22.202440  8756 rpcz_store.cc:269] 0709 12:23:19.431668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.975324 (+543656us) service_pool.cc:224] Handling call
0709 12:23:22.190426 (+2215102us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.190545 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338311040}
I20260709 12:23:22.203372  8064 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:22.210042  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:22.213169  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.121727 12764 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.218008 12764 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.218715  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.219365  8067 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.158293 13074 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.169335 13295 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.220006 13293 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:22.261022 13314 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:23:22.174583 13216 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:23:22.179469 13246 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:23:22.209111 13189 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.213752  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:22.265740 13253 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.676s	user 0.016s	sys 0.010s
W20260709 12:23:22.266892  8144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1998) took 1281 ms (client timeout 1618 ms). Trace:
W20260709 12:23:22.326875  8144 rpcz_store.cc:269] 0709 12:23:20.985024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.079897 (+ 94873us) service_pool.cc:224] Handling call
0709 12:23:22.266724 (+1186827us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54000528d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.266830 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964378368}
I20260709 12:23:22.327780  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 755) took 2277 ms. Trace:
I20260709 12:23:22.328138  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.328419 13189 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.328523 13029 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.329015 13029 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.329486  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.330121  8144 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:22.329789 13029 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.329572 13188 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:22.330796 13029 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.331952  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:22.332823 13189 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.333195 13189 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.333535 13189 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.336364 13295 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.337092 13141 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.337741  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2147) took 1214 ms. Trace:
I20260709 12:23:22.337643 13141 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.338099  8143 rpcz_store.cc:276] 0709 12:23:21.123584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.424146 (+300562us) service_pool.cc:224] Handling call
0709 12:23:21.445083 (+ 20937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.015713 (+570630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.337503 (+321790us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400255654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.337685 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150797568}
I20260709 12:23:22.339315  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.339752  8219 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:22.341017 13216 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:22.341409 13216 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.341675 13288 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:22.341989 13229 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 2.208s	user 0.004s	sys 0.023s
I20260709 12:23:22.342073 13288 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:22.328154  8757 rpcz_store.cc:276] 0709 12:23:20.050703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.242661 (+1191958us) service_pool.cc:224] Handling call
0709 12:23:21.341485 (+ 98824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.349908 (+  8423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.327603 (+977695us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b54005f1c50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.327726 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226523392}
I20260709 12:23:22.343138 13288 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.344944  8757 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:22.266795 13091 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.267994  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2016) took 3517 ms. Trace:
I20260709 12:23:22.345896 13241 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:22.346055  8062 rpcz_store.cc:276] 0709 12:23:18.750858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.751045 (+   187us) service_pool.cc:224] Handling call
0709 12:23:18.786639 (+ 35594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.909498 (+2122859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.267769 (+1358271us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54003958d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.267941 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4723263360}
I20260709 12:23:22.272256 13222 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:22.347234 12677 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:22.347360 13222 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.347705 12677 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:22.348248 13222 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.348487 12677 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.349434 12677 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.272959 13195 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:22.350354 13195 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.352371  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 759) took 2300 ms. Trace:
I20260709 12:23:22.352530 13195 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.340363  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.352806  8759 rpcz_store.cc:276] 0709 12:23:20.052445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.254242 (+1201797us) service_pool.cc:224] Handling call
0709 12:23:22.022066 (+767824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.046419 (+ 24353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.352180 (+305761us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400447d50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.352309 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764948864}
I20260709 12:23:22.210084 12665 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:22.353933 12665 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.356047 12665 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.273531  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2021) took 3405 ms. Trace:
W20260709 12:23:22.356568 13267 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.305s	user 0.002s	sys 0.000s
I20260709 12:23:22.340402 13141 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.356885  8065 rpcz_store.cc:276] 0709 12:23:18.867720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.867853 (+   133us) service_pool.cc:224] Handling call
0709 12:23:18.944693 (+ 76840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:20.791208 (+1846515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.273271 (+1482063us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54002030d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.273468 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4219252992}
I20260709 12:23:22.331002  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.275223 13117 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.358062  8144 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:22.272990  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.361033  8218 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:22.361425  8068 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:22.277992  8760 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:22.287804  8070 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:23:22.285269  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2031) took 1051 ms. Trace:
I20260709 12:23:22.342237 13216 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.363785  8061 rpcz_store.cc:276] 0709 12:23:21.233826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.235713 (+  1887us) service_pool.cc:224] Handling call
0709 12:23:22.285053 (+1049340us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001f7554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.285197 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859270912}
I20260709 12:23:22.291745  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2001) took 1535 ms. Trace:
I20260709 12:23:22.292390  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.293272  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:22.365175  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 789) took 2866 ms (client timeout 1854 ms). Trace:
W20260709 12:23:22.365613  8762 rpcz_store.cc:269] 0709 12:23:19.498775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.094644 (+595869us) service_pool.cc:224] Handling call
0709 12:23:22.292232 (+2197588us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:23:22.365109 (+ 72877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7385984}
W20260709 12:23:22.365912  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 72728.8us
I20260709 12:23:22.364836  8213 rpcz_store.cc:276] 0709 12:23:20.756084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.756213 (+   129us) service_pool.cc:224] Handling call
0709 12:23:20.778534 (+ 22321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.915281 (+136747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.291507 (+1376226us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002a5dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.291682 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310340992}
I20260709 12:23:22.297948 13208 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.368747 13208 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:22.301432  8211 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.369951  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3171) took 1032 ms. Trace:
I20260709 12:23:22.370412 13032 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.356665  8143 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:22.377264 12916 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:22.377725 12916 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.378075 12916 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.378325  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2121) took 2825 ms. Trace:
I20260709 12:23:22.378794  8140 rpcz_store.cc:276] 0709 12:23:19.552814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.552993 (+   179us) service_pool.cc:224] Handling call
0709 12:23:19.553320 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:20.613488 (+1060168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.378032 (+1764544us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400311854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.378261 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367128320}
W20260709 12:23:22.302124 13282 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.780s	user 0.007s	sys 0.013s
I20260709 12:23:22.296465 13219 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.303491 13277 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:22.381423 13277 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.382282 13277 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.383726 13277 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.304456 13258 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.384488 13258 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.305140 13105 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:22.295322 13182 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.385371 13105 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:22.386255 13105 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.387452 13105 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.309725  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2149) took 1082 ms. Trace:
I20260709 12:23:22.388957  8146 rpcz_store.cc:276] 0709 12:23:21.226968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.996215 (+769247us) service_pool.cc:224] Handling call
0709 12:23:21.996527 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:21.996993 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.997018 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:22.010278 (+ 13260us) log.cc:844] Serialized 52 byte log entry
0709 12:23:22.094749 (+ 84471us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:22.094782 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.094839 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.309464 (+214625us) raft_consensus.cc:1685] finished
0709 12:23:22.309490 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.309653 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":330,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":16372,"thread_start_us":84031,"threads_started":1,"wal-append.queue_time_us":268132}
I20260709 12:23:22.390455 13208 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.391824  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1990) took 2289 ms. Trace:
I20260709 12:23:22.370265  8211 rpcz_store.cc:276] 0709 12:23:21.337324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.337439 (+   115us) service_pool.cc:224] Handling call
0709 12:23:21.352147 (+ 14708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.301256 (+949109us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54003578a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:22.369693 (+ 68437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.369896 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37024000}
I20260709 12:23:22.396436  8061 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:22.398350  8070 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:22.399148  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2001) took 1281 ms. Trace:
I20260709 12:23:22.399338  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.399971  8066 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:22.401142  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.401742  8063 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:22.409055  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 766) took 1444 ms. Trace:
I20260709 12:23:22.409471  8763 rpcz_store.cc:276] 0709 12:23:20.964937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.496778 (+531841us) service_pool.cc:224] Handling call
0709 12:23:21.499499 (+  2721us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:21.499969 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.500011 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:21.502064 (+  2053us) log.cc:844] Serialized 52 byte log entry
0709 12:23:21.791761 (+289697us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:21.826093 (+ 34332us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.836298 (+ 10205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.836376 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.405658 (+569282us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b180041c800. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:22.407650 (+  1992us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b2400318908. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:23:22.408842 (+  1192us) raft_consensus.cc:1685] finished
0709 12:23:22.408862 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.408995 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9894,"prepare.queue_time_us":33996,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":49046,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":63321,"spinlock_wait_cycles":45560832,"thread_start_us":236917,"threads_started":1,"wal-append.queue_time_us":307983}
I20260709 12:23:22.392197  8137 rpcz_store.cc:276] 0709 12:23:20.102915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.930584 (+827669us) service_pool.cc:224] Handling call
0709 12:23:21.249580 (+318996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.250582 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.391625 (+1141043us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400042750. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.391764 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732853632}
I20260709 12:23:22.413849  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2002) took 1295 ms. Trace:
I20260709 12:23:22.414392  8139 rpcz_store.cc:276] 0709 12:23:21.118003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.213852 (+ 95849us) service_pool.cc:224] Handling call
0709 12:23:22.413633 (+1199781us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540008ded4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:22.413775 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775469824}
I20260709 12:23:22.415777  8063 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:22.268558 13260 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.314636 13225 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:23:22.323041  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:22.425518  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 102557us
W20260709 12:23:22.426066  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.325553 13030 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.325994 13293 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:22.345399  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 131732us
I20260709 12:23:22.346529 13241 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.349473 13222 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.399521  8142 rpcz_store.cc:276] 0709 12:23:21.117542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.327449 (+209907us) service_pool.cc:224] Handling call
0709 12:23:21.327745 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.398197 (+ 70452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.398517 (+   320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.398579 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.398624 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.398956 (+1000332us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b5400040954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:22.398996 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.399099 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161446272}
W20260709 12:23:22.417801  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 49266.6us
I20260709 12:23:22.202773 13312 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:23:22.164299 13273 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:22.164767 13214 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:22.426546  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.433261  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.446971  8066 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.433988  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:22.448107  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:22.450187  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.442703  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:22.451534  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:22.460420  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:22.460744  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:22.436088  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.439188  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.439429  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.431867  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.440488  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.464541  8065 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.444103  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:22.442795 13288 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.465742  8219 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.429862 13030 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.509116  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.509428  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:22.509935  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.476234  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.511040  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.513001  8137 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.513235  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:22.488891  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.506796  8139 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:22.507921  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50784.7us
I20260709 12:23:22.320402 13296 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.533033  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:22.592733  8139 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:22.598294  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 87663.6us
I20260709 12:23:22.577450  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.546672  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:22.540208  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 79585us
I20260709 12:23:22.599439  8141 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.575551  8065 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:22.593148  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.602697  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.539644 12432 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.567385  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.603819  8214 raft_consensus.cc:1217] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Deduplicated request from leader. Original: 8.4->[9.5-14.7]   Dedup: 9.5->[12.6-14.7]
I20260709 12:23:22.604399  8214 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [9.5-14.7]
I20260709 12:23:22.562925  8067 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:22.608739  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.466881 13192 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.603609 12432 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.615585  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.600834  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.469787 13303 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.146s
I20260709 12:23:22.466104 13187 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 12:23:22.623850 13173 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 12:23:22.624457 13187 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:22.624584 12764 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:22.624907 13187 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:22.625213 12764 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.625834 13187 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.627068 13187 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.626760 13189 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.609447  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.513618 13043 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:22.534185 12996 raft_consensus.cc:2764] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:23:22.619604  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 106420us
I20260709 12:23:22.661466  8061 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.665325  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.609892  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.616755 13259 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.622143 13290 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.197s
I20260709 12:23:22.622391 13273 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:22.622200 12665 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:22.623051 13074 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.450680 13092 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 12:23:22.689739  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.627488 12764 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.628031  8063 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.553583  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.466547 13293 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:22.648414 12432 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.628854  8763 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:22.530185 13133 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.664093  8146 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:22.650905  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:22.695123  8140 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:22.695549  8140 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:22.664518  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49154.8us
I20260709 12:23:22.671180 13154 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:22.671557 13215 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:22.672737 13307 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.224s
I20260709 12:23:22.597105 13246 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:22.598011 12927 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.687958  8141 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:22.531720 13295 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:22.623340 13227 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:22.617028 13192 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.622973  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.697151  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:22.665547 13043 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.701568 13154 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.717747 13043 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.718096 13285 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.718541 13285 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.718883 13285 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.719337 13154 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.699791  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.696446  8140 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.720762  8140 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.675199 13303 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.672260 13234 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:23:22.728418 13205 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:22.729095 13141 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:22.729224 13205 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.686950 13184 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:22.730095 13184 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:22.730541 13184 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.707401  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.673909 12665 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.686298 13322 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.736768 12665 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.737187  8061 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:22.620270 13247 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:23:22.702919 13195 raft_consensus.cc:2764] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:22.692754 13091 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:22.712217  8757 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:22.724238  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.725792 13256 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.750450 13256 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.750931 13256 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.756263  8139 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:22.725528 13154 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:22.757496 13318 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:23:22.758657 13091 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:22.759500 13091 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:22.726141 13264 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:22.760439 13264 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:22.726781 13302 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:22.760960 13264 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.761322 13302 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:22.727324 13303 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.733812  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.613236 13272 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:23:22.722958 13023 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:23:22.770233 13023 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.770622 13023 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.771431 13023 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.686225 13241 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.715201  8143 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.743722  8761 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:22.736788  8219 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:22.706514 13074 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:22.747282  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 258511us
W20260709 12:23:22.758749 13171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.535s	user 0.029s	sys 0.043s
I20260709 12:23:22.714075 13227 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.777732 13154 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:23:22.781611 13296 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:22.781877 13303 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.760754 13091 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:22.783030 13320 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:22.785025  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.785732  8062 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:22.773195 13302 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.788708 13227 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.758452 12916 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.758790  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2006) took 1518 ms. Trace:
I20260709 12:23:22.789920  8145 rpcz_store.cc:276] 0709 12:23:21.240470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.038535 (+798065us) service_pool.cc:224] Handling call
0709 12:23:22.038835 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.039187 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.039215 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.073156 (+ 33941us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.213144 (+139988us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:22.213184 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.213250 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.758534 (+545284us) raft_consensus.cc:1685] finished
0709 12:23:22.758555 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.758725 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4029,"thread_start_us":90225,"threads_started":1,"wal-append.queue_time_us":235634}
I20260709 12:23:22.791380  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:22.792550  8140 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:23:22.792981  8140 pending_rounds.cc:85] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 5
I20260709 12:23:22.793224  8140 pending_rounds.cc:107] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:23:22.793481  8140 raft_consensus.cc:2889] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:22.726658  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.721377 13192 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.752399  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.767531  8759 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:22.700431 13259 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.777096  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.777242  8730 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:22.708222 13293 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:22.772454 13023 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.712558 12927 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.706086 13133 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.778335 13029 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.793793  8140 pending_rounds.cc:107] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:23:22.808030  8140 raft_consensus.cc:2889] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:22.808249  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.808933  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:22.796356  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69774.3us
I20260709 12:23:22.800073  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.807014  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:22.811056  8216 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.789062 13097 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:22.779870 13171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.668s	user 0.030s	sys 0.043s
W20260709 12:23:22.805749  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53422us
I20260709 12:23:22.816404  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.774044 13109 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.735571 13295 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.812129  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.816010  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.813215  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:22.813730  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.814306  8140 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:22.814258 13246 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:22.803409 13141 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.798043 12935 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:22.815681  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.836325  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:22.821563  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.837440  8220 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:22.823837  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:22.826599  8212 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:22.835602  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.830202  8215 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:22.839250  8217 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:22.800534 13154 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:22.858240  8219 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:22.833841  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.835541  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.829221  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.861557  8137 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:22.843222  8216 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:22.850070  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.850730  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:22.863298  8140 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:22.864377  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.865477 13043 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.867292  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.868860 13154 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:22.868506  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.869935 13154 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.870615  8066 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:23:22.871656  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 338687us
I20260709 12:23:22.818145 13029 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.810518 13296 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:22.874459 13029 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:22.874545 13321 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:23:22.874614 13296 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:22.875161  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:22.815615 12764 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:22.876098 13326 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:23:22.876312  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.876747 13211 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.877189 13211 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.877521 13211 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.879822  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.880177  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.880447  8064 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:22.831205  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:22.882025  8759 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:22.840703  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.882200  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:22.882490  8145 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.882700  8067 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.882750  8141 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.803659 13303 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:22.885121  8066 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:22.835731 13298 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.823925 13293 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:22.889639 13324 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:23:22.810554 13104 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:23:22.893554 13117 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:22.894658 13259 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.843001 12935 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.895478 13296 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:22.952502  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68345.5us
I20260709 12:23:22.836141 13109 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.825996 12927 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:22.897750 12916 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.903950  8763 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:22.906862 13043 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:22.905725  8143 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:22.908808  8144 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:22.911031 13114 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:22.880923  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.967813  8061 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:22.912855 13322 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:22.916079  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:22.916565  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103423us
W20260709 12:23:22.921195  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.916003  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55529.6us
I20260709 12:23:22.911988 13256 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:22.927326  8212 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:22.830265 13097 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:22.978899  8219 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.933337  8064 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:22.938971 13327 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:22.939762  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:22.949363  8109 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 2.010s (SENT)
I20260709 12:23:22.983184  8065 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:22.881639 13246 consensus_queue.cc:1243] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:22.921587 13173 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:22.965744  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:22.986580  8765 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:22.973604  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.988201  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.968849  8068 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:22.950980  8145 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:22.984095  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:22.989768  8066 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.989928  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:22.984469  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:22.992954  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.993676  8213 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:22.993844  8217 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:22.977080  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:22.954692 12935 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:22.995178  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:22.927831 12644 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:23:22.999742  8141 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:23.001214  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:23.022574  8215 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:23.024802  8110 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:23.028530  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:23.029284  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:22.962620 13030 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:23.051549  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50412.5us
I20260709 12:23:23.052037  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.055713  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:23.056253  8212 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:23.057508  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:23.058876 12432 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:23.062674 13303 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:23.068532  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.069154  8756 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.068683 13303 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.072278 13141 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:23.074276 13184 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.021901 13246 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.053136 13029 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:23.022787 13259 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:23.100493  8211 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:23.079843  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.082919  8140 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:23.024551 12916 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.021695 13241 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:22.996165 13290 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:23.088610  8065 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:23.033586  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.091256  8066 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:23.095863 13154 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:23.097182  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66695.1us
I20260709 12:23:23.118670  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:23.118738 12432 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.119877  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:23.022945 12927 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.018772 13227 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.064566 13222 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:22.931944 13298 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.124764 12927 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.129541 13336 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:23.124933 13259 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.130561 13298 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.060499 13096 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:23.130800 12927 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.130676 13259 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.131314 13096 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.132601 13222 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.132339 13096 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.132905 13259 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.133097 13222 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.133679  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.134810  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:23.125399 13154 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.139429 13154 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.127683 13141 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:23.140367 13141 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.140858 13141 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:23.141202 13332 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:23.141487  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 787) took 3643 ms. Trace:
I20260709 12:23:23.141834  8764 rpcz_store.cc:276] 0709 12:23:19.498158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.129483 (+1631325us) service_pool.cc:224] Handling call
0709 12:23:22.196717 (+1067234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.200353 (+  3636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.200379 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.200844 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.429251 (+228407us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:22.459474 (+ 30223us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.467939 (+  8465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.468014 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.784427 (+316413us) raft_consensus.cc:1685] finished
0709 12:23:22.784446 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.141319 (+356873us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400605250. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.141435 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11404,"prepare.queue_time_us":29346,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":20957,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":73546,"spinlock_wait_cycles":2618300928,"thread_start_us":227997,"threads_started":1,"wal-append.queue_time_us":311760}
I20260709 12:23:23.145200  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.145301  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.146037  8065 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:23.060762 13074 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:23:23.063441 13218 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.032979 13277 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:23:23.124015  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:23.114756  8756 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:23.151520  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.166282  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:23.102685 13029 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:23.063664 13219 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:23:23.166407  8066 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:23.166998  8763 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:23.066076 13322 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:23:23.125548 13260 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.175160  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:23.181972  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58036.1us
I20260709 12:23:23.183705  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:23.168701 13029 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:23.217991  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.190071 13295 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.221668  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.223564  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.224514  8215 raft_consensus.cc:2368] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13.
I20260709 12:23:23.225668  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.190778 13092 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:23.226516  8215 raft_consensus.cc:2410] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:23.124143 13290 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.227674  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.229442  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:23.211825 13187 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.008s
I20260709 12:23:23.232657  8213 raft_consensus.cc:2368] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:23.168449 13211 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.177526 12665 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.251332  8067 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:23:23.254189  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.140143 13285 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.238310  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.232610 13043 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:23.230800 13303 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.246111 13342 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:23:23.247424 13331 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:23:23.248147 13334 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:23.257485  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.256470  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.259268  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.268648  8215 raft_consensus.cc:2376] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14. Re-sending same reply.
I20260709 12:23:23.269546  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.270498  8215 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:23.271391  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.206485 13104 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:23.274305  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.275519  8215 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:23.282915  8762 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:23.284353  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:23.286836 13339 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:23:23.248963 13092 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.291862  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.288844  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.293226  8215 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:23.289518  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 294193us
I20260709 12:23:23.123329 13258 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.263274 13222 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.294652  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.295552  8220 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:23.256399 13256 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.274755 13043 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.295573 13030 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.267287 13303 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.319350 13222 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.320111 13303 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.324731 13227 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.326750 13285 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:23.329110 13192 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:23:23.341410  8215 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:23:23.341785  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.342597  8220 raft_consensus.cc:2368] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:23.317200 13184 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.346693  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.337459 12996 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:23.354220 12996 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.355078 12996 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.356096 12996 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:23.351097 13345 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:23.350498 13092 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.351958 13043 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:23.353928 13023 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 12:23:23.335234 13192 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.339146 13327 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.374131 13327 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:23.375883 13335 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:23:23.377620 13264 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.006s
I20260709 12:23:23.378064 13264 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.381640 13264 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:23.383071 13328 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.666s	user 0.006s	sys 0.000s
I20260709 12:23:23.388924 13290 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.390785 13246 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:23.438930  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.309094  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:23.442662  8067 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.446198  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.446507  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:23.461614  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:23.462638  8143 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:23.465258  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 167608us
I20260709 12:23:23.466176  8145 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:23.467310  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.351727  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 943) took 1031 ms. Trace:
I20260709 12:23:23.359436  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.470785  8219 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.469775  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:23.469839  8212 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:23:23.471716  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.476902  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.469880  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.478668  8212 pending_rounds.cc:85] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
I20260709 12:23:23.499897 13211 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.502363 13192 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.468142  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:23.492281  8212 pending_rounds.cc:107] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:23.508241  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.345980 12935 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.507956  8212 raft_consensus.cc:2889] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:23.514501  8067 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:23.516844 12665 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:23.517165 13355 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:23:23.515650  8218 rpcz_store.cc:276] 0709 12:23:22.319891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.321443 (+  1552us) service_pool.cc:224] Handling call
0709 12:23:22.321761 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.361470 (+ 39709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.351499 (+990029us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:23.351670 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89394944}
I20260709 12:23:23.520485  8218 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:23.522671  8218 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:23.525151  8213 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:23.536302  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.542219  8220 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.542989  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:23.543848  8137 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.544368  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:23.545322  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.520293 12935 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.555191  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.561048  8137 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:23.557713  8143 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:23.513968 13192 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:23.562496  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 94673.5us
W20260709 12:23:23.571126  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.578946 13216 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:23.573321 13226 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:23:23.582927 13226 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:23.583333 13226 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:23.584841  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.581910 13029 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.585529  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3160) took 1154 ms. Trace:
I20260709 12:23:23.586040  8063 rpcz_store.cc:276] 0709 12:23:22.431514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.431633 (+   119us) service_pool.cc:224] Handling call
0709 12:23:23.585111 (+1153478us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400347e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.585331 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376094976}
I20260709 12:23:23.587405 13029 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.588593  8035 leader_election.cc:400] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13.
I20260709 12:23:23.589079  8035 leader_election.cc:403] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:23.574779 13327 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:23.590517 13327 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.593073 13182 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13.
I20260709 12:23:23.594991  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:23.595485  8213 raft_consensus.cc:2410] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:23.596240 13182 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:23.598276  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:23.599563 13182 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.601876  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2021) took 1001 ms. Trace:
I20260709 12:23:23.602456  8139 rpcz_store.cc:276] 0709 12:23:22.600051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.609210 (+  9159us) service_pool.cc:224] Handling call
0709 12:23:23.601304 (+992094us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001c43d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.601616 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294222720}
I20260709 12:23:23.606082  8146 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:23:23.606508  8146 pending_rounds.cc:85] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 7
I20260709 12:23:23.606801  8146 pending_rounds.cc:107] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:23:23.607118  8146 raft_consensus.cc:2889] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:23.608769 13105 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:23.609411 13105 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.611083 13105 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.611966  8035 leader_election.cc:400] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:23.613790 12935 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:23.614612  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3168) took 2310 ms. Trace:
I20260709 12:23:23.615103  8214 rpcz_store.cc:276] 0709 12:23:21.304733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.306794 (+  2061us) service_pool.cc:224] Handling call
0709 12:23:21.336905 (+ 30111us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:22.604767 (+1267862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.613819 (+1009052us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003a6e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:23.614361 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913137408}
I20260709 12:23:23.568817 13303 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:23.612463  8035 leader_election.cc:403] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:23.604382  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:23.621181 13226 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.622776  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1033) took 1017 ms. Trace:
I20260709 12:23:23.606801  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:23.619689  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47179.6us
I20260709 12:23:23.625322  8762 rpcz_store.cc:276] 0709 12:23:22.605546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.605682 (+   136us) service_pool.cc:224] Handling call
0709 12:23:23.622225 (+1016543us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.622579 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398713088}
I20260709 12:23:23.628577  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:23.629297  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:23.632534  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:23.631428  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:23.633772  8140 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:23.635941 13211 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:23.624701 13105 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:23.637759  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64923.5us
I20260709 12:23:23.592089 13327 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.641053 13182 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:23.641189 13192 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.642350 13272 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.643185 13221 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:23.642984 13171 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:23.636575 13226 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:23.653133  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:23.654386  8761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1022) took 2711 ms (client timeout 2010 ms). Trace:
W20260709 12:23:23.654853  8761 rpcz_store.cc:269] 0709 12:23:20.943202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.982009 (+ 38807us) service_pool.cc:224] Handling call
0709 12:23:23.654020 (+2672011us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54006702d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.654171 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4020604800}
I20260709 12:23:23.655334  8141 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:23.650488 13187 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:23.656945 13043 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:23.657112 13187 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.657905  8758 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:23.661180 13187 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.661932 13187 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.662654 13187 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.663390 13109 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.648396 13303 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.664462 13110 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:23.682521 13110 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.678231  8140 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:23.684883  8140 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:23.692590  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:23.670166 13189 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.694571  8140 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:23.685451 13303 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.695783  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:23.666807 13133 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:23.673770 13208 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.683894 13110 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.679805 13312 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:23.706212 13312 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.707525 13303 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:23.708515  8213 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.709937  8070 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:23:23.710426  8070 pending_rounds.cc:85] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 8
I20260709 12:23:23.710724  8070 pending_rounds.cc:107] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:23:23.711033  8070 raft_consensus.cc:2889] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:23.689042 13246 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:23.690604  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.714262  8067 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:23.710438 13312 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.713428  8214 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:23.715513 13312 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.716718  8761 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:23:23.718192 13146 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:23.718837 13146 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.719283 13154 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:23.719750 13154 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:23.720007 13192 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.687273  8063 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.674516 13214 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:23.721043 13214 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:23.696431  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2017) took 1131 ms. Trace:
I20260709 12:23:23.721776  8144 rpcz_store.cc:276] 0709 12:23:22.564786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.567007 (+  2221us) service_pool.cc:224] Handling call
0709 12:23:23.696005 (+1128998us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002f1554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:23.696213 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700504960}
I20260709 12:23:23.722488 13214 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.724143 13214 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.729337 13097 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.731308 13171 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.677026 13029 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:23:23.672695  8141 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:23.710861  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.837604  8213 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:23.837957  8067 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:23:23.765925 13141 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.005s
I20260709 12:23:23.838976 13303 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:23.840303 13303 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.841591 13171 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.825456 13173 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.843230 13171 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:23.843829 13303 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.843240 13173 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:23.843039  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 157139us
I20260709 12:23:23.844514 13187 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.845961  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:23.846760 13173 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.826908  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:23.847677  8063 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.846499 13182 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.825977  8137 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:23:23.829512  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.852974  8216 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:23.854035 13182 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.854921  8220 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 9.
I20260709 12:23:23.860356 13301 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:23.862257 13272 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:23.862813 13272 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.864068 13272 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.839103 13146 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:23.827421 13097 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:23.731670 13154 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.866776 13211 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:23.867239 13154 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.868448 12942 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:23.868932 12942 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:23.840449  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 228685us
I20260709 12:23:23.870460  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:23.838914 13141 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.840134 13228 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:23.872040 13228 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:23.836848 13215 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:23.846956  8067 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 9: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:23.852154 13244 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.840785  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 175138us
I20260709 12:23:23.833674 12935 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:23.871455 13274 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:23.870110 12942 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:23.834419  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.839447  8143 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:23.692044  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:23.823804  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.880559  8211 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 16. Ops: []
W20260709 12:23:23.831879  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.887375  8140 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.885982  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:23.888588  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:23.899622  8063 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:23.872608  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:23.903375  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.896432  8219 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:23.910805  8220 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.911842  8219 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:23.914673  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 222966us
I20260709 12:23:23.915459  8144 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.879549 12942 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.881999 13141 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.883585 13274 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:23.872985 13215 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.925702  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.873195 13228 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:23.928074  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:23.879935 13211 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:23.874007 12935 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.923833 13192 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:23.944525  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.873205 13244 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.949747  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:23.951478  8763 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:23.954583  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.955475  8217 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:23.940362 13221 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.972051 13173 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.978359  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 105875us
I20260709 12:23:23.981201 13293 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:23.979810 13173 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.981861  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.983316  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:23.983644 13173 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:23.984014  8759 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:23.984192  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.984519 13092 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:23.989051 13293 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.989576 13092 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:23.990056 13092 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:23.990394 13293 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.991242 13092 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:23.974862 13246 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:24.009639  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.010599  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:24.006894  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:23.981915 13215 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.010241  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:23.998488 13246 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.015167  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.017319  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:23.961905 13274 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:24.001660 13092 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.990437 13244 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.024722  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:24.024889  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:24.026692  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.030100  8763 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:24.033294  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.012691 13228 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:24.033646  8145 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:24.025647 13246 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:24.118115  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 108854us
I20260709 12:23:24.009460 13303 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:23:24.090278  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.216414  8212 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:24.086900  8143 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 9.
W20260709 12:23:24.095270  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 89749.1us
W20260709 12:23:24.184304  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.191231  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 218616us
W20260709 12:23:24.114045  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.118620  8217 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:23:24.100852  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.102751  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:24.117337  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:24.211232  8142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2007) took 1704 ms (client timeout 2043 ms). Trace:
I20260709 12:23:24.247747  8061 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:24.102898  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1026) took 2328 ms. Trace:
I20260709 12:23:24.080566 13215 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:24.224211  8144 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:24.105248  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:24.102301  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.097801  8219 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:23:24.288657  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:24.283282  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.105894  8146 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:24.283893  8758 rpcz_store.cc:276] 0709 12:23:21.774858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.172826 (+397968us) service_pool.cc:224] Handling call
0709 12:23:23.656999 (+1484173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.658353 (+  1354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.102643 (+444290us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006702d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:24.102800 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3412080896}
I20260709 12:23:24.283226  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:24.034243 13274 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.192843 13226 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:24.041494 13029 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:24.303757  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.339600  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.286316  8142 rpcz_store.cc:269] 0709 12:23:22.475203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.475925 (+   722us) service_pool.cc:224] Handling call
0709 12:23:24.179718 (+1703793us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:24.179926 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837200128}
I20260709 12:23:24.307090  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:24.307926 13303 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:24.308204 13348 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.945s	user 0.002s	sys 0.000s
I20260709 12:23:24.344035  8759 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:24.344529 13192 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:24.111156 13302 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.212584 13214 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.347512  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.289204 13215 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.312418 13032 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:24.041851 12935 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.315050  8220 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:24.116407 13337 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.833s	user 0.002s	sys 0.000s
I20260709 12:23:24.356411  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:24.357115 13258 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:24.358026  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:24.358546 13171 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:24.359157 13171 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:24.360241 13171 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.352695 12942 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:24.361681 12942 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.363888 12942 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.364447 13363 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:24.366516  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.347718 13192 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.370021 13192 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.371423 13192 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:24.371821 13192 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:24.372206 13192 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:24.349948 13215 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:24.372938  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.375617 12996 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.348165 13214 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.377243  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3167) took 1583 ms. Trace:
I20260709 12:23:24.378757 13214 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.379390 13214 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:24.376379 12996 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.345799 13226 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:24.383646 13188 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Committing config change with OpId 9.7: config changed from index 3 to 7, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:24.347572  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:24.385901  8061 raft_consensus.cc:2393] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:24.297088 13244 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:24.387334 13244 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.389288 13032 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:24.389739 13032 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:24.390314 13244 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:24.311890  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 206721us
I20260709 12:23:24.390726 13032 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.392131 13032 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.388139  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.392975 13327 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:24.393783 13293 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:24.125747 13296 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:24.348943 13303 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.377626  8062 rpcz_store.cc:276] 0709 12:23:22.793682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.794196 (+   514us) service_pool.cc:224] Handling call
0709 12:23:22.803828 (+  9632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.940538 (+136710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.940586 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.951781 (+ 11195us) log.cc:844] Serialized 26 byte log entry
0709 12:23:23.152102 (+200321us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:23.152158 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.152245 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:24.115538 (+963293us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:24.376760 (+261222us) raft_consensus.cc:1685] finished
0709 12:23:24.376781 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.377066 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199051,"raft.queue_time_us":147833,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4237,"spinlock_wait_cycles":7587712,"thread_start_us":192681,"threads_started":1,"wal-append.queue_time_us":268356}
I20260709 12:23:24.314050 13208 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:24.379575  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 779) took 1646 ms. Trace:
W20260709 12:23:24.101192 13255 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:23:24.380210  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64399.2us
I20260709 12:23:24.381088 13214 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:24.342144  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.313630  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.380052 13340 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.383695 13226 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.428239  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:24.403590  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.395273 12996 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.400228 13303 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:24.435781  8186 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.438740 13141 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.424955 13214 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:24.441565  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:24.398056 13296 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:24.434521 12942 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:24.455354  8765 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:24.456717 13093 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.457192  8035 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.457770  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:24.458827 13362 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:23:24.460685 13327 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.461467 13327 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:24.462345 13312 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:24.462703 13312 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:24.462862 13182 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:24.463351 13182 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:24.463670 13312 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.465118  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.469746 13274 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.470306  8760 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:23:24.470764  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.470897  8144 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:23:24.471549  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.471807 13109 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.472393 13109 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.422183  8764 rpcz_store.cc:276] 0709 12:23:22.733523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.144054 (+410531us) service_pool.cc:224] Handling call
0709 12:23:23.144421 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:23.164042 (+ 19621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.164076 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:23.172587 (+  8511us) log.cc:844] Serialized 26 byte log entry
0709 12:23:23.268021 (+ 95434us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:23.268064 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.268136 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:24.307372 (+1039236us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:24.379113 (+ 71741us) raft_consensus.cc:1685] finished
0709 12:23:24.379135 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.379420 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21554,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14520,"spinlock_wait_cycles":11769088,"thread_start_us":71285,"threads_started":1,"wal-append.queue_time_us":143383}
I20260709 12:23:24.473073  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.473784 13312 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.473989 13289 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.474493 13255 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.474565 13289 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.475266 13255 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.476828 13208 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.478927  8146 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:24.479171 13215 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.478971 13208 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.508538  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.509264  8137 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:24.508477  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1034) took 1902 ms. Trace:
W20260709 12:23:24.510917  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 75738.1us
I20260709 12:23:24.510869  8760 rpcz_store.cc:276] 0709 12:23:22.606011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.607266 (+  1255us) service_pool.cc:224] Handling call
0709 12:23:22.607593 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.469778 (+1862185us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b54005ef720. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:24.470715 (+   937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.508148 (+ 37433us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003106d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:24.508394 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3683407104}
I20260709 12:23:24.513314 13096 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:24.514186  8061 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:24.514040 13184 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:23:24.515693 13184 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:24.515811  8070 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:24.517189  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:24.473718 13189 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:24.518160  8065 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.464435 13182 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.482004 12942 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.483531 13258 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.483893  8138 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:24.486826 13255 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.447232 13340 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.493629  8142 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:23:24.532233  8142 pending_rounds.cc:85] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:23:24.532539  8142 pending_rounds.cc:107] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:23:24.532856  8142 raft_consensus.cc:2889] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:24.533339  8142 pending_rounds.cc:107] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:23:24.533572  8142 raft_consensus.cc:2889] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:24.493775 12644 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:24.496052  8067 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:24.457405 13093 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.496796 13272 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.500164 13109 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.502480 13312 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:24.517387 13215 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.439400 13141 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.481002  8145 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:24.516381 13184 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:24.520103  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:24.581267  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 61876.2us
W20260709 12:23:24.542773  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.556777  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 198900us
I20260709 12:23:24.532780  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:24.563768  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.573717  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:24.557981  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.578208  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.578460  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.573818  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.521497 12996 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:24.569849 13105 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.007s
I20260709 12:23:24.532102 13216 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.566329 13154 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.597911  8070 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:24.598011  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.520104 13173 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:23:24.574396 12644 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:24.558254 13096 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:24.636282  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48281.9us
I20260709 12:23:24.636904  8143 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.596971  8137 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:24.644953  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.645720  8144 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:24.645630  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 188510us
W20260709 12:23:24.647101  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 149266us
I20260709 12:23:24.647981  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.648090  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.565366 13208 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:23:24.529692 13246 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.652186  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.601120 13293 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:24.587939 13226 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:24.587746 13092 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:24.579113 13258 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.680423  8142 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 10: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.592871 13289 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.644695 13312 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:24.689735  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.650170 12644 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:24.691664  8065 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:24.693850  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.655211 13182 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:24.698760  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 120392us
I20260709 12:23:24.701892  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.678231 13226 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:24.707494  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.672034 13293 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:24.708617  8144 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.598682 13216 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.710136  8140 raft_consensus.cc:2393] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.709761 13312 raft_consensus.cc:2764] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:24.715857  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.716140  8064 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:23:24.692811 13215 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:24.716827 13370 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:24.716969  8066 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:23:24.717535 13366 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:24.716997  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.715358  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.725454  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.729352 13312 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:24.730027 13184 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.726778  8064 pending_rounds.cc:85] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 7
I20260709 12:23:24.731537  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:24.700013 13188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37796 (request call id 2) took 23405 ms (client timeout 29999 ms). Trace:
I20260709 12:23:24.742764  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:24.742002 13188 rpcz_store.cc:269] 0709 12:23:01.280077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.734686 (+454609us) service_pool.cc:224] Handling call
0709 12:23:01.769284 (+ 34598us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b54007178a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca09520 00007f498ca92b42 00007f498ca91800 00007f498ca8a9fa 00007f4991a524c9 00007f498afcec54 00007f498afcebe2 00007f498afceb11 00007f498afcea8c 00007f498afcdd42
0709 12:23:01.903664 (+134380us) log.cc:844] Serialized 501 byte log entry
0709 12:23:02.653193 (+749529us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18002c8d20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:02.842113 (+188920us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b18002c8d20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498c9e5b0b 00007f498ca6ab63 00007f498ca92752 00007f498ca8a9fa
0709 12:23:24.674476 (+21832363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251777,"raft.queue_time_us":666047,"raft.run_cpu_time_us":2141,"raft.run_wall_time_us":122613,"spinlock_wait_cycles":44793344,"thread_start_us":277884,"threads_started":1,"wal-append.queue_time_us":448380,"wal-append.run_cpu_time_us":2944,"wal-append.run_wall_time_us":1098157}
I20260709 12:23:24.743861  8764 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:23:24.744107  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:24.674917 13154 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.738377  8220 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:24.739763  8064 pending_rounds.cc:107] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:23:24.713284 13226 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.738204  8142 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:24.763455  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.742162  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:24.765640  8064 raft_consensus.cc:2889] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:24.751091 13097 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.003s
I20260709 12:23:24.709211 13092 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.781544  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:24.779184  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.783561  8146 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:24.767779 13289 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:24.787959  8762 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:24.789068  8142 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:24.791570  8765 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:24.794145 13246 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.800973 13141 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:24.801849  8764 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:24.775825 13296 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.811309 13296 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.812053  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.823657  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.825284 13246 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.828044  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:24.830271 13258 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:24.834807  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 138175us
I20260709 12:23:24.769909 13215 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.794854 12644 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.772053 13192 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.841528  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:24.847781  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:24.855595  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 52729.8us
I20260709 12:23:24.811792 13340 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:24.846367  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 112676us
I20260709 12:23:24.847198 13258 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:24.864929  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 767edb8a304f440591a33aae36a36252 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 2)
W20260709 12:23:24.865090  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.867516  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 219583us
I20260709 12:23:24.843926 13293 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.871274 13293 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.872825 13312 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:24.889865  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.869172  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.893649  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:24.893826 13312 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:24.895308  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:24.896034  8065 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:24.898449 13154 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.899211 13215 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.914026 13192 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.861884 13093 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:24.920661 12644 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:24.847283 13303 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.922909 13303 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:24.924464 13092 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:24.926007  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 70930.8us
I20260709 12:23:24.926148 13284 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:24.927421  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 115441us
I20260709 12:23:24.928545  8035 leader_election.cc:400] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:24.931896  8035 leader_election.cc:403] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:24.901024  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.901327 13385 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:24.861747 13246 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:24.868736 13340 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:24.940791 13255 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:24.902493  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.942751  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.943048 13258 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:24.944043  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:24.943992 13258 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.944737  8764 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:24.905227 13382 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 12:23:24.946303  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.908839 13141 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.947149  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:24.909256 13377 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:24.865567 13096 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:24.910943 13327 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:24.937490 13187 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.938438 13244 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:24.939050  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45958.7us
I20260709 12:23:24.928829 13173 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.941082  8757 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:24.945422  8212 raft_consensus.cc:2955] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 3 to 7, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:24.936317  8063 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:24.905679 13214 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.947727  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.960762  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:24.953312  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.954062  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64284us
I20260709 12:23:24.962128  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.907888 13226 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.955204  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:24.948472 13340 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.949756 13215 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.983958  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.964259  8220 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:24.985766 13375 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:24.986761 13110 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.987171 13264 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:24.987614 13264 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.987747  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.988034 13264 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.989051  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:24.955109 13387 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:24.989813 13387 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:24.990206 13387 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:24.992093  7967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 254) took 23826 ms (client timeout 15000 ms). Trace:
I20260709 12:23:24.969110 13141 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:24.964260  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:24.965848  8070 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:23:24.958992 13343 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.969072 13096 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:24.968978  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68063.6us
I20260709 12:23:24.962307 13187 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:24.966464 13289 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:24.974542  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:24.981118  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:24.971720  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.972250 13372 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 12:23:24.975675 12942 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.983628 13192 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:24.969380  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:24.997478  8220 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:24.949561 13272 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:25.013473  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:25.004741 13096 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:25.006377 13244 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.016263 13289 consensus_queue.cc:1243] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:25.016989  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2018) took 2442 ms. Trace:
I20260709 12:23:25.017117 13343 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:25.018748  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 54566.9us
I20260709 12:23:25.019555 13255 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:25.028196  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.028194  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.029434  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.050797  8143 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:25.051614  8144 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:24.973923 13214 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:24.968825 13302 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.962558 13327 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.039927  8138 rpcz_store.cc:276] 0709 12:23:22.574636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.575837 (+  1201us) service_pool.cc:224] Handling call
0709 12:23:22.612139 (+ 36302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.526559 (+1914420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.016716 (+490157us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400043654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:25.016910 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4303443200}
I20260709 12:23:25.022478 12996 raft_consensus.cc:2764] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:25.019469 13246 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:25.025848 13226 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.034022 13097 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:25.058512  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.060719  8145 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:25.062388  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.004905 13189 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:23:25.064725  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:25.038724 13096 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:25.091996  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:25.053961  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.075867  8142 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:23:24.992491  7967 rpcz_store.cc:269] 0709 12:23:01.165166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.165373 (+   207us) service_pool.cc:224] Handling call
0709 12:23:24.991865 (+23826492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:14.678974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:14.679889 (+   915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:14.679957 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:23:14.679976 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:14.681569 (+  1593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:14.681682 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:14.681709 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:23:14.683275 (+  1566us) tablet.cc:701] Row locks acquired
0709 12:23:14.683326 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:23:14.683494 (+   168us) write_op.cc:270] Start()
0709 12:23:14.683654 (+   160us) write_op.cc:276] Timestamp: P: 1783599794683424 usec, L: 0
0709 12:23:14.683693 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:23:15.107521 (+423828us) log.cc:844] Serialized 6386 byte log entry
0709 12:23:16.407017 (+1299496us) op_driver.cc:464] REPLICATION: finished
0709 12:23:16.747165 (+340148us) write_op.cc:301] APPLY: starting
0709 12:23:16.755934 (+  8769us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.021889 (+265955us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.022048 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.700912 (+678864us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.701415 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:23:17.701524 (+   109us) write_op.cc:312] APPLY: finished
0709 12:23:17.701962 (+   438us) log.cc:844] Serialized 148 byte log entry
0709 12:23:17.872824 (+170862us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.873075 (+   251us) write_op.cc:454] Released schema lock
0709 12:23:17.873184 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.873728 (+   544us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.873768 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116547,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":232994,"apply.run_cpu_time_us":56350,"apply.run_wall_time_us":1192008,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71071,"num_ops":16,"prepare.queue_time_us":184503,"prepare.run_cpu_time_us":25345,"prepare.run_wall_time_us":1320922,"raft.queue_time_us":44832,"raft.run_cpu_time_us":16488,"raft.run_wall_time_us":167289,"replication_time_us":1696094,"thread_start_us":1122779,"threads_started":5,"wal-append.queue_time_us":1309181,"wal-append.run_cpu_time_us":18423,"wal-append.run_wall_time_us":2255155}]]}
I20260709 12:23:25.045559 13105 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.034327 13092 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:25.078140  8140 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:25.062422 13208 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.010782 13340 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:25.079188  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 104760us
I20260709 12:23:25.044597 13244 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:25.127270 13244 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.080322  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:25.010403 13264 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.074303  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.101815 13221 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.135232 13221 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.137544 13221 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.102869  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:25.103261  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:25.105652 13387 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.138739  8219 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:25.140111 13387 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.140761 13173 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.131156 12996 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.141434  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.142158 12996 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.143347  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.144172 13272 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.144500 13244 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.109380  8065 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:25.145901  8211 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:25.148550 13189 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:25.149235  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.148732 13244 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.150252  8068 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:25.150897  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.120258 13246 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:25.154703  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.122057  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68214.5us
I20260709 12:23:25.063820 13093 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:25.123196  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.123833  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:25.163160  8143 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:25.124641  8145 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:23:25.102886 13395 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:23:25.179512 13173 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:25.180104 13173 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.180510 13173 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.180899 13327 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.182018 13246 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:25.154582 13208 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.183835 13340 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.184163 13208 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.184909 13399 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.185551 13399 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.186791 13187 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.187309 13284 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:25.187716 13284 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:25.187960 13399 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.188797 13284 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.189724  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.169476  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:25.190248 13284 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:25.192061 13312 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:25.156243 12996 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.193475 12996 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:25.194235 13327 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:25.194394 12644 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:25.091722 13226 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.130709  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:25.131405  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:25.211359  8220 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:25.132098  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:25.144968 13272 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:23:25.120092  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46969.4us
I20260709 12:23:25.114696 13171 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:25.113822 13141 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.223754  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:25.108266  7964 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 7 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 8 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:23:25.158459  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84309.3us
W20260709 12:23:25.226166  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.168339  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.169276  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:25.113221 13302 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.216302  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:25.218569  8137 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:25.228288  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60066.9us
I20260709 12:23:25.161859 13093 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.248927  8763 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:25.249423  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:25.245366  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:25.247363  8730 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:25.260164  8066 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:25.263204  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:25.266618  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.253607  7964 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 8 to 9, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 9 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.279242  8070 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:25.279518  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:25.216285 13171 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:25.244671 13397 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.223356 13215 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:25.284282  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.253170 13141 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.251029 13187 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:25.288903  8217 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
W20260709 12:23:25.258791  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.540s (SENT) [suppressed 28 similar messages]
I20260709 12:23:25.312950  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:25.216993 13226 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.258116 13093 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:25.305821  8143 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:25.306644  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:25.300971  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:25.317498  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:25.321072  8764 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:25.261946 13398 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.323407  8220 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:25.324743  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.281867 13032 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:25.318995  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.328773  8760 raft_consensus.cc:1217] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-16.12]   Dedup: 12.10->[13.11-16.12]
I20260709 12:23:25.337029  8760 pending_rounds.cc:85] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Aborting all ops after (but not including) 10
I20260709 12:23:25.337334  8760 pending_rounds.cc:107] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:23:25.337651  8760 raft_consensus.cc:2889] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:25.329572  8140 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:23:25.284662 13188 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:25.297636 13171 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:25.305562 13110 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.340842  8138 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:25.332988  7964 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 7 to 9, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.361019  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.314149 13182 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:25.347316  8765 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:25.335170  8218 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:25.349018  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.355651  8213 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:25.357231  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.366707  8145 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:23:25.366946  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.295459 13385 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:23:25.318276 13375 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:25.312382 13296 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:25.334242  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 169824us
I20260709 12:23:25.319533 13397 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.368922  7964 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 4, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 4 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.367619  8063 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
W20260709 12:23:25.386284  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 162646us
W20260709 12:23:25.387718  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 195581us
I20260709 12:23:25.391724  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.317593 13141 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.394614  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:25.341177 13255 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:25.399242  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:25.406531  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105522us
I20260709 12:23:25.402848  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.356819 13221 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:25.389881 13216 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.399183 13398 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.417764  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.417999  8143 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:25.424232  8065 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:25.425443  8066 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:25.429188  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:25.429922  8063 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:25.431380 13226 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.435084  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:25.435927  8219 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:25.432406 13398 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.462092 13401 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:25.468986  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:25.487058  8765 raft_consensus.cc:606] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:25.391980 13110 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.478154  7964 catalog_manager.cc:5697] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 4 to 6, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 6 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:23:25.481123 13396 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 12:23:25.502384  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81377.2us
I20260709 12:23:25.432129 13272 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:25.421126 13312 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:23:25.410400 13182 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.484184  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.497982  8765 raft_consensus.cc:614] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:25.509721  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.498548  8219 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:25.498914  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 172129us
I20260709 12:23:25.499145  8139 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:25.420849 13258 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:25.512336  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:25.504002  7964 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 6 to 8, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.515197  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:25.489859  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 231086us
I20260709 12:23:25.438527 13264 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.521950  8070 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:23:25.527873  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43753.6us
I20260709 12:23:25.532790  7964 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 6 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.432498 13092 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:23:25.424757 13399 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:23:25.507659 13272 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:25.511798 13105 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:25.538609  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.514920 13296 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:25.513602 13188 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:25.535868 13409 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:23:25.515508 13182 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.548156 13215 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.547286 13327 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:25.549151 12996 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:25.543834 13302 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.561877 13105 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:25.587013  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 57805.5us
W20260709 12:23:25.586453  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47036.5us
I20260709 12:23:25.594784  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.554062 13340 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:23:25.597931 13182 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:25.598342 13411 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:25.599527 13411 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:25.599898 13411 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:25.602145  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:25.602787  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:25.604548 13399 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.605180 13399 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.606614 13096 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.609141  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:25.611606 13110 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:25.562153 13255 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.615777 13272 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.616945 13272 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:25.621500 13400 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:25.586845 12996 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:25.622157 13188 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.623373 12996 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.624800 13215 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.625348 13173 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.627259 13215 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.602866 13397 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:25.629259 13141 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.629402 13415 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:25.550022 13385 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:23:25.630012 13415 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:25.630995 13415 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.631562 13343 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:25.632411  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51501us
I20260709 12:23:25.633683  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:25.635185  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:25.637013 13393 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.389s	user 0.000s	sys 0.005s
I20260709 12:23:25.637809 13398 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.638317  7964 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 7 to 8, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 8 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.639158 13399 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.639611 13171 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.620158 13093 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.645668  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:25.612351 13110 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:25.585716 13327 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.659735 13327 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:25.660868  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 247824us
I20260709 12:23:25.661906  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:25.663105  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:25.663395 13284 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:25.664068 13097 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.006s
W20260709 12:23:25.648814  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54102.4us
I20260709 12:23:25.628473 13173 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:25.650297  8762 raft_consensus.cc:606] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:25.636546  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.653409 13399 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:25.654045 13413 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:23:25.653895  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:25.655385 13414 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:23:25.592311 13387 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:25.656061 13412 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:23:25.663990 13284 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:25.557875 13296 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.595399  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:25.665465  7964 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:23:25.689266  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 94264.7us
W20260709 12:23:25.731068  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.748546  8139 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:23:25.753392  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 214853us
W20260709 12:23:25.748906  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 84626.9us
I20260709 12:23:25.767656  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.768447  8139 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:25.769500  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.770296  8139 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:25.771494  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:25.772192  8139 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.774233 12996 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:25.685104  8214 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:25.672031 13097 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.687340  8061 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:25.651588 13226 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:23:25.651563 13110 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.670504 13182 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.785548  7964 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 6 to 9, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 9 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.788987  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:25.797372 13413 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:25.796492  8139 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:25.802152  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:25.687789 13105 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:25.730345 13154 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.753465 13141 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:25.841342  8218 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:25.763713 13375 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:25.684227 13401 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:25.667730  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.814422  7964 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:23:25.815773  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46442.8us
I20260709 12:23:25.671815 13184 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 12:23:25.841135  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.813666 13110 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:25.854079  7964 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 6 to 7, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 7 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:25.672226 12644 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
W20260709 12:23:25.849965  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 182338us
I20260709 12:23:25.776713 13264 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 12:23:25.852443  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50365.1us
W20260709 12:23:25.852701  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63784.6us
I20260709 12:23:25.859479  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:25.841356 13105 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.847306 13429 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:25.811589 13385 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:25.930965 13429 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.931449 13429 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:25.859862  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.744738 13411 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.853377 13258 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:25.932562  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72796.5us
I20260709 12:23:25.933879 13340 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:25.933681 13258 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:25.879455 13312 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:25.937042 13312 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:25.937677 13312 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:25.926994 13093 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:25.899783  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:25.933699  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:25.943809 13385 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:25.945127  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.973148  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 336664us
I20260709 12:23:25.880136 13428 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:25.880679 13398 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.858645 13255 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:23:25.921470 13105 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:25.997171 13414 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:23:25.858916 13284 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.025298 13436 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:26.025578  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 125897us
I20260709 12:23:25.996580 13428 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:26.026166 13436 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:26.027383 13436 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.032888  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.038035  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.038954  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.027542 13428 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.041034  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.014463 13189 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.009322 13402 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:26.023217 13420 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:26.052448  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.054301  8062 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.989636 13141 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:26.053313  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.061059  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.128168 13440 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.128938 13440 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:26.128490 13421 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:23:26.132337 13438 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:26.058913 13401 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.139230 13411 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.143450 13228 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.144006 13228 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:26.145287 13228 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.155016  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.156473  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:26.157238 13437 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.179s	user 0.000s	sys 0.004s
I20260709 12:23:26.157747  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.158380  8065 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:26.159277  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.160091  8065 raft_consensus.cc:2410] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:23:26.160161  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 950) took 1148 ms. Trace:
I20260709 12:23:26.059206 13296 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:26.173189  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2096) took 1019 ms. Trace:
I20260709 12:23:26.178990  8062 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:23:26.164893 13327 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.161422  8141 rpcz_store.cc:276] 0709 12:23:25.012098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.012210 (+   112us) service_pool.cc:224] Handling call
0709 12:23:25.030417 (+ 18207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.101294 (+ 70877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.101360 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.127693 (+ 26333us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.387319 (+259626us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:25.387373 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.387460 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.149953 (+762493us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b24000fb3a8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:23:26.159799 (+  9846us) raft_consensus.cc:1685] finished
0709 12:23:26.159824 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.160073 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48019,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":81125760,"thread_start_us":329530,"threads_started":2,"wal-append.queue_time_us":415430}
I20260709 12:23:26.189610  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.191128  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.192520  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.193634  8061 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:26.195164  8065 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:26.201787  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.203378  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.176985  8068 rpcz_store.cc:276] 0709 12:23:25.154047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.198636 (+ 44589us) service_pool.cc:224] Handling call
0709 12:23:25.222387 (+ 23751us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:25.280248 (+ 57861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.280277 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:25.306319 (+ 26042us) log.cc:844] Serialized 52 byte log entry
0709 12:23:25.524264 (+217945us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:25.749114 (+224850us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.172922 (+423808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.172984 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.173017 (+    33us) raft_consensus.cc:1685] finished
0709 12:23:26.173025 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.173138 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8932,"prepare.queue_time_us":49115,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":231990,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":62901,"thread_start_us":744840,"threads_started":3,"wal-append.queue_time_us":247738}
I20260709 12:23:26.160238 13312 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.062229 13189 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.180460 13258 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:26.057535 13402 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.217957 13387 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:26.257848  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:26.264758  8145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.008s
W20260709 12:23:26.265386  8145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.000s	sys 0.008s
I20260709 12:23:26.267016  8067 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:26.265169  8068 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:23:26.260944 13192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.008s	sys 0.000s
I20260709 12:23:26.267117 13141 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.258203 13387 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.286572  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.290853  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.301003  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.302974  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:26.278410 13192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.008s	sys 0.000s
I20260709 12:23:26.310540  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.311182  8062 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:26.311826  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.312566  8065 raft_consensus.cc:2393] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:26.317322  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 707566us
I20260709 12:23:26.318090  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.320182  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.311300  8066 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:26.257767 13258 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.310774 13255 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.328933  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:26.331521  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.331540  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.331755  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:26.336089  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.337721  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.346066  8730 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:26.318343 13105 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.313905 13214 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:26.355830  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.357597  8066 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:26.359041  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.355086  8065 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:26.363065  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:26.366097  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:26.368978  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.325730 13467 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:26.401383  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:26.425050  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:26.426076  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:26.350827 13447 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.443553  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.466111  8212 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:26.467120  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 91614.9us
I20260709 12:23:26.468788 13340 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:26.445431  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 143003us
I20260709 12:23:26.359078 13418 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:26.469473 13340 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.469988 13418 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:26.470433 13418 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.472054 13340 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.473029  8065 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:26.473742  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.377460 13302 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:26.477957  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 797) took 1184 ms. Trace:
I20260709 12:23:26.476567  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.481256  8762 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:26.478159  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.483637  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:26.484656 13458 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:26.485255 13189 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:26.486375 13448 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:23:26.486763  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.487713 13439 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:26.487888  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.488335 13439 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.488456  8065 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:26.489418  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:26.489506  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:26.351661 13255 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.489013  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:26.477682  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:26.501670  8765 raft_consensus.cc:2393] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:26.465238 13188 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.505594  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.507318  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:26.478377  8760 rpcz_store.cc:276] 0709 12:23:25.293613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.301632 (+  8019us) service_pool.cc:224] Handling call
0709 12:23:25.328489 (+ 26857us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:23:25.349854 (+ 21365us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:25.386101 (+ 36247us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.465502 (+ 79401us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180012a180. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:25.524616 (+ 59114us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.633195 (+108579us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b180012a180. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:26.277261 (+644066us) spinlock_profiling.cc:243] Waited 970 us on lock 0x7b180012a180. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:23:26.277456 (+   195us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:26.289026 (+ 11570us) log.cc:844] Serialized 52 byte log entry
0709 12:23:26.293691 (+  4665us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:26.293763 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.293848 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.477722 (+183874us) raft_consensus.cc:1685] finished
0709 12:23:26.477742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.477895 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757170,"prepare.queue_time_us":37030,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3167,"raft.queue_time_us":793217,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":18146,"spinlock_wait_cycles":15099264,"thread_start_us":110315,"threads_started":1,"wal-append.queue_time_us":260457}
I20260709 12:23:26.538077  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.539639  8763 raft_consensus.cc:2368] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:26.540791  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.519199  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.427011 13214 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.489935 13093 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:26.501696 13272 consensus_meta.cc:287] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.001s
I20260709 12:23:26.552382  8765 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:26.560274 13453 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:23:26.562106 13451 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:26.553068  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.513801 13215 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.480712 13302 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.502056 12996 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.444151 13467 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.567452  8070 raft_consensus.cc:2410] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:23:26.538372 13097 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.506696 13188 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:26.558888 13244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.016s	sys 0.005s
I20260709 12:23:26.572296  8765 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:26.573278  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.574920  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:26.567787 13215 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.579188 13426 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:26.579705 13457 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:26.476944 13447 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.553561 13402 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:26.589066  8142 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:26.593443  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3218) took 1283 ms. Trace:
I20260709 12:23:26.594383  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 826) took 1054 ms. Trace:
I20260709 12:23:26.567268 13093 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:26.596025 13425 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.751s	user 0.001s	sys 0.001s
I20260709 12:23:26.597745  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2065) took 1161 ms. Trace:
I20260709 12:23:26.556952 13312 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:26.601640 13258 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.622184 13188 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.556981 13173 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.621079 13105 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:26.623548 13255 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:26.568904 13302 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.647156  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.650187  8214 rpcz_store.cc:276] 0709 12:23:25.309774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.310827 (+  1053us) service_pool.cc:224] Handling call
0709 12:23:25.339683 (+ 28856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.797561 (+457878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.593142 (+795581us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540017cfd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:26.593338 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793839872}
I20260709 12:23:26.643065 13215 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.728875  8063 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:26.729417  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.630627 13244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.017s	sys 0.005s
I20260709 12:23:26.711723  8212 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
W20260709 12:23:26.602608 13110 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.001s
I20260709 12:23:26.718748  8144 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:26.650341  8761 rpcz_store.cc:276] 0709 12:23:25.540484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.540684 (+   200us) service_pool.cc:224] Handling call
0709 12:23:25.553699 (+ 13015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.290104 (+736405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.290140 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.310597 (+ 20457us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.493175 (+182578us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.493242 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.493334 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.594156 (+100822us) raft_consensus.cc:1685] finished
0709 12:23:26.594179 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.594326 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751624,"raft.queue_time_us":739066,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":22944,"thread_start_us":140493,"threads_started":1,"wal-append.queue_time_us":261822}
I20260709 12:23:26.731381  8070 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:26.628120 13439 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:26.652388  8138 rpcz_store.cc:276] 0709 12:23:25.436472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.468361 (+ 31889us) service_pool.cc:224] Handling call
0709 12:23:25.482729 (+ 14368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.789715 (+306986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.789765 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.815173 (+ 25408us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.294921 (+479748us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.467761 (+172840us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.501319 (+ 33558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.501417 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.587639 (+ 86222us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4800011058. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f49919acb37 00007f49919ac9ca 00007f4991aa426f 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508 00007f4991ab8488 00007f4991ab8443 00007f4991ab76ec 00007f49909e1a96
0709 12:23:26.597351 (+  9712us) raft_consensus.cc:1685] finished
0709 12:23:26.597492 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.597671 (+   179us) inbound_call.cc:177] Queueing success response
0709 12:23:26.624888 (+ 27217us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b18003d6900. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
Metrics: {"mutex_wait_us":214580,"prepare.queue_time_us":245897,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":312213,"raft.run_cpu_time_us":3696,"raft.run_wall_time_us":845188,"spinlock_wait_cycles":37585024,"thread_start_us":690423,"threads_started":3,"wal-append.queue_time_us":663877}
I20260709 12:23:26.732265  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:26.733311 13343 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.746131  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.746546  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3214) took 1653 ms. Trace:
I20260709 12:23:26.766801  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:26.765048  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.767046  8216 rpcz_store.cc:276] 0709 12:23:25.093058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.093191 (+   133us) service_pool.cc:224] Handling call
0709 12:23:25.121727 (+ 28536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.196304 (+ 74577us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:25.196337 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.196899 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.587771 (+390872us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:25.587817 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.587891 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.595293 (+1007402us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:26.746181 (+150888us) raft_consensus.cc:1685] finished
0709 12:23:26.746205 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.746466 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61508,"raft.queue_time_us":62189,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":99,"spinlock_wait_cycles":8843136,"thread_start_us":382442,"threads_started":1,"wal-append.queue_time_us":547560}
I20260709 12:23:26.770035 13426 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.773413 13289 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:26.774732  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:26.775102  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2064) took 1339 ms. Trace:
I20260709 12:23:26.775972  8730 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:26.777012  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.778136  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:26.778767  8144 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:26.779902  8142 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:26.777060 13312 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.780967  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:26.781538 13312 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.782480 13093 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:26.783058 13093 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:26.783494  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:26.783660 13093 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:26.744977 13105 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:26.747442  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:26.785188  8069 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:23:26.785351  8216 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:26.734396 13110 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.728395 13415 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:26.753808 13214 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.754770 13173 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:26.756253 13428 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:26.728149 13189 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.757478 13302 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.757962 13447 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:26.761682 13467 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:26.736907 13187 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.918171 13187 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.784276 13312 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:26.780803  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:26.788182  8063 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:26.775454  8145 rpcz_store.cc:276] 0709 12:23:25.435937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.466966 (+ 31029us) service_pool.cc:224] Handling call
0709 12:23:25.467483 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.272500 (+805017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.272538 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.314259 (+ 41721us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.549688 (+235429us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.549725 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.549815 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.774801 (+224986us) raft_consensus.cc:1685] finished
0709 12:23:26.774821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.775042 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194721,"raft.queue_time_us":258441,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13633,"thread_start_us":775754,"threads_started":2,"wal-append.queue_time_us":409126}
I20260709 12:23:26.895344 13343 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:26.883551 13431 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:26.915055 13097 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:26.916095  8065 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:23:26.922118  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.922955  8061 raft_consensus.cc:2368] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16.
W20260709 12:23:26.936777  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 156056us
I20260709 12:23:26.949774  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:26.856469 13289 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.978143  8069 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:23:26.978789  8069 pending_rounds.cc:85] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 9
I20260709 12:23:26.979627  8069 pending_rounds.cc:107] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:23:26.979943  8069 raft_consensus.cc:2889] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:26.922024 13173 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:26.981952  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:26.985432  8065 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:26.942552 13387 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.647s	user 0.018s	sys 0.002s
I20260709 12:23:26.938037 13093 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:26.921263 12942 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 12:23:26.978217 13411 consensus_meta.cc:287] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.006s
I20260709 12:23:26.855691 13415 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:26.994635  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 262458us
I20260709 12:23:26.954716 13289 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:26.976554 13467 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.922646 13189 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.010893  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:27.014659  8765 raft_consensus.cc:606] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:27.015057  8765 raft_consensus.cc:614] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:27.017253  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:26.951639 13431 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.009811 13289 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:27.032791  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:27.033706  8765 raft_consensus.cc:606] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:27.034186  8765 raft_consensus.cc:614] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:27.036098 13173 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.041173 13187 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.046281 13289 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.050839 13343 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.051229 13411 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.051993 13411 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.054719 13411 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:27.073628  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56494.9us
I20260709 12:23:26.996466 13097 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:27.088939  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.136343  8062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:27.150460  8062 raft_consensus.cc:606] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:27.151003  8062 raft_consensus.cc:614] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:27.023680 13418 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.553s	user 0.016s	sys 0.005s
I20260709 12:23:27.149328  8064 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
W20260709 12:23:27.155407  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 378809us
I20260709 12:23:27.015138 13398 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:27.076269 13477 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:23:27.129804 13442 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:27.007340 13387 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.092559 13419 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:27.176052  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:27.231508  8064 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.231389 13419 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.184115  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:27.237277  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53255.6us
I20260709 12:23:27.238752  8109 leader_election.cc:400] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:27.236493  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.075596 13467 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.193718 13312 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.194669 13430 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.196409 13216 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.197639  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:27.199457 13171 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.202108 13289 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.202358 13110 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.200412  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 822) took 1066 ms. Trace:
I20260709 12:23:27.258860  8061 rpcz_store.cc:276] 0709 12:23:26.133939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.203058 (+ 69119us) service_pool.cc:224] Handling call
0709 12:23:27.200204 (+997146us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54001937d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:27.200350 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652621568}
I20260709 12:23:27.260154  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.261528  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.262131  8061 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:27.262935  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.263470  8061 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:23:27.263867 13188 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 12:23:27.265396 13189 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.266757 13431 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.241006 13302 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.275997 13467 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.208161  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.209344  8141 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:27.213752 13096 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.218516 13415 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.221536 13184 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:27.224211 13449 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:27.172721 13411 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.298000  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.239312  8109 leader_election.cc:403] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:27.190407  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 816) took 1141 ms. Trace:
I20260709 12:23:27.023008 13244 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:23:27.204873 13442 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:27.250991  8145 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:27.160666 13418 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.253997  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:27.245574 13462 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.746s	user 0.007s	sys 0.007s
W20260709 12:23:27.257113 13454 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.771s	user 0.000s	sys 0.013s
I20260709 12:23:27.255467 13216 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.250581 13343 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:27.169200 13426 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:27.250968 13312 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:27.273308 13429 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.341s	user 0.022s	sys 0.000s
I20260709 12:23:27.264298 13188 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.207499  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.247032 13255 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:27.278445  8064 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:27.278332  8142 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 9.
I20260709 12:23:27.264328  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.303079 13096 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.330516  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.331321  8764 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:27.328325  8762 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:27.245905  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.327214  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:27.333491  8214 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.303680 13214 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:27.171782 13398 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:27.302057  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 63449.2us
I20260709 12:23:27.299857  8067 rpcz_store.cc:276] 0709 12:23:26.049136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.049285 (+   149us) service_pool.cc:224] Handling call
0709 12:23:26.049656 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.267583 (+217927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.190137 (+922554us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003214d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:27.190345 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499237760}
I20260709 12:23:27.298849  8211 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:27.247483 13419 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.306233  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.254944 13215 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.293655 13415 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.298599 13289 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.324915  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:27.281385  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:27.326464  8756 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:23:27.349735  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68429.7us
I20260709 12:23:27.285068 13440 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.299504 13184 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.339237  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.340772  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:27.378216  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:27.313277 13097 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.341002  8064 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:27.378818  8062 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:27.343124  8061 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:23:27.379611  8061 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 6
I20260709 12:23:27.379885  8061 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:23:27.380203  8061 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:27.341907  8216 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 10.
I20260709 12:23:27.322984 13484 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:27.331400 13255 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.303135 13411 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.336805 13375 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:27.351600  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2115) took 1028 ms. Trace:
I20260709 12:23:27.351665  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.353569 13173 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.340205 13096 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.359983 13093 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:27.361332  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.362171 13216 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.447084  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.448187  8756 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:27.448874  8211 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:27.364085 13418 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.366253 13312 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.368769 13188 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.370465 13302 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:27.373764  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:27.382107  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.384997  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:27.322711 13343 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:27.388927  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.456493  8062 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:27.398259  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.377609  8758 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:27.413026  8757 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:23:27.332696 13429 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.429639  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.386458 13431 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.471796  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:27.455176  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81494.6us
I20260709 12:23:27.415359 12644 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:27.476524  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 127987us
I20260709 12:23:27.477774  8219 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:27.478888  8213 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:27.476039  8218 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:27.430191 13255 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:27.434091  8070 rpcz_store.cc:276] 0709 12:23:26.323334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.834056 (+510722us) service_pool.cc:224] Handling call
0709 12:23:26.934380 (+100324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.940387 (+  6007us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:26.940732 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 12:23:27.351258 (+410526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:27.351321 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:27.351371 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.351434 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.351546 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3784,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":25923,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":33980,"thread_start_us":410065,"threads_started":1}
I20260709 12:23:27.351788 13415 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.483989  8219 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.385807 13141 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:27.450819 13171 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.491394  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:27.492254  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:27.533147  8220 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:27.493440  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:27.521998  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.525044  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.378670 13289 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.485517  8760 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:27.536175  8217 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:27.450275 13173 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.253094 13430 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.538298  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:27.539255  8143 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:27.539844  8211 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 10: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:27.539119  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45819.4us
I20260709 12:23:27.384577 13097 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.475728 13419 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.480446 13387 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.481108 13312 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.304425 13449 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.481488 13488 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.584690 13488 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.585240 13488 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:27.585451 13487 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:23:27.586369  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.586499 13246 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:27.587093  8756 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:27.588214 13208 raft_consensus.cc:993] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:23:27.589169 13096 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:27.590062 13483 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 12:23:27.532537 13216 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:27.590620  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2110) took 1269 ms. Trace:
I20260709 12:23:27.430003 13484 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.588194  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.593355  8756 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:27.591063  8066 rpcz_store.cc:276] 0709 12:23:26.321649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.778400 (+456751us) service_pool.cc:224] Handling call
0709 12:23:26.778784 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:26.834216 (+ 55432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.834254 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:26.952524 (+118270us) log.cc:844] Serialized 52 byte log entry
0709 12:23:27.232871 (+280347us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:27.232919 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.232994 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.590369 (+357375us) raft_consensus.cc:1685] finished
0709 12:23:27.590399 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.590563 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32362,"raft.queue_time_us":7413,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":68053,"thread_start_us":249719,"threads_started":1,"wal-append.queue_time_us":357589}
I20260709 12:23:27.550050 13182 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:27.576742 13482 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:27.528539 13110 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:27.483584 13385 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.584475 13438 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:27.571096  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:27.645578  8764 raft_consensus.cc:2368] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:27.647267  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:27.648515  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:27.571233  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.561276 13293 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:27.484292 12644 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.464248 13375 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.578974 13244 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:23:27.604637  8066 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:27.654141  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1052) took 1132 ms. Trace:
I20260709 12:23:27.605947  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:27.683914  8762 rpcz_store.cc:276] 0709 12:23:26.509084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.509252 (+   168us) service_pool.cc:224] Handling call
0709 12:23:27.641737 (+1132485us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54004c2f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:27.641858 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809444096}
I20260709 12:23:27.455247 13442 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.613545  8070 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:27.614566  8062 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:27.617715 13436 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.619908 13415 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.619767  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.621341 13228 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:27.676874  8137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2057) took 2366 ms (client timeout 1698 ms). Trace:
I20260709 12:23:27.623381  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:27.624941  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.624640 13093 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:27.625671  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:27.624310  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.628489  8145 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
W20260709 12:23:27.628873  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.702965  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:27.634559  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.634924  8219 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:27.703963  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.640524  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3197) took 1368 ms. Trace:
I20260709 12:23:27.707795  8063 rpcz_store.cc:276] 0709 12:23:26.272476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.320960 (+ 48484us) service_pool.cc:224] Handling call
0709 12:23:27.640317 (+1319357us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:27.640457 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897533824}
I20260709 12:23:27.641719  8220 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:27.642987 13444 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.542831 13171 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.541636 13141 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.597374 13302 raft_consensus.cc:1081] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:23:27.652308  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:27.706187  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:27.593989 13312 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.560643 13105 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.705513  8139 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:27.707954  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:27.705049  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 81763.3us
I20260709 12:23:27.598766 13216 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.728404  8759 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:27.708779  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.651062 13430 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.704991  8140 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:27.647053 13327 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.650431 13431 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:27.601531  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:27.651295  8214 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:27.721755  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.721848  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:27.647684 13284 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:27.704150  8137 rpcz_store.cc:269] 0709 12:23:25.285030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.318270 (+ 33240us) service_pool.cc:224] Handling call
0709 12:23:27.634437 (+2316167us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002f1a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:27.650869 (+ 16432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150158080}
I20260709 12:23:27.651832 13246 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.730006  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:27.659420 13182 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.651958 13440 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:27.685642 13192 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:27.648052 13110 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.748767  8211 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:27.752419  8215 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 9.
I20260709 12:23:27.754727 13411 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.754364 13431 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.756472 13484 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.757874  8759 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:27.748195 13430 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.767308 13284 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.768726  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:27.822053  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53433.7us
I20260709 12:23:27.823015  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:27.732110 13500 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:27.750617 13215 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:27.771541 13485 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.507s	user 0.000s	sys 0.007s
I20260709 12:23:27.773013 13105 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.773195 13343 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.774718 13171 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.775616 13289 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.683238 13293 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.750861 13398 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.779515 13097 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:27.816442  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 276420us
I20260709 12:23:27.644234 13482 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.888659 13482 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.844496 13192 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.862191 13171 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.889578 13192 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.890132 13171 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.891846 13192 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.892170 13171 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.743692 13447 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:27.660580 13385 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.895718 13293 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.788468 13488 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.707854 13436 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.844767  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 829) took 1293 ms. Trace:
I20260709 12:23:27.777755 13499 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:27.821105 13498 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 12:23:27.815456 13438 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:27.857643  8062 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.903442  8760 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:27.801738 13440 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.777640 13246 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.882071  8731 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:27.902648  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2202) took 1123 ms. Trace:
I20260709 12:23:27.882831 13284 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.884459  8759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:27.885365 13216 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.896880  8139 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:27.960582  8759 raft_consensus.cc:606] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:27.961017  8759 raft_consensus.cc:614] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:27.838186 13302 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:27.724334 13444 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.845993 13484 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:27.895807 13447 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.900614  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:27.899262  8757 rpcz_store.cc:276] 0709 12:23:26.551639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.551799 (+   160us) service_pool.cc:224] Handling call
0709 12:23:26.559487 (+  7688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:27.471221 (+911734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.840501 (+369280us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54005eecd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:27.844700 (+  4199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899560192}
I20260709 12:23:27.789831 13182 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.859311  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:27.817519 13184 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.934106 13499 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:27.961264 13449 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:27.947952  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:27.980396  8061 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:27.949704 13429 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:27.951973  8141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2189) took 1465 ms (client timeout 1825 ms). Trace:
W20260709 12:23:27.983716  8141 rpcz_store.cc:269] 0709 12:23:26.486240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.488726 (+  2486us) service_pool.cc:224] Handling call
0709 12:23:27.951800 (+1463074us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400312754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:27.951909 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624680320}
W20260709 12:23:27.958441  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 76474.6us
I20260709 12:23:27.985416  8731 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:27.899134 13411 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:23:27.978430 13284 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:27.977175 13484 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:27.933095 13481 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:27.901975 13289 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:27.971525  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70988.8us
I20260709 12:23:27.929035 13428 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.002043 13428 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.004242 13428 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:27.944154 13312 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:27.857337 13105 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:27.946602  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.009691  8067 raft_consensus.cc:2368] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:27.965883 13208 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:27.929066  8146 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:27.974416 13387 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:27.845737 13430 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.001253  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:28.014585 13484 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:27.997779 13284 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.016896 13284 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:28.018354 13430 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:28.001099 13289 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:27.973527  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 114303us
I20260709 12:23:27.997594  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:27.933704  8144 rpcz_store.cc:276] 0709 12:23:26.778755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.779535 (+   780us) service_pool.cc:224] Handling call
0709 12:23:26.779830 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.780191 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.780218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.784382 (+  4164us) log.cc:844] Serialized 26 byte log entry
0709 12:23:27.133855 (+349473us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:27.134044 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.134381 (+   337us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.770975 (+636594us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:27.897645 (+126670us) raft_consensus.cc:1685] finished
0709 12:23:27.897667 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.902582 (+  4915us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2100,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":50711296,"thread_start_us":348108,"threads_started":1,"wal-append.queue_time_us":464070}
W20260709 12:23:28.005839  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 315938us
I20260709 12:23:27.994640 13385 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.031247  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:28.007169  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 358721us
I20260709 12:23:27.973788 13255 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.008646  8062 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:28.010309  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:27.989583 12644 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:28.046347 13431 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.047534 13440 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.048404 13255 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.004886 13503 raft_consensus.cc:2804] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:28.049695 13503 raft_consensus.cc:697] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:28.050796 13503 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.035781  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.037307  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.036821 13449 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:23:28.036988 13430 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.040427  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.041982 13504 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:28.068578  8141 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:28.009907 13375 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.044029 13182 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.044695 13499 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.045223 13428 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.048496 13436 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.034267  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.078408  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.079056  8139 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:28.078938  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45351.1us
I20260709 12:23:28.056810  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:28.080862  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 421112us
I20260709 12:23:28.081656  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:28.072911  8067 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:28.021538 13387 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.080205  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.089804  8068 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:28.090083  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.091116  8146 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:28.110416  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.111099  8141 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:28.092772 13189 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.093461 13255 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:28.052383 13110 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.068109 13430 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.070802 13431 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.096166  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.104426  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:28.073442  8184 leader_election.cc:400] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:28.108733  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.148079  8139 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:28.087237 13387 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.088780 13375 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:28.150290  8184 leader_election.cc:403] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.086508 13428 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.103369 13488 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:28.149717  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45354us
I20260709 12:23:28.171286 13500 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:28.175038 13431 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.120709 13189 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.176939 13516 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.125715 13430 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:28.178303  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82214.6us
I20260709 12:23:28.179275  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:28.180223 13516 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:28.180846 13516 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:28.182017 13516 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.186012  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.188264  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:28.188755  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 122509us
I20260709 12:23:28.193732  8061 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
W20260709 12:23:28.197754  8143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.006s
W20260709 12:23:28.198387  8143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.008s	sys 0.006s
I20260709 12:23:28.204598  8067 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.218010  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.150738 13246 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.151155 13429 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:28.229424  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.230268  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.247069  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.247668  8061 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.200924 13255 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:28.251803  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.252810  8063 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:28.254082  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.255589  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.256124  8063 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.262784  8212 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:23:28.266120  8212 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:23:28.268764  8065 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.015s
W20260709 12:23:28.269721  8065 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.010s	sys 0.015s
I20260709 12:23:28.242844 13375 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:28.226891 13512 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.281528  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.282483  8211 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:28.277351  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48004.4us
I20260709 12:23:28.283607  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:28.290952  8063 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:28.291421  8211 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:28.279261  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 96621.2us
I20260709 12:23:28.293521  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.294495  8220 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:28.257669 13440 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:23:28.272367 13511 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:28.292738  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.298312  8063 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.295951  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.278616 13375 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.301666  8061 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:28.302062  8214 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:28.307253  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.308794  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.311266  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.312251  8219 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:28.314468  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.315826  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.289271 13510 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:28.316932  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.319717  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:28.320539  8217 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:28.320824  8220 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:28.293434 13289 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.318480  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.322400  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:28.328456  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.360934  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.359511  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.320319 13510 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.394495 13510 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.303347 13512 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:28.308480 13375 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:28.357329  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.022s
I20260709 12:23:28.395910  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:28.367434  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.370450  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.352980  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.362802  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.373356  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.358974 13449 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:28.379132  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.323330 13246 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:23:28.381822  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2112) took 2059 ms. Trace:
I20260709 12:23:28.383347 13173 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.384617  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.385510 13509 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.386358 13141 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.426957  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.427874  8061 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:28.361465 13244 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
W20260709 12:23:28.390775 13519 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:23:28.391573 13506 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:23:28.397182 13512 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.312043 13255 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:23:28.406428  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.008s	sys 0.022s
I20260709 12:23:28.364586  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.410331  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.442580  8220 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:28.325626 13442 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:23:28.411527  8214 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 11: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:28.411935  8068 rpcz_store.cc:276] 0709 12:23:26.322363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.346328 (+ 23965us) service_pool.cc:224] Handling call
0709 12:23:28.381655 (+2035327us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54003962d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:28.381761 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3961973632}
I20260709 12:23:28.415946  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:28.413945 13436 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:28.447045  8217 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:28.393316 13428 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:28.389936 13523 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:23:28.424513 13509 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:28.391866 13447 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.439471  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.442474  8062 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:28.459434  8216 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:28.459946  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.380805 13398 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.460445  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.415235 13449 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:28.428352  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.456969  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.457921  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.437112 13511 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:28.460580  8062 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.461108  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.405669 13401 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:23:28.463001  8184 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.467337  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.463904  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.472527  8220 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:28.446565 13436 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:28.442965 13512 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.475939  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:28.454578 13105 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.495990  8062 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
W20260709 12:23:28.497931 13531 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:23:28.465832 13509 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.460831 13398 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:28.503537  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.504704  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.456554 13214 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.505098  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.475839 13411 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.475165 13244 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.507472 13327 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.525136  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.476393 13436 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.481192 13293 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:28.517690 13532 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:23:28.518564 13520 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:23:28.505403 13401 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:28.519312 13524 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:23:28.488161 13511 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:28.487644 13503 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.531005  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.508136 13398 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.512161 13411 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.527213 13244 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.535571 13387 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:28.537055 13527 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:28.541821  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.462100 13449 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.523497 13327 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.524142 13246 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.557399  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.558261  8145 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:28.551676 13533 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:23:28.530799 13401 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:28.562886 13401 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.563508 13244 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.564304 13401 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.532254 13293 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:28.571920 13293 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:28.573458  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 61544.5us
I20260709 12:23:28.579684  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.581120 13173 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:28.581946 13173 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:28.583283 13173 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.550575  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.516175 13214 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.589416  8220 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:23:28.550880 13411 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.561112  8211 raft_consensus.cc:2368] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14.
I20260709 12:23:28.561645  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.565306  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3233) took 1022 ms. Trace:
I20260709 12:23:28.566970  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1054) took 1249 ms. Trace:
W20260709 12:23:28.567261 13284 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
I20260709 12:23:28.561179  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.597632  8215 rpcz_store.cc:276] 0709 12:23:27.543214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.570925 (+ 27711us) service_pool.cc:224] Handling call
0709 12:23:28.565097 (+994172us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540017c0d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:28.565221 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236281600}
I20260709 12:23:28.555102  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.568681 13431 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.557693 13327 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.597935  8218 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:28.604588  8216 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:28.598114  8761 rpcz_store.cc:276] 0709 12:23:27.317755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.317908 (+   153us) service_pool.cc:224] Handling call
0709 12:23:27.321570 (+  3662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.529253 (+207683us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:27.841047 (+311794us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.152851 (+311804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:28.152928 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:28.152991 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.566748 (+413757us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54005ef954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:28.566799 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.566916 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41569,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1543,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":67,"spinlock_wait_cycles":476783488,"thread_start_us":528816,"threads_started":2,"wal-append.queue_time_us":407527}
I20260709 12:23:28.600368  8138 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:28.587913 13444 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.608476  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.609503  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.603057 13284 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.613792  8217 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:28.614620  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.596650 13246 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.618571  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.625801  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.626261  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.628082  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.628784  8145 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.589802 13511 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.632473  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.638334 13246 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.639446  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.649173  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.653026  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.661104  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.662133  8139 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 10.
I20260709 12:23:28.624975 12644 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.637094 13214 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.554062 13430 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.683898  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.689006  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.693303  8216 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:28.664067 12644 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.698069  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.706491  8145 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.709931 13214 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:28.710572 13214 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.606746 13503 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.714978 13503 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.716905 13419 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.717445 13419 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.716959  8220 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:28.723384  8141 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:23:28.725749  8216 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:28.727209  8216 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:23:28.727550  8216 pending_rounds.cc:85] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
I20260709 12:23:28.727772  8216 pending_rounds.cc:107] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:23:28.727999  8216 raft_consensus.cc:2889] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:28.734184  8219 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:28.734370 13430 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.735631  8219 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:28.738276 12644 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:28.741191  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.742543  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.743924  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.744915  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.745620  8138 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:28.707808 13284 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.748735 13516 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:28.749169 13516 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:28.750056 13516 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.751296 13516 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.753274 13387 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.757843  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.758726  8067 raft_consensus.cc:2410] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:23:28.759296  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.761802  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.762427 13509 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.763374 13398 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.764725  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.765353  8139 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:28.767357  8184 leader_election.cc:400] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14.
I20260709 12:23:28.774616 13375 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:28.776224 13534 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.316s	user 0.003s	sys 0.000s
I20260709 12:23:28.739315  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2203) took 1118 ms. Trace:
I20260709 12:23:28.776983  8144 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:28.779556  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.781016  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.782119  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.782837 13418 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.783265  8761 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:23:28.783421 13418 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.776780  8143 rpcz_store.cc:276] 0709 12:23:27.620609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.626083 (+  5474us) service_pool.cc:224] Handling call
0709 12:23:27.678276 (+ 52193us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:28.198916 (+520640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:28.198967 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:28.212879 (+ 13912us) log.cc:844] Serialized 52 byte log entry
0709 12:23:28.309839 (+ 96960us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:28.322658 (+ 12819us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.738449 (+415791us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b1800469d20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:23:28.738677 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.738921 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.738988 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.739113 (+   125us) raft_consensus.cc:1685] finished
0709 12:23:28.739127 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.739252 (+   125us) inbound_call.cc:177] Queueing success response
0709 12:23:28.767262 (+ 28010us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b1800469d20. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
Metrics: {"mutex_wait_us":345515,"prepare.queue_time_us":431089,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":4584,"raft.queue_time_us":246105,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":229,"spinlock_wait_cycles":136421376,"thread_start_us":564849,"threads_started":2,"wal-append.queue_time_us":125599}
I20260709 12:23:28.787740 13419 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:28.789405 13214 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:28.790153  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.791031  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.792064  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.793372  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.795260  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 811) took 1426 ms. Trace:
I20260709 12:23:28.799610  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.787842  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:28.806183  8139 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:28.806391  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:28.807246  8760 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.793780  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2116) took 1181 ms. Trace:
I20260709 12:23:28.813647  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.814616  8765 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:28.816598  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.817510  8765 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:28.821051  8760 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:28.803429  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.804486  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.827046  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:28.829164  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 60621.8us
I20260709 12:23:28.795645  8758 rpcz_store.cc:276] 0709 12:23:27.369005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.480392 (+111387us) service_pool.cc:224] Handling call
0709 12:23:27.537809 (+ 57417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.896823 (+359014us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:27.897084 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.264013 (+366929us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.264380 (+   367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:28.267309 (+  2929us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:28.267516 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.754760 (+487244us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b18000c0820. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:28.779665 (+ 24905us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b18000c0820. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:28.795046 (+ 15381us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:28.795092 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.795206 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12058,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":2411,"raft.queue_time_us":1712,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13759,"spinlock_wait_cycles":885326208,"thread_start_us":350988,"threads_started":1,"wal-append.queue_time_us":461042}
I20260709 12:23:28.832044  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.828029  8761 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:28.832365  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.825539  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.808164  8065 rpcz_store.cc:276] 0709 12:23:27.612523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.626289 (+ 13766us) service_pool.cc:224] Handling call
0709 12:23:27.683029 (+ 56740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.683239 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:28.270769 (+587530us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.317208 (+ 46439us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.792893 (+475685us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b18003ed400. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:23:28.793242 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.793399 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:28.793440 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:28.793478 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.793541 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.793728 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424750,"prepare.queue_time_us":497827,"prepare.run_cpu_time_us":3967,"prepare.run_wall_time_us":42908,"raft.queue_time_us":483179,"raft.run_cpu_time_us":4085,"raft.run_wall_time_us":43992,"spinlock_wait_cycles":5490944,"thread_start_us":606494,"threads_started":2,"wal-append.queue_time_us":183181}
I20260709 12:23:28.834151  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.840260  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.841718  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:28.841102  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:28.842442  8211 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.843597  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:28.845506 13216 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:28.845885 13216 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.846222 13216 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:28.846853 13440 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:28.847563 13440 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:28.847884 13418 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.848981  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:28.849421  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.849677  8061 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.850093  8220 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:28.855921  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.711877 13510 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.861104  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:28.864563  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.865428  8761 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.870775  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:28.871513  8141 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:28.871086  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:28.825047 13428 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:28.838188 12644 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.905999  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.843715 13503 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:28.760450 13512 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:28.887044  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.913399  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.965981  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:28.999039  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:28.945685  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.901382  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:29.044272  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
W20260709 12:23:28.913681  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 87204.1us
I20260709 12:23:28.997642  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:28.942727  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:29.046653  8756 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:28.948822  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 293160us
W20260709 12:23:28.887812  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126088us
W20260709 12:23:29.049947  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.035s	sys 0.063s
W20260709 12:23:29.052101  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.035s	sys 0.063s
I20260709 12:23:29.056916  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:29.066862  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.070171  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:29.072086  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:28.942727  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:29.074107  8065 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.854256 13214 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:28.854066 13105 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.831548 13509 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:29.077561  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:28.913899 13110 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:29.092809  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 221788us
I20260709 12:23:29.101109  8141 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.095738  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:29.102454  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:29.102988  8061 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:29.107645  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.108170  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:29.110314  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.112385  8145 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:29.113530  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:29.114168 13442 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:29.114831 13244 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:29.115307 13246 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:29.115931 13255 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:29.116637 13541 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:29.118352  8061 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:29.121589 13541 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.122133 13541 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.126144  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:29.126940 13255 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:29.130157  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:28.886062  8216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51784
I20260709 12:23:28.953506 13375 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.943280 13189 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:28.846800 13327 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.083689 13284 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:29.220988  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 148987us
I20260709 12:23:29.135643  8137 raft_consensus.cc:2410] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:29.268544  8216 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:29.300011 13540 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:29.214551  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:29.096979 13503 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.240057  8065 raft_consensus.cc:2468] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:29.206662  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.914965 13440 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.085114 13214 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.094990 13401 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.105727 13293 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:29.153049 13418 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:29.102116 13105 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.299615  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3231) took 1771 ms. Trace:
I20260709 12:23:29.329511 13419 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:29.094707 13289 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:29.304811 13548 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:23:29.307525 13188 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:29.313792  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:29.347110 13438 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.320418  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:29.321252  8141 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:29.103771 13110 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:29.388321  8757 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.224196 13398 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:29.158282 13529 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.889062 13411 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.071516 12942 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:29.072731 13428 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:29.337702  8138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.008s
I20260709 12:23:29.084478 13096 consensus_queue.cc:1059] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 12:23:29.339499  8216 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:29.197398  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:29.437320  8759 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:29.341534  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.341881  8758 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:29.159133  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.354207  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 262425us
I20260709 12:23:29.352228  8213 rpcz_store.cc:276] 0709 12:23:27.528713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.529500 (+   787us) service_pool.cc:224] Handling call
0709 12:23:27.529939 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.750194 (+220255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.750243 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:27.750301 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:27.750347 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.299330 (+1548983us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54000e6d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:29.299390 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.299553 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505926016}
W20260709 12:23:29.301671  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 168492us
I20260709 12:23:29.133152  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:29.373176  8211 consensus_meta.cc:287] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:23:29.440017  8211 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:29.439513  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:29.382082  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2141) took 1064 ms. Trace:
I20260709 12:23:29.441146  8067 rpcz_store.cc:276] 0709 12:23:28.318074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.759341 (+441267us) service_pool.cc:224] Handling call
0709 12:23:28.759707 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:28.759981 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:28.760381 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.349809 (+589428us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.381604 (+ 31795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:29.381682 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:29.381746 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.381829 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.381995 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27536,"prepare.queue_time_us":4486,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":273260,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":54646,"spinlock_wait_cycles":63848448,"thread_start_us":567874,"threads_started":2,"wal-append.queue_time_us":387411}
W20260709 12:23:29.383260  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69561.5us
W20260709 12:23:29.317193  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 180121us
I20260709 12:23:29.443665  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:29.351482 13436 consensus_meta.cc:287] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.000s
I20260709 12:23:29.341367 13540 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:29.451529  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 349850us
I20260709 12:23:29.386935 13444 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:29.323019  8215 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 11. Ops: []
I20260709 12:23:29.453235  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.389580  8065 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:29.453929  8137 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:29.454092  8067 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:23:29.454447  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3219) took 1044 ms. Trace:
I20260709 12:23:29.354444 13105 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.356456 13246 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:29.358966 13284 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:29.466059  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:29.361328 13293 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:29.442958  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.483616  8141 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:29.443661  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:29.444581  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:29.349532 13214 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:29.452682 13375 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.456089  8219 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:23:29.424134 13110 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.458957  8065 rpcz_store.cc:276] 0709 12:23:28.409933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.356197 (+946264us) service_pool.cc:224] Handling call
0709 12:23:29.389419 (+ 33222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.454211 (+ 64792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.454392 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:29.472718 13226 raft_consensus.cc:3055] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:29.464011  8143 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:29.480007 13431 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:29.469012 13557 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:23:29.469671 13546 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:23:29.470408 13545 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:23:29.472453 13554 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:23:29.473272  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2139) took 1252 ms. Trace:
I20260709 12:23:29.514581  8064 rpcz_store.cc:276] 0709 12:23:28.221030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.559291 (+338261us) service_pool.cc:224] Handling call
0709 12:23:28.597720 (+ 38429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.872825 (+275105us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:28.872868 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:28.917000 (+ 44132us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.218413 (+301413us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:29.218474 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.218575 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.472971 (+254396us) raft_consensus.cc:1685] finished
0709 12:23:29.472992 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.473192 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274622,"raft.queue_time_us":287435,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":18417,"thread_start_us":201908,"threads_started":1,"wal-append.queue_time_us":363510}
I20260709 12:23:29.354723 13418 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.477663  8758 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:29.429837  8138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.008s
I20260709 12:23:29.479509  8067 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:29.482836  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3217) took 1073 ms. Trace:
I20260709 12:23:29.479718  8184 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:29.475808  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:23:29.455869  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114405us
W20260709 12:23:29.490327  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46739.6us
I20260709 12:23:29.766263  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.455296 13540 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.454663 13419 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:29.494800  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50306.7us
I20260709 12:23:29.392668 13188 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.460176  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.500151  8141 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:29.501652  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:29.468770 13549 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:23:29.773089  8137 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:29.427829 13529 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.424342 13438 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.786175  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2055) took 1476 ms. Trace:
I20260709 12:23:29.505409 13503 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:29.474045 13444 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.472890 13246 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:29.480135 13512 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:29.509145  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.491060 13387 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:29.770659 13559 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:29.556892 13284 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.491748 12942 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:23:29.511083 13192 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:29.537261 13327 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:29.561784 13411 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:29.502969 13226 raft_consensus.cc:740] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:29.855171 13192 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:29.538226  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 58589.1us
I20260709 12:23:29.510242 13431 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.856159 13192 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.856972 13431 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.857368 13192 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:29.857846 13575 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:23:29.859735 13510 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:29.859748  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:29.862188  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:29.862656 13552 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
I20260709 12:23:29.572120  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 852) took 1451 ms. Trace:
I20260709 12:23:29.865584  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:29.864830  8069 rpcz_store.cc:276] 0709 12:23:28.121238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.513954 (+392716us) service_pool.cc:224] Handling call
0709 12:23:28.514363 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.854147 (+339784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:28.854179 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.097679 (+243500us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.385128 (+287449us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:29.385165 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.385250 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.571828 (+186578us) raft_consensus.cc:1685] finished
0709 12:23:29.571856 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.572048 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324227,"raft.queue_time_us":356370,"spinlock_wait_cycles":19739392,"thread_start_us":187396,"threads_started":1,"wal-append.queue_time_us":332302}
I20260709 12:23:29.866134  8213 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.866374  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3242) took 1375 ms. Trace:
I20260709 12:23:29.517848  8063 rpcz_store.cc:276] 0709 12:23:28.409328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.761950 (+352622us) service_pool.cc:224] Handling call
0709 12:23:28.762342 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.912723 (+150381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:28.912771 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:28.913399 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.334105 (+420706us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:29.334166 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.334256 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.482631 (+148375us) raft_consensus.cc:1685] finished
0709 12:23:29.482653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.482779 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125325,"raft.queue_time_us":149512,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":122,"thread_start_us":420274,"threads_started":1,"wal-append.queue_time_us":538467}
I20260709 12:23:29.710088  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2119) took 2079 ms. Trace:
I20260709 12:23:29.867851  8070 rpcz_store.cc:276] 0709 12:23:27.631068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.710525 (+ 79457us) service_pool.cc:224] Handling call
0709 12:23:27.710804 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.845322 (+134518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.845368 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:27.845428 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:27.845473 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.709803 (+1864330us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003219d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:29.709863 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.710017 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308822912}
I20260709 12:23:29.577368 13385 raft_consensus.cc:2804] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.539309  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:29.579095 13293 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.870954  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:29.657179 13398 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.871989 13398 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.872659 13503 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.873160 13503 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.874166 13398 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:29.556285 13216 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.001s
I20260709 12:23:29.560799 13488 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.719936  8064 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:23:29.553433 13556 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:29.758193  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:29.750290 13560 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:23:29.502646 13499 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:29.503713 13569 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:29.764792  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 289087us
I20260709 12:23:29.900264  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3240) took 1600 ms. Trace:
I20260709 12:23:29.768659  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.762892  8216 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:29.760416 13554 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:23:29.772761  8139 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:23:29.774063  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.779183  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:29.907058  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 138728us
I20260709 12:23:29.907419  8141 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:29.907909  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.782442 13188 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:29.783895 13529 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:29.785784 13504 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:29.771250 13289 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:29.882994 13559 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:29.455003 13436 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.786569  8217 rpcz_store.cc:276] 0709 12:23:28.309722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.650510 (+340788us) service_pool.cc:224] Handling call
0709 12:23:28.650946 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.651638 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:28.651675 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:28.652222 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:23:28.939575 (+287353us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:29.421778 (+482203us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.422014 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.422093 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.785968 (+363875us) raft_consensus.cc:1685] finished
0709 12:23:29.785989 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.786120 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29379,"prepare.queue_time_us":195714,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":216,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2507,"thread_start_us":602941,"threads_started":2,"wal-append.queue_time_us":557127}
W20260709 12:23:29.834369 13541 consensus_meta.cc:287] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.005s
I20260709 12:23:29.853629  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:29.853312 13246 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.856062 13226 consensus_queue.cc:260] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.866861  8219 rpcz_store.cc:276] 0709 12:23:28.490851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.736505 (+245654us) service_pool.cc:224] Handling call
0709 12:23:28.761389 (+ 24884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.498190 (+736801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.866104 (+367914us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54000cc1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:29.866308 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596880256}
I20260709 12:23:29.864240 13431 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.869282  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2056) took 1559 ms. Trace:
I20260709 12:23:29.912438 12942 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:29.864363  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:29.785799 13438 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:29.868499 13547 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.653s	user 0.006s	sys 0.019s
W20260709 12:23:29.866465 13516 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.115s	user 0.012s	sys 0.004s
I20260709 12:23:29.895220  8213 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:29.899012  8211 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:29.901644  8214 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:29.902011  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44963.3us
I20260709 12:23:29.927290 13499 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:29.909412  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.900665  8218 rpcz_store.cc:276] 0709 12:23:28.299621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.633618 (+333997us) service_pool.cc:224] Handling call
0709 12:23:28.633956 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:28.634176 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:28.634505 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.855748 (+1221243us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180006c3a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf 00007f498caa6038
0709 12:23:29.855945 (+   197us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.867976 (+ 12031us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:29.899937 (+ 31961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:29.899998 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:29.900039 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.900102 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.900210 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233203,"prepare.queue_time_us":818342,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":217212,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10107,"spinlock_wait_cycles":47780480,"thread_start_us":236813,"threads_started":1,"wal-append.queue_time_us":575611}
I20260709 12:23:29.881714 13428 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:29.917533  8216 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:29.911084  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.776150 13419 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:29.927567  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 153621us
I20260709 12:23:29.911793 13488 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.919606 13385 raft_consensus.cc:697] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:29.898030 13387 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:29.969139 13387 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:29.971573 13572 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:23:29.972178  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.932194 13509 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:29.972842 13509 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.973335 13509 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.934443  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2228) took 1177 ms. Trace:
I20260709 12:23:29.973888  8140 rpcz_store.cc:276] 0709 12:23:28.756664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.758326 (+  1662us) service_pool.cc:224] Handling call
0709 12:23:29.853484 (+1095158us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:23:29.934379 (+ 80895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104992512}
I20260709 12:23:29.905714 13503 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:29.899809 13569 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:29.936048  8138 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.936702  8215 rpcz_store.cc:276] 0709 12:23:28.309986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.696780 (+386794us) service_pool.cc:224] Handling call
0709 12:23:28.699265 (+  2485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.455694 (+756429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.869063 (+413369us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54001b9254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:29.869226 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434025344}
I20260709 12:23:29.877483  8109 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:29.890246 13216 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:29.912603 13228 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:29.948604  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:29.942852 13141 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:29.954524  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:29.952167  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.990558  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:29.955250  8067 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:29.959023  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:29.992192  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:29.992333  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 114932us
I20260709 12:23:29.960716  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:29.956255 13419 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.961911  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:29.990583  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.962491  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:29.976840 13226 raft_consensus.cc:3060] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.963431  8217 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:29.963809 13529 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.956560 13576 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:29.944268 13246 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:29.965793 13511 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:29.966892 13436 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:29.982240 13569 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.978638  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:29.979396  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51784 (request call id 994) took 1144 ms. Trace:
I20260709 12:23:30.012813  8216 rpcz_store.cc:276] 0709 12:23:28.831796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.834680 (+  2884us) service_pool.cc:224] Handling call
0709 12:23:29.951712 (+1117032us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:29.929203  8757 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 12:23:29.987280  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:30.013832  8757 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:30.014199  8760 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:29.993350  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:29.995458  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.937536 13541 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.928369 13504 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:29.996415  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:30.001019  8761 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:29.999405  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:30.003809  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:30.004277  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:29.954371 13510 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:23:30.006659  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:29.998755 13567 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:29.990885 13467 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:30.017107  8213 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:30.019089  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 849) took 1949 ms. Trace:
I20260709 12:23:30.001243 12942 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:30.001583 13512 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:30.027052  8764 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:30.038165  8764 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:29.967082  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.022533  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.001559 13576 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.030031  8062 rpcz_store.cc:276] 0709 12:23:28.069316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.496835 (+427519us) service_pool.cc:224] Handling call
0709 12:23:28.497166 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:28.838614 (+341448us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:28.870449 (+ 31835us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.501235 (+630786us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.502372 (+  1137us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.503717 (+  1345us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:29.503809 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.503897 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.018875 (+514978us) raft_consensus.cc:1685] finished
0709 12:23:30.018896 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.019033 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365774,"prepare.queue_time_us":46243,"raft.queue_time_us":568598,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":24796,"spinlock_wait_cycles":51774720,"thread_start_us":518053,"threads_started":2,"wal-append.queue_time_us":514290}
I20260709 12:23:30.007362 13228 raft_consensus.cc:2764] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:30.039815  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.033174  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.045006 13576 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.031518 13516 raft_consensus.cc:2764] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:23:30.034930 13401 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 12:23:30.024582 13293 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:30.010818 13562 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.065057 13467 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:30.069636 13504 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:30.070596 13418 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:30.106590  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.082022 13512 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:30.110486  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.111151  8141 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:30.080490  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.067922  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.006680 13529 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.046995 13411 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:30.115947 13411 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:30.116912 13577 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:23:30.065572  8764 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.117331 13529 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.117669  8764 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.117939 13529 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.116408 13411 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.118892 13529 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:30.119292 13529 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:30.119665 13529 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.121016  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3218) took 1711 ms. Trace:
I20260709 12:23:30.121445  8066 rpcz_store.cc:276] 0709 12:23:28.409663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.155312 (+745649us) service_pool.cc:224] Handling call
0709 12:23:29.192045 (+ 36733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.384151 (+192106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.384196 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.422384 (+ 38188us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.537585 (+115201us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:29.537624 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.871135 (+333511us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:29.871185 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.120691 (+249506us) raft_consensus.cc:1685] finished
0709 12:23:30.120714 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.120951 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441063296,"thread_start_us":56033,"threads_started":1,"wal-append.queue_time_us":475023}
W20260709 12:23:30.124586 13553 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.915s	user 0.000s	sys 0.006s
I20260709 12:23:30.127031  8146 raft_consensus.cc:1240] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:30.127846  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2226) took 1371 ms. Trace:
I20260709 12:23:30.090992 13293 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:30.042595 13428 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:30.037715 12942 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.093130 13401 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:30.105003  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.169509  8140 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:30.073233 13499 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.996482 13559 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:30.075340  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56570.7us
W20260709 12:23:30.094076  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 335949us
W20260709 12:23:30.137740 13375 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
W20260709 12:23:30.115411  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47612.7us
I20260709 12:23:30.110883 13512 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.134904 13587 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.135860 13216 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.136300 13431 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:30.137693  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.138185 13571 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:30.096514 13438 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.140131  8212 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:30.098280 13467 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.196784 13512 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:30.109392 13105 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 12:23:30.142068  8764 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:30.146100  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 123671us
I20260709 12:23:30.245858  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.155551 13595 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.157094  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.157799  8143 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:30.115167  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:30.176779  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.177203  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.248669  8140 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:30.249616  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.178937  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.047197 13511 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:23:30.182914 13580 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:23:30.183998 13582 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:23:30.185341 13581 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:23:30.187624 13436 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:30.238843 13467 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:30.189056 13488 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:30.140717 13428 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:30.195818  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.063107 13385 consensus_queue.cc:237] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.169236 12942 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:30.201582 13411 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.257746 13216 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:30.257709 13431 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:30.111227 13583 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:23:30.128206  8146 rpcz_store.cc:276] 0709 12:23:28.756016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.758014 (+  1998us) service_pool.cc:224] Handling call
0709 12:23:30.126514 (+1368500us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5800003098. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a65fc0 00007f4991a50929 00007f4991a503d2 00007f498afc7bd4
0709 12:23:30.126756 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.127523 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.127779 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105458432}
W20260709 12:23:30.235785  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 268763us
I20260709 12:23:30.197330 13375 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:30.243075  8063 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:23:30.282956 13246 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.250849  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93844us
I20260709 12:23:30.253137  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:30.249615  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3221) took 1180 ms. Trace:
I20260709 12:23:30.329917  8067 rpcz_store.cc:276] 0709 12:23:29.068984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.517275 (+448291us) service_pool.cc:224] Handling call
0709 12:23:29.517605 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.991567 (+473962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.249372 (+257805us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400395dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:30.249552 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005932288}
W20260709 12:23:30.255865  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 77019.9us
I20260709 12:23:30.197516 13499 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:30.188902  8139 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:30.331849  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.334270  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:30.252063 13110 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 12:23:30.262907 13436 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:30.273331  8731 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.130:37085 timed out after 2.069s (SENT) [suppressed 18 similar messages]
W20260709 12:23:30.234048 13440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.002s	sys 0.015s
I20260709 12:23:30.289829  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:30.204977 13214 consensus_meta.cc:287] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.002s
I20260709 12:23:30.260646 13571 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:30.208740 13587 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.302435  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.239588 13438 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.302104 13216 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:30.321981  8138 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 11.
I20260709 12:23:30.281601 13428 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.255345 13105 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.326212  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.327262  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.354488  8063 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.243147  8069 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:30.336045  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83003.7us
I20260709 12:23:30.356204  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.236759 13293 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:30.360028  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 57544.4us
W20260709 12:23:30.340471 13440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.002s	sys 0.016s
I20260709 12:23:30.340801  8065 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.309568 13541 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.331120  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.357965  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.344926 12644 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:30.325306 13431 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.338928 13589 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.365394  8067 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:23:30.338207 13401 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:30.360826  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:30.340382 13510 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.258255 13595 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.375279 13467 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.376720 13588 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:30.378074 13597 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:30.367946 12644 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.355661 13216 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:30.380942 13591 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.380342 13592 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:30.383196  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:30.426204  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65454.2us
I20260709 12:23:30.424872 13431 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:30.434723  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 74935us
I20260709 12:23:30.461472  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.434970 13610 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:30.468075  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.445617 13293 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:30.459322 13192 consensus_meta.cc:287] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:23:30.416134  8063 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:30.486779  8065 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:30.470930 13610 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:30.496675 13610 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.462206 13591 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.499254 13591 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.501170 13105 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.503247 13576 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.436856 13436 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.509100 13411 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.509517 13436 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.511114 13595 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.512576 13587 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.476001 13567 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.514734 13438 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.516057 13615 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:30.507941 13529 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.365551 13511 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:30.440837  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.336869 13419 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.339897 13246 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.343043 13110 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.451542 12644 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.350728 13214 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:30.455327  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125778us
I20260709 12:23:30.439118 13510 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.523644  8146 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:30.556740  8146 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:23:30.489719  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.523674  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.558043  8063 raft_consensus.cc:2410] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:23:30.519742  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:30.529882  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.530270  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:30.558826  8764 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.531014  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:30.435678 13312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.158s	user 0.013s	sys 0.016s
W20260709 12:23:30.533828  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 260509us
I20260709 12:23:30.535313  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.541570  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:30.541884  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.543465  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:30.545857  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:30.546226  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.482275 13597 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:30.562552  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.566517  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.567302  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.570396 13419 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.484202 13512 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.573524 13516 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:30.576273  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.577651  8143 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:30.578290  8066 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:30.541656 13438 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.583870  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:30.584362  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.583663  8764 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:30.585506  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.586576  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:30.636404  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 280248us
W20260709 12:23:30.649333  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63183.2us
I20260709 12:23:30.650063  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.552910 13615 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:30.651427  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:30.565346 13312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.294s	user 0.014s	sys 0.016s
I20260709 12:23:30.462492 13499 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.745942 13529 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.651492  8137 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:23:30.678200  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.747208  8064 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:30.747738 13110 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:30.749028 13605 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:30.751792  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 972) took 1240 ms. Trace:
I20260709 12:23:30.679059  8146 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:30.752166  8138 rpcz_store.cc:276] 0709 12:23:29.511918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.538974 (+ 27056us) service_pool.cc:224] Handling call
0709 12:23:30.751626 (+1212652us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54001c2fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:30.751732 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152825088}
I20260709 12:23:30.692785 13614 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.759785  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:30.761230  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.761970  8213 raft_consensus.cc:2393] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:30.762661  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.763578  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:30.766474 13431 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.680678  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:30.710152  8141 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:29.343382  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:30.780457  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 213204us
I20260709 12:23:30.564512 13541 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:23:30.690076 13418 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:30.681824  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.653587 13411 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.770823 13509 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.002s
I20260709 12:23:30.715193  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:30.813290  8140 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:30.716734  7953 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c70d5020db543caa986f80b0adaa8d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:30.717595 13214 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.814579  8215 raft_consensus.cc:2410] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:30.680605 13438 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.719709 13613 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.719987 12644 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.819265 13613 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.678719 13504 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:23:30.756489 13614 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.726433 13228 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:30.821410 13228 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:30.821691 13614 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.822458 13228 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.823657 13228 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.588497 13419 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 12:23:30.728704  8144 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:23:30.731973 13246 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.734627  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:30.828981  8761 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.736160  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.833932  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.834923  8069 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:30.835965  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.739797 13444 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.699213 13467 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.711258 13590 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.837263 13214 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:30.837733 13214 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:30.837455 13590 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.838063 13510 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.838586 13214 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.839879 13214 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:30.690578 13141 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.840943 13141 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.843101 13141 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.756441  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.845147  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.845765  8218 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
W20260709 12:23:30.791229 13540 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.000s
I20260709 12:23:30.846583  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:30.846704 13540 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.847651  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:30.777858  8064 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:30.848905  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.806777 13529 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:30.849562 13529 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:30.849977  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:30.850641  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 864152us
I20260709 12:23:30.850437 13529 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.555904 13226 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:30.851508  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:30.687856  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:30.787765  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 112430us
W20260709 12:23:30.854166  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72581.9us
I20260709 12:23:30.856262  8068 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:30.797518 13576 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:30.803627 13579 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:23:30.552197 13192 consensus_queue.cc:1059] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 12:23:30.811143 13375 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.774858 13569 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.004s
W20260709 12:23:30.814620  7953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 262526us
I20260709 12:23:30.721100 13216 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.815706 13503 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.785861 13591 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:30.850680  8064 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:30.860570  8213 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17.
I20260709 12:23:30.861246  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:30.861804  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.869407  8069 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:23:30.883232  8069 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:30.884006 13216 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.884200  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.821691 13613 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.579571 13597 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.844420 13610 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.816751 13411 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:30.858291 12942 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.001s
I20260709 12:23:30.865289 13293 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:30.807931  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126224us
I20260709 12:23:30.792141 13418 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:30.904309  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:30.866549  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.823570 13438 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.862869  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.840387 13590 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.864063 13467 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.875064  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.916460  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.880134  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:30.894356  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2092) took 2172 ms. Trace:
I20260709 12:23:30.917312  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:30.917398  8145 rpcz_store.cc:276] 0709 12:23:28.721821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.724715 (+  2894us) service_pool.cc:224] Handling call
0709 12:23:28.725083 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.112975 (+387892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.894054 (+1781079us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001c2ad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:30.894266 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890063616}
I20260709 12:23:30.848906 13540 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.900738  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.905526  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.857267 13509 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.905441  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:30.913252  8063 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:30.914407  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47929.6us
I20260709 12:23:30.950067  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:30.950757  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:30.866371 13567 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:30.888435  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:30.956420  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68068.8us
I20260709 12:23:30.918426  8212 raft_consensus.cc:2368] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
W20260709 12:23:30.919821  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57047.7us
I20260709 12:23:30.910321 13418 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.950932  8069 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:30.877223 13375 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:30.953126  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47797.4us
I20260709 12:23:30.954208  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:30.912194 13428 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:23:30.959344  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:30.948601  8064 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:30.908388 12644 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:30.885499 13591 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:30.945974 13589 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:30.876961 13569 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:30.909191 13617 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:30.974224  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99248.5us
I20260709 12:23:31.054685 13500 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:31.208564  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.010870  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:31.511405  8756 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:31.511737  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 500940us
I20260709 12:23:30.972911 13216 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:31.029059 13540 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:31.092451  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:30.974846 13593 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:31.075152 13398 raft_consensus.cc:3055] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:31.017254  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 57196.4us
I20260709 12:23:31.203853  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:31.094624  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.085489 13512 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:31.016685  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:31.016004  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:31.017791  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.010100  8070 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:23:31.211755  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.042018  8141 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:31.080758  8067 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:23:30.910895 13493 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:23:31.559311 13493 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:31.559537 13619 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:23:31.559872 13493 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:31.085364 13431 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:31.074870 13327 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:31.093708  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:31.562498  8764 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:31.562592 13327 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:31.562989 13327 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:31.563416  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:31.079746 13411 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:31.061619  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:31.563838 13327 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.564450  8219 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.552390  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:31.566507  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.567474  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:31.070991  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3256) took 1106 ms. Trace:
I20260709 12:23:31.568774  8211 rpcz_store.cc:276] 0709 12:23:29.964649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.004126 (+ 39477us) service_pool.cc:224] Handling call
0709 12:23:30.024942 (+ 20816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.269793 (+244851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:30.269822 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.283217 (+ 13395us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.290274 (+  7057us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:30.290316 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.070471 (+780155us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b540017d4d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:31.070534 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.070608 (+    74us) raft_consensus.cc:1685] finished
0709 12:23:31.070629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.070913 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64601,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":66013952,"thread_start_us":207245,"threads_started":2,"wal-append.queue_time_us":3821,"wal-append.run_cpu_time_us":1642,"wal-append.run_wall_time_us":1021222}
I20260709 12:23:31.570885  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.571878  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.009110 13141 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.355s
I20260709 12:23:31.573243 13327 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:31.573632  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.568704 13493 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.575309 13493 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:31.072968  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.576202  8213 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:31.577056  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:31.577759  8213 raft_consensus.cc:2393] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:31.578464 13591 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:30.974190 13499 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.580814 13499 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:31.581245 13499 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.036814 13312 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:31.244087 13387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.028s	sys 0.042s
I20260709 12:23:30.898147 13615 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:31.209717  8763 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:31.207080  8069 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:31.076908 13610 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:31.081691 13509 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:30.915254 13514 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:23:30.946681 13438 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:30.919229 13444 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:31.064538  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:30.909015 12942 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:31.069772 13574 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.150s	user 0.005s	sys 0.000s
I20260709 12:23:31.243876 13613 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:31.062969  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.244395  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:30.946293 13590 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:31.406665  8068 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:31.097070  8218 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:31.087661 13597 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:31.055891 13504 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:31.620390  8137 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:31.498703 13488 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:31.013949  8140 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:31.076807  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.051959  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1003) took 1187 ms. Trace:
I20260709 12:23:31.090821  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:31.042429  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.630707  8215 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:31.631011  8214 rpcz_store.cc:276] 0709 12:23:29.864972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.871850 (+  6878us) service_pool.cc:224] Handling call
0709 12:23:29.872140 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.942282 (+ 70142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.051679 (+1109397us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001b8d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:31.051882 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67429120}
W20260709 12:23:31.635330  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.095800  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.448406  8063 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:31.474257  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 514959us
I20260709 12:23:31.330178 13428 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.639088  8066 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:31.508536 13589 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:31.510433  8064 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:31.637794  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:31.519054  8061 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:31.533918  8758 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:31.545032  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:31.476293 13516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.011s	sys 0.005s
I20260709 12:23:31.551052  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:31.649220  8760 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:31.542552  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
W20260709 12:23:31.647014 13385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.027s	sys 0.073s
I20260709 12:23:31.554124 13226 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.555037 13587 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:31.536192 13398 raft_consensus.cc:740] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:31.014185  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.668604  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.669927  8139 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:31.669937  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:31.671053  8761 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:31.671154  8139 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:31.582778  8217 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:31.586189  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:31.673086  8211 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:31.674434  8211 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:31.674690  8760 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:31.665334 13385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.027s	sys 0.073s
I20260709 12:23:31.675623  8211 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:31.675936  8213 raft_consensus.cc:1240] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:31.468912 13529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.001s	sys 0.012s
I20260709 12:23:31.591722  8219 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 10.
I20260709 12:23:31.597432  8145 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:31.482915 13255 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:31.597973  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3231) took 1133 ms. Trace:
I20260709 12:23:31.602376  8763 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:31.533608 13188 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:31.593176 13387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.029s	sys 0.043s
I20260709 12:23:31.617810  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.617949  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:31.089339  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:31.637856  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:31.512642  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:31.627835  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.640394  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.647740  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:31.652112  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107151us
I20260709 12:23:31.553110 13562 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:31.652128  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:31.654301  8062 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:31.654428  8214 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:23:31.542661 13500 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:31.642688  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:31.615170 13375 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:31.655719 13221 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:31.620796 13591 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:31.619985 13284 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:31.649015 13516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.012s	sys 0.005s
I20260709 12:23:31.678300  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3254) took 1718 ms. Trace:
I20260709 12:23:31.702366  8065 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:31.679872  8765 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:31.679893  8138 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:31.680205  8144 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:31.680649  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 591341us
W20260709 12:23:31.681313  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43598.9us
I20260709 12:23:31.710207  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:31.711650  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:31.681667  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 169131us
I20260709 12:23:31.682461  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:31.683287  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:31.688971  8140 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:31.620208 13613 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.650077 13438 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 12:23:31.678588  8069 rpcz_store.cc:276] 0709 12:23:30.464824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.020028 (+555204us) service_pool.cc:224] Handling call
0709 12:23:31.020379 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.594514 (+574135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.597893 (+  3379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.734768  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:31.682256  8143 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:31.854423  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 142857us
I20260709 12:23:31.862018  8110 leader_election.cc:400] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
I20260709 12:23:31.862438  8110 leader_election.cc:403] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:23:31.854773  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 140838us
I20260709 12:23:31.807485  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:31.867992  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60638.7us
I20260709 12:23:31.701982  8220 rpcz_store.cc:276] 0709 12:23:29.960121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.960264 (+   143us) service_pool.cc:224] Handling call
0709 12:23:29.960612 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.975400 (+ 14788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.975430 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.754527 (+779097us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:30.754936 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.974565 (+219629us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:30.974603 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.974670 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.677971 (+703301us) raft_consensus.cc:1685] finished
0709 12:23:31.677999 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.678243 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14374,"raft.queue_time_us":21681,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4764,"spinlock_wait_cycles":13011328,"thread_start_us":219275,"threads_started":1,"wal-append.queue_time_us":757178}
I20260709 12:23:31.668087 13398 consensus_queue.cc:260] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.684484  8142 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
W20260709 12:23:31.884344  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 149634us
I20260709 12:23:31.677361  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:31.871354  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.024s	sys 0.067s
I20260709 12:23:31.660024 13597 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:23:31.886152  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.024s	sys 0.067s
W20260709 12:23:31.676605 13529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.001s	sys 0.013s
I20260709 12:23:31.683848 13419 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:31.682638 13226 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:31.682480 13387 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.716980 13221 raft_consensus.cc:2764] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:31.684060 13562 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:31.815389 13255 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.687963 13500 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:31.886996  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.042s	sys 0.057s
I20260709 12:23:31.688895 13375 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:31.718293 13188 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.858664 13444 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.650612 13488 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:31.885524 13571 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:31.908597  8138 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:31.797432 13503 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.797755 13289 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 12:23:32.003624 13289 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:32.004078 13289 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.004464 13289 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:32.007143 13418 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.000s
I20260709 12:23:32.007737 13418 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:31.896194 13589 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:31.831367 13431 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:23:31.918766  8763 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:31.797259 13614 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:23:32.013309 13431 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:31.734656 13385 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:23:32.013772 13431 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:31.814208 13567 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:23:32.015013 13567 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:32.014714 13431 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.015447 13567 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.016054 13431 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.900475 13419 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.016846 13419 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:32.019157 13214 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 1.179s	user 0.014s	sys 0.000s
I20260709 12:23:31.911406 13398 raft_consensus.cc:3060] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.949493 13255 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:31.953948 13613 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:31.689226 13591 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.025107  8758 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:31.889451 12644 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:23:32.026751 12644 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:32.027367 12644 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:31.903241 13226 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:32.028882 13226 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:31.905210 13387 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.905059 13562 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:32.032859 13387 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.033433 13562 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.034976 13562 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.689438 13284 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.038390 13284 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:31.973109  8765 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:23:31.961735 13623 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.444s	user 0.001s	sys 0.000s
I20260709 12:23:31.976035  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:31.962559 13221 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:31.979590 13216 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:31.970893 13569 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:31.971714 13428 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:31.991583  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.043s	sys 0.057s
I20260709 12:23:31.979948 13438 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:32.001837  8036 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.026753 13418 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:31.972724  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.082902  8142 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:31.997407 13228 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.173s	user 0.014s	sys 0.000s
I20260709 12:23:32.054157  8143 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:32.054098 13503 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.085415 13216 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.053745 13613 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:32.055927 13221 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:32.001645 13571 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:32.083083  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81389.7us
I20260709 12:23:32.053908 13214 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11.
I20260709 12:23:32.094439  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2147) took 1888 ms. Trace:
I20260709 12:23:32.028513 12644 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:32.097291  8729 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.033s	sys 0.027s
W20260709 12:23:32.142153  8729 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.033s	sys 0.027s
W20260709 12:23:32.142629  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 558683us
I20260709 12:23:32.145931  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.147018  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.147876  8140 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:32.150545  8140 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:23:32.151995  8140 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:23:32.121788  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.033s	sys 0.079s
W20260709 12:23:32.154853  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.036s	sys 0.079s
I20260709 12:23:32.125474  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.156004  8144 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:32.125020  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.058910  8759 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.002229 13188 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.141878  8062 rpcz_store.cc:276] 0709 12:23:30.206485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.207661 (+  1176us) service_pool.cc:224] Handling call
0709 12:23:30.231292 (+ 23631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.684739 (+1453447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.094192 (+409453us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001f6654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:32.094379 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272241024}
I20260709 12:23:32.153630  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.162166  8145 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.050671 12942 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.159139 12644 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:32.016310 13567 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.090080 13428 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:32.140435 13571 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.140795 13569 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:32.116751 13221 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:32.174654  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.092229 13617 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:32.087697 13438 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.199529 13488 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.117129 13613 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.200073 13610 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:32.200601 13438 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.200945 13610 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:32.201747 13613 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.201879  8141 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:32.202699 13385 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:32.203131 13385 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.204044 13385 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.205461 13385 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.207322 13188 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:32.190186 13591 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.183722 13503 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:32.191075  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.171753 13418 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.209065 13418 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.211513  8214 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:32.212661  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:32.212983  8144 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:32.219699  8142 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:32.179934  8143 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:32.221778  8138 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:32.221850  8140 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.226042  8759 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:32.183396 13529 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:32.185818 13312 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.219152 13591 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.228118  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.198290  8145 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:32.239398  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.256944  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.259851 13516 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.033s
W20260709 12:23:32.260324 13516 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.013s	sys 0.033s
I20260709 12:23:32.261283  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3245) took 1375 ms. Trace:
I20260709 12:23:32.261791  8067 rpcz_store.cc:276] 0709 12:23:30.886086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.545380 (+659294us) service_pool.cc:224] Handling call
0709 12:23:31.545694 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.545929 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:31.551114 (+  5185us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.260802 (+709688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.260875 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:32.260939 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.261029 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.261210 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5498,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":123572,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":709216,"threads_started":2,"wal-append.queue_time_us":541446}
I20260709 12:23:32.195631 13428 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:32.270539  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 593253us
W20260709 12:23:32.271576  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.005s	sys 0.009s
W20260709 12:23:32.271979  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.009s
W20260709 12:23:32.272821  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.273561  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.274550  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 412675us
W20260709 12:23:32.275413  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54665.9us
I20260709 12:23:32.277338  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.196123 13569 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:32.278313  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 595106us
I20260709 12:23:32.324273  8035 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.266198 13627 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:32.279964 13597 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:32.204042 13289 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.271224 13591 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.313514 13514 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:32.291685 13418 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.316612  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:32.331924  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 133093us
W20260709 12:23:32.319062 13626 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.461s	user 0.001s	sys 0.000s
W20260709 12:23:32.319845  8063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3229) took 1855 ms (client timeout 2149 ms). Trace:
W20260709 12:23:32.336931  8063 rpcz_store.cc:269] 0709 12:23:30.464150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.566264 (+102114us) service_pool.cc:224] Handling call
0709 12:23:32.319657 (+1753393us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540011dfd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:32.319787 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795930880}
I20260709 12:23:32.319973  8070 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.337895  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.339502  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1005) took 2351 ms. Trace:
I20260709 12:23:32.339759  8217 rpcz_store.cc:276] 0709 12:23:29.988195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.999728 (+ 11533us) service_pool.cc:224] Handling call
0709 12:23:30.010909 (+ 11181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.672004 (+1661095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.339323 (+667319us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:32.339455 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3614403840}
I20260709 12:23:32.321596 13184 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:32.267068 13628 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:32.333004  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.323789 13637 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:32.256124 13529 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.293524 13633 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:32.335542  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64066.3us
W20260709 12:23:32.277501  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.334947  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:32.266307 13312 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.343073  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.344147  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:32.346426  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69181.7us
I20260709 12:23:32.347514  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:32.348829 13639 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.348958  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.352818 12644 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:32.356254  8214 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:32.357168  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.357406  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.358700  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:32.363370 13289 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.363478 13638 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:32.364797 13444 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:32.365536 13444 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.365991 13444 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.368212 13444 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.359618 13562 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:23:32.359664 13284 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:32.343250 13184 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.334375 13504 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:32.334834 13488 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:23:32.371536 13184 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.372418  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3261) took 1458 ms. Trace:
I20260709 12:23:32.372823  8213 rpcz_store.cc:276] 0709 12:23:30.914028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.578266 (+664238us) service_pool.cc:224] Handling call
0709 12:23:31.578525 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.676345 (+ 97820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.372195 (+695850us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b54002b5554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:32.372362 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223557888}
W20260709 12:23:32.373337  8065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3237) took 1814 ms (client timeout 2131 ms). Trace:
W20260709 12:23:32.373860  8065 rpcz_store.cc:269] 0709 12:23:30.559345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.687505 (+128160us) service_pool.cc:224] Handling call
0709 12:23:32.373134 (+1685629us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54003219d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:32.373269 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863534336}
I20260709 12:23:32.376504  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.359375 13613 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:32.377039 12644 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.332270 13584 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:23:32.377056  8217 raft_consensus.cc:2410] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:32.370327 13312 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.377944  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.386333  8145 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:32.387209  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:32.350726 13327 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.003s
I20260709 12:23:32.347154 13627 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:32.377204  8143 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
W20260709 12:23:32.400138 13499 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.818s	user 0.004s	sys 0.004s
I20260709 12:23:32.396169 13597 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.349700 13428 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.408324 13569 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.353142 13637 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:32.360064 13633 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.409679 13637 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.349733 13640 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:32.382581  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.342195 13628 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.422531 13562 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:32.437093 13562 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.437582 13562 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.375082 13639 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.437323 13628 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.438546 13628 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.439831 13639 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.388821  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.349583 13634 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:32.441300  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52552.7us
I20260709 12:23:32.441738 13634 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.442230  8035 leader_election.cc:400] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17.
I20260709 12:23:32.443325  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:32.443951 13634 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.444145 13587 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:32.385211 13613 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.445080 13587 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:32.446645 13613 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.383847 13438 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:32.447752 13640 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:32.449034 13512 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:32.448792 13640 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.449437 13512 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:32.368876 13614 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.334491 13514 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.393708 13228 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:32.349948 13643 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:32.417235 13591 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.418484 13529 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:32.473066  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2170) took 1419 ms. Trace:
I20260709 12:23:32.473539  8070 rpcz_store.cc:276] 0709 12:23:31.054097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.557277 (+503180us) service_pool.cc:224] Handling call
0709 12:23:32.319794 (+762517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.341245 (+ 21451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.472831 (+131586us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540011dfd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:32.472998 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752726272}
I20260709 12:23:32.477814  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:32.478498  8756 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:32.423677  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.481117  8142 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:32.376664  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:32.481848  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 105274us
I20260709 12:23:32.421551 12644 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.421499  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.484532  8142 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:23:32.485020  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 63631.4us
I20260709 12:23:32.343915 13500 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:23:32.414798  8212 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:32.374846 13617 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:32.433555 13375 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:23:32.389714  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.493137  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:32.436506  8145 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:32.456163  8137 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:32.416162 13493 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.005s
W20260709 12:23:32.462924  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 1010) took 1869 ms (client timeout 2401 ms). Trace:
I20260709 12:23:32.507251  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:32.508045  8763 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:32.370996 13284 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.496676  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:32.513480  8760 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:32.483232  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:32.507652  8218 rpcz_store.cc:269] 0709 12:23:30.588516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.847421 (+258905us) service_pool.cc:224] Handling call
0709 12:23:32.457344 (+1609923us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400373a54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:32.457483 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390214528}
I20260709 12:23:32.413168  8139 raft_consensus.cc:2410] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:32.515251  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.502619  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:32.518415  8141 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.518955  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:32.411801 13633 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.400542 13499 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.520563  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.529417  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:32.464511 13289 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:32.393050 13226 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:32.460098 12942 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.519564  8145 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:32.459445 13418 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:23:32.515545 13638 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:32.530900  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:32.545557  8761 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:32.548146  8764 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:32.548499  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.521607  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:32.415639 13419 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.530354  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:32.536885  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:32.516440 13634 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:32.539953  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:32.539793  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:32.541015  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:32.417193 13221 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.525131 13529 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:32.538949 13493 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:32.463533 13614 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.559383  8142 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:32.560364  8145 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
W20260709 12:23:32.582929  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65807us
I20260709 12:23:32.522977 13627 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:23:32.586112  8758 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:32.533640 13445 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:23:32.548913 13652 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:32.591246  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.598394  8070 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:32.593400  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.599021  8065 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:32.595690  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.600256  8063 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:32.549499 13617 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:32.602357 13617 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.596859  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:32.609690  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.610394  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.611189  8067 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:32.611557  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.612618  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.613435  8062 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:32.616132  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.616456  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:32.622237  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82537.2us
I20260709 12:23:32.624034  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:32.543818 13613 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:32.531220 13643 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:23:32.563800 13529 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.565058 13593 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:32.541651 13289 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:32.643438  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46700.5us
I20260709 12:23:32.644589  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:32.590546 13387 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:23:32.635262  8062 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 11: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:32.585175 13633 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:32.582345 13634 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:32.574285 13141 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:23:32.617167 13652 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.550432 12942 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:32.618043 13629 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:32.675568  8070 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:32.677066  8065 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.678028  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.679026  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.680008  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.686501  8062 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:32.693210 13632 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:32.639300 13438 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:32.644187 13529 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:32.737355  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.742059  8061 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:32.744174  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.754390  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.759011  8064 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:32.656996 13593 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:32.695713 13540 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:32.776716  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:32.755177 13647 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:32.735766 13633 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:32.782253  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.694855 13652 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:32.636435 13648 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.144s
I20260709 12:23:32.650240 13312 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 12:23:32.755781 13657 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:32.798010  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.774009 13438 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:32.656534 13387 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:32.795486 13616 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.381s	user 0.000s	sys 0.009s
I20260709 12:23:32.807247  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:32.808143 13653 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:23:32.775722 13418 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.907173  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:32.908433  8064 raft_consensus.cc:2410] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:32.902633 13493 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:32.792557  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 168742us
I20260709 12:23:32.796554 13657 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:32.903467  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 258986us
W20260709 12:23:32.924034  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.925678  8218 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:32.934064  8064 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:32.934800  8064 pending_rounds.cc:85] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 10
I20260709 12:23:32.935221  8064 pending_rounds.cc:107] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:32.935601  8064 raft_consensus.cc:2889] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:32.910989 13284 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.938308  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:32.942624 13624 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.111s	user 0.003s	sys 0.000s
I20260709 12:23:32.989531 13289 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:32.990319 13679 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.993157 13387 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.995626 12942 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.996745 13614 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:32.911036 13569 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:32.927273 13499 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:32.897150 13634 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.005780  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1008) took 2560 ms. Trace:
I20260709 12:23:33.006373  8216 rpcz_store.cc:276] 0709 12:23:30.445006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.445246 (+   240us) service_pool.cc:224] Handling call
0709 12:23:30.471531 (+ 26285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.471973 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:30.472004 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.480984 (+  8980us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.891035 (+410051us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:30.891091 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.892180 (+  1089us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.588536 (+1696356us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:33.005379 (+416843us) raft_consensus.cc:1685] finished
0709 12:23:33.005408 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.005700 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4508,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9258,"spinlock_wait_cycles":19004800,"thread_start_us":343846,"threads_started":1,"wal-append.queue_time_us":720079}
W20260709 12:23:33.031056  8759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 853) took 1936 ms (client timeout 2219 ms). Trace:
W20260709 12:23:33.033335  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 508383us
W20260709 12:23:33.031492  8759 rpcz_store.cc:269] 0709 12:23:31.099204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.205559 (+106355us) service_pool.cc:224] Handling call
0709 12:23:33.030838 (+1825279us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54005ef954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:33.030991 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022288768}
I20260709 12:23:33.036069  8069 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:33.036542  8756 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.912073 13514 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.038187  8759 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 12:23:33.036252 13500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.040s	sys 0.051s
I20260709 12:23:33.044227  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.045439  8064 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:33.016112 13512 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.048833 13512 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:33.017139 13226 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.054926  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:33.059037  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 482009us
I20260709 12:23:33.061537  8061 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:33.061724  8761 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:33.062244  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:32.918733  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.068780  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.067961  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.927464  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.071113  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.071796  8061 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:33.073558  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.076177  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:33.081382  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 154024us
I20260709 12:23:33.081398  8064 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.078747  8067 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:33.037027 13419 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
W20260709 12:23:33.081501  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.083084  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.083359 13514 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:33.083709 13419 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.084647  8067 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:32.922153 13418 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.089648  8065 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:33.072922  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.078045  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.091248  8068 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:33.067920 13584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.032s	sys 0.141s
I20260709 12:23:33.094511  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.097276  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.086411  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:33.132776  8213 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:33.084223 13419 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.090771  8061 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:33.120976  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:33.052837 13529 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.121594  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.085171 13629 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.120188  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.084818 13514 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:23:33.029438 13438 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.131325  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.123659 13671 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:33.125878 13628 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260709 12:23:33.125649 13668 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:33.134927 13675 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:23:33.088675 13493 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.142733 13670 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.163703  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.117836 13509 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:23:33.153456  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:32.991003 13679 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.141084  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:33.144739  8765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.013s
I20260709 12:23:33.210393  8215 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:33.210506  8765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.009s	sys 0.013s
I20260709 12:23:33.145208  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.171720  8064 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:33.193528  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.200019  8142 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:33.166802  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:33.165841 13571 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.971s	user 0.009s	sys 0.003s
I20260709 12:23:33.216382  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.165731 13671 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.144174 13214 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:33.097920 13657 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:33.143352 13587 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.000s
W20260709 12:23:33.133605 13584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.032s	sys 0.148s
W20260709 12:23:33.212906  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46353us
W20260709 12:23:33.188593 13562 consensus_meta.cc:287] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
W20260709 12:23:33.213522  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72529.1us
W20260709 12:23:33.214376  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69243.4us
I20260709 12:23:33.161554  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.218696 13540 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:33.219136  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:33.219482 13592 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:33.219568 13514 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:33.220170 13571 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.153496 13500 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:33.150295 13293 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:33.208032  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.187630 13668 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:32.976809 13593 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.163127 13674 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:33.265038  8756 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:33.265466  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.269356  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.274029 13540 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.273315  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.276187  8213 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:23:33.301308  8215 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:33.273389  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.281306  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:33.196244 13327 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:23:33.284493  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:33.289000  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61450.2us
I20260709 12:23:33.315479  8219 raft_consensus.cc:2410] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:23:33.316419  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.233982 13671 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.295728  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.162446 13516 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:23:33.187722 13629 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:33.326957  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61555.2us
I20260709 12:23:33.298724  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.327901  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.303632 13673 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:33.303987  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:33.305111  8217 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:23:33.305547  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72934.4us
I20260709 12:23:33.331321  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.335253  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:33.336004  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.308867 13664 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:33.304194 13504 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:23:33.310211  8211 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:23:33.287981 13293 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:33.294420 13668 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:33.313498 13529 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.276531 13562 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.314163  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.321636  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1013) took 1112 ms. Trace:
I20260709 12:23:33.322438  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.274060 13587 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:33.337033  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65062.7us
I20260709 12:23:33.338444  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.294147 13674 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.311969 13184 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:33.316817 13592 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:33.342510  8756 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:33.319028 13540 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:33.343446  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.345293  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.346891  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.209784 13670 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.295184 13500 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.335660 13398 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:33.367653  8065 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:33.351432  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:33.368651  8140 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:33.354353  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.369582  8756 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:33.363176  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.363497  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:33.371064  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.371338  8137 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:33.349042  8220 rpcz_store.cc:276] 0709 12:23:32.209642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.209774 (+   132us) service_pool.cc:224] Handling call
0709 12:23:32.210083 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.335977 (+125894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.336011 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.336059 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:32.336090 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.321324 (+985234us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400374954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:33.321389 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.321560 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289070976}
I20260709 12:23:33.331924 13673 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:33.341948 13488 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:33.366820  8063 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:33.369455  8217 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:33.372251  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.384114  8220 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:33.326301 13503 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:23:33.360994  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:33.372967  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.364470  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.358246 13214 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:33.347414 13684 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:33.349731 13511 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.355566 13445 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:33.360502 13664 consensus_queue.cc:1243] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:23:33.443490  8729 leader_election.cc:336] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.357s (SENT)
I20260709 12:23:33.444152  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:33.449923 13678 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:23:33.451623 13686 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:33.452826  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:33.453498  8765 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:33.454291 13445 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:33.456722 13684 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.459395 13684 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.460219  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:33.461230 13688 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:23:33.461882  8217 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:23:33.385753  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:33.465230  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.402626  8218 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:33.353045 13659 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:23:33.467872  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.468307  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.391618  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:33.430100  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.357854 13674 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:33.385106 13663 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:33.449496 13652 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 12:23:33.455615 13445 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.485955  8217 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:23:33.391001 13418 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.488488  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:33.489464  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 146175us
I20260709 12:23:33.497524  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.498529 13591 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:33.486814 13587 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.499890 13587 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.500882  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.501384 13591 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.502002 13587 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.504142  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 980) took 1068 ms. Trace:
I20260709 12:23:33.504421  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:33.504078 13592 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.505239  8066 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:33.495703 13398 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:33.490188  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.505966 13398 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.506232  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.492774 13289 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.506866  8066 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:33.507082 13289 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.411983 13214 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:33.508930 13214 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:33.509224 13289 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.513105  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.508877 13670 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.514421 13516 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:33.514816 13516 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.515179 13516 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:33.491773  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.501838 13591 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:33.509395 13689 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:23:33.391628 13673 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:33.412922 13675 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.506371 13398 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.504667  8138 rpcz_store.cc:276] 0709 12:23:32.436313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.445462 (+  9149us) service_pool.cc:224] Handling call
0709 12:23:32.445791 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:32.464740 (+ 18949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.464774 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:32.499145 (+ 34371us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.685264 (+186119us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:32.685305 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.503762 (+818457us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b5400042254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:33.503810 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.503860 (+    50us) raft_consensus.cc:1685] finished
0709 12:23:33.503880 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.504084 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10171,"raft.queue_time_us":6817,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5063,"spinlock_wait_cycles":19304192,"thread_start_us":143000,"threads_started":1,"wal-append.queue_time_us":249775}
I20260709 12:23:33.563796 13675 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.473052  8765 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:33.565583  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.518271  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:33.489976 13228 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.530999 13562 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.531698 13571 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.566514 13228 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:33.566860  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48691.7us
I20260709 12:23:33.566680 13562 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.566025 13675 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.570297  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.571798  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.523450 13663 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:33.543363  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2246) took 1926 ms. Trace:
I20260709 12:23:33.486929 13419 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.549963  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.556866 13584 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:33.581096  8146 rpcz_store.cc:276] 0709 12:23:31.617086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.618340 (+  1254us) service_pool.cc:224] Handling call
0709 12:23:31.618634 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.049252 (+430618us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:32.294805 (+245553us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.563236 (+268431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.563295 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:32.563343 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.543087 (+979744us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400313654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:33.543140 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.543283 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45719,"prepare.queue_time_us":209618,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":67637,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":28055,"spinlock_wait_cycles":989629184,"thread_start_us":466845,"threads_started":2,"wal-append.queue_time_us":213775,"wal-append.run_cpu_time_us":1107,"wal-append.run_wall_time_us":1003567}
I20260709 12:23:33.559733 13500 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:33.518501  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.577613  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:33.580339  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 219431us
I20260709 12:23:33.584229  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:33.586293  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3262) took 2672 ms (client timeout 2169 ms). Trace:
I20260709 12:23:33.448567 13511 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.596541  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:33.570322 13567 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.587185 13562 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:33.596771  8212 rpcz_store.cc:269] 0709 12:23:30.914346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.567267 (+652921us) service_pool.cc:224] Handling call
0709 12:23:33.585986 (+2018719us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:33.586183 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901574016}
I20260709 12:23:33.611932  8212 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:33.612280  8212 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:33.581048 13663 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:33.585659 13512 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:23:33.612938 13663 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:33.613092  8212 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.613813 13629 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.614290 13188 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:33.496143 13652 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.614849 13188 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:33.615808 13188 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.616560 13652 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.616714 13672 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:33.598376  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:33.619311  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:33.586038 13289 raft_consensus.cc:2764] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:23:33.620759 13289 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.621443 13418 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.621855  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:33.621974 13418 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.623988 13672 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:33.624182 13418 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.624920  8062 raft_consensus.cc:2368] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18.
I20260709 12:23:33.624606 13672 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.606537 13679 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.592473 13659 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:33.584131 13670 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:33.628455  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:33.629618 13613 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:33.599231  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 850) took 2498 ms. Trace:
I20260709 12:23:33.630962  8069 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:33.631834  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:33.632500  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:33.633229  8143 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:23:33.570868 13228 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.630383 13613 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.630887  8762 rpcz_store.cc:276] 0709 12:23:31.093926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.094047 (+   121us) service_pool.cc:224] Handling call
0709 12:23:31.949932 (+855885us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b54002f86a8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f49919b5aa1 00007f4991a30ebc 00007f4991a6608c 00007f4991a5093b 00007f4991a503d2 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c
0709 12:23:31.950123 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.950435 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:32.263287 (+312852us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.341274 (+ 77987us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.318606 (+977332us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b1800029aa0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f498ca84060 00007f498ca96716 00007f498caa7287 00007f498caa7208
0709 12:23:33.322934 (+  4328us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b1800029aa0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:33.589052 (+266118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:33.589963 (+   911us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:33.590017 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.590093 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.590793 (+   700us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8634,"prepare.queue_time_us":316534,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":17141,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":17610,"spinlock_wait_cycles":29724800,"thread_start_us":656512,"threads_started":3,"wal-append.queue_time_us":92191,"wal-append.run_cpu_time_us":1513,"wal-append.run_wall_time_us":1021198}
I20260709 12:23:33.644014  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:33.607856 13587 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:33.643805  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 166933us
I20260709 12:23:33.652601  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:33.653267  8762 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.654295  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2145) took 1079 ms. Trace:
I20260709 12:23:33.629910 13516 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.627452 13672 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:33.654717  8142 rpcz_store.cc:276] 0709 12:23:32.575063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.575275 (+   212us) service_pool.cc:224] Handling call
0709 12:23:32.575615 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.212179 (+636564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.654045 (+441866us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:33.654237 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435541248}
I20260709 12:23:33.637425  8061 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:23:33.608376 13540 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.677125 13511 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.683543 13613 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.682528 13673 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.686167  8214 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:33.687054 13398 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.687567 13514 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.688262 13514 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.689363 13398 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.690312 13663 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:33.693460 13673 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.694742  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:33.712091  8142 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:33.695027  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:33.714360  8137 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:33.697454  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:33.699036  8216 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:33.699604  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:33.673738 13503 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:23:33.715583  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:33.697018 13663 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:33.726549  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.708382 13567 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.729611  8218 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:33.735867  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:33.736020  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.736937  8061 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.753398  8142 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:33.821599  8762 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
W20260709 12:23:33.754994  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 91274.9us
I20260709 12:23:33.759135  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:33.758276 13398 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.795022 13695 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:23:33.795666 13540 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.795984 13671 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:33.802143 13693 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:23:33.732034 13699 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:33.809340 13516 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:33.811901 13674 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:33.832585  8137 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:33.851411  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:33.838550  8061 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:23:33.974512  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.036944 13694 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:23:33.973580 13398 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.033488 13613 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.041096 13699 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:33.973713 13672 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.043709 13671 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.044436  8146 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:34.045630  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2256) took 1907 ms. Trace:
I20260709 12:23:34.064572  8139 rpcz_store.cc:276] 0709 12:23:32.137987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.145666 (+  7679us) service_pool.cc:224] Handling call
0709 12:23:34.030156 (+1884490us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400052dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.045571 (+ 15415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612423040}
W20260709 12:23:34.047442  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 196108us
W20260709 12:23:34.051678  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.043712  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2095) took 1237 ms (client timeout 1507 ms). Trace:
W20260709 12:23:34.067535  8214 rpcz_store.cc:269] 0709 12:23:32.806076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.915729 (+109653us) service_pool.cc:224] Handling call
0709 12:23:34.043490 (+1127761us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400374454. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.043633 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717823232}
I20260709 12:23:34.040542 13590 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:34.054723  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:34.053833 13499 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:33.740136 13567 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.071334  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:34.088563  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:34.071973  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.084390  8763 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:33.980695 13668 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.005s
I20260709 12:23:34.053439 13516 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:34.094187  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:34.034705 13214 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.064793 13699 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.077474 13590 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:34.097047 13696 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:34.097105 13503 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:34.104245  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:34.108968 13663 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:34.142048 13188 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:34.147264  8764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1080) took 2671 ms (client timeout 1935 ms). Trace:
I20260709 12:23:34.147555  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 833) took 1670 ms. Trace:
W20260709 12:23:34.147729  8764 rpcz_store.cc:269] 0709 12:23:31.476152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.563170 (+ 87018us) service_pool.cc:224] Handling call
0709 12:23:34.147020 (+2583850us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54002143d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.147188 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262890752}
I20260709 12:23:34.148285  8758 rpcz_store.cc:276] 0709 12:23:32.477056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.477185 (+   129us) service_pool.cc:224] Handling call
0709 12:23:34.147296 (+1670111us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b540064e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.147475 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158251392}
I20260709 12:23:34.149255  8757 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.150835 13617 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:34.150609 13590 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.151240 13617 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:34.143008  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:34.077406 13672 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.065106 13613 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.155035  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:34.113415 13516 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.117933 13668 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.157171 13663 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:34.161772 13188 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.152148 13617 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.174103 13567 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.174454 13668 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.176360 13672 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.162621 13503 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:34.183187 13674 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.184708 13214 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.185443 13617 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.187276 13657 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:34.189067 13488 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.189530 13488 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:34.190521 13488 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.192165 13488 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.204545 13699 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.207769 13699 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.049417  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.050168  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.261935  8066 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.267089  8064 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:34.280786  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.275254  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.285723  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.293347  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.313181  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:34.317770  8066 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:34.318639 13214 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.319764 13214 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.324122 13214 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.326467  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.328068  8139 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:34.329447 13445 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.330581 13445 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.331558 13516 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.337977  8142 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:34.338384  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.339407  8137 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.341333  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3259) took 1214 ms. Trace:
I20260709 12:23:34.349423  8065 rpcz_store.cc:276] 0709 12:23:33.126709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.126883 (+   174us) service_pool.cc:224] Handling call
0709 12:23:33.127224 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.368126 (+240902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.340579 (+972453us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003237d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:34.341087 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552114560}
I20260709 12:23:34.351868 13591 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.341486  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.407608  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.344056  8141 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:34.359666  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.409260  8145 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:23:34.409427  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.410109 13312 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.410473  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.410984  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.411053 13312 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.412046  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.361860  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.363801  8144 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.368654  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.370036 13445 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:34.374454  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 830) took 2707 ms. Trace:
I20260709 12:23:34.376190  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1016) took 2165 ms. Trace:
I20260709 12:23:34.386924  8137 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:34.390848 13221 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.391646  8763 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:34.395541 13293 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.398139  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:34.411983  8141 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:34.418223  8757 rpcz_store.cc:276] 0709 12:23:31.666598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.670245 (+  3647us) service_pool.cc:224] Handling call
0709 12:23:34.149053 (+2478808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.149692 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.373843 (+224151us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b54002143d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.374158 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5699932032}
I20260709 12:23:34.418541  8211 rpcz_store.cc:276] 0709 12:23:32.210639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.210765 (+   126us) service_pool.cc:224] Handling call
0709 12:23:32.211125 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.341575 (+1130450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.375455 (+1033880us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:34.375944 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505163648}
I20260709 12:23:34.453497  8143 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:34.454793  8139 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:34.455200  8143 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.456612 13540 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.457093  8145 raft_consensus.cc:2410] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:34.457399 13540 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.460476 13540 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.465816  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2182) took 1397 ms. Trace:
I20260709 12:23:34.466500  8063 rpcz_store.cc:276] 0709 12:23:33.068660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.073331 (+  4671us) service_pool.cc:224] Handling call
0709 12:23:34.465350 (+1392019us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400202bd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.465564 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672872192}
I20260709 12:23:34.467434  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:34.468688  8211 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:34.468816  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:34.468953 13674 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.470089 13255 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:34.470798 13255 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.473299 13613 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.473942 13613 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.474645 13613 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:34.475739  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2100) took 1665 ms (client timeout 1558 ms). Trace:
I20260709 12:23:34.476508  8139 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:23:34.469761 13674 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.468144  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:34.480777  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:34.482523 13293 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.480827  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.483101  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.483584  8139 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 10.
I20260709 12:23:34.485221  8139 raft_consensus.cc:1275] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:34.486517  8145 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:34.489130  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:34.490447  8145 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:34.490955 13512 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:34.491704 13512 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:34.492132  8137 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:23:34.493605 13674 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.493273 13512 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.495116  8145 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:34.497001 13671 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.484524  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:34.497758 13671 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.498400  8142 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.500146 13671 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.502292  8212 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.502434 13312 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:34.503468  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.515246  8145 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:34.476190  8216 rpcz_store.cc:269] 0709 12:23:32.810042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.027973 (+217931us) service_pool.cc:224] Handling call
0709 12:23:34.475395 (+1447422us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.475552 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1139387648}
I20260709 12:23:34.477404 13214 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:34.533107 13214 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.532573  8142 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:34.548379 13667 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:34.548764  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2106) took 1638 ms. Trace:
I20260709 12:23:34.548954 13667 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:34.549252  8217 rpcz_store.cc:276] 0709 12:23:32.867512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.462681 (+595169us) service_pool.cc:224] Handling call
0709 12:23:33.485710 (+ 23029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.493074 (+  7364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.477082 (+984008us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54002a5dd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.505462 (+ 28380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51744640}
I20260709 12:23:34.549806  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.550350 13667 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.552140 13488 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:34.553148 13488 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:34.554926 13488 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.565228 13667 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.568488 13398 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.571453 13613 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.571794  8731 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.573698 13670 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:34.573725  8144 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:34.579635  8141 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:34.516872 13671 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.574857 13670 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:34.580569 13516 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.590863  8212 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:23:34.593575 12644 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:23:34.595477 13682 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.596004 13682 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:34.597210 13682 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.598907 13682 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.600103  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2116) took 1128 ms. Trace:
I20260709 12:23:34.600497  8212 rpcz_store.cc:276] 0709 12:23:33.471338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.611498 (+140160us) service_pool.cc:224] Handling call
0709 12:23:33.611806 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.501749 (+889943us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5800658ad0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498c9e80aa 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca8eb49 00007f498ca8f416 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4
0709 12:23:34.591305 (+ 89556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.600040 (+  8735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67682176}
I20260709 12:23:34.589627 13516 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:34.608501  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.610510  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:34.613544 13613 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:34.616998  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 326891us
W20260709 12:23:34.625754  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.644901  8068 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
W20260709 12:23:34.668165  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 324353us
I20260709 12:23:34.653270 13221 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.673134  8035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.010s
I20260709 12:23:34.683841  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.685284  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:34.692319 13617 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.002s
W20260709 12:23:34.699543  8035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.007s	sys 0.011s
W20260709 12:23:34.676110  8061 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.015s
I20260709 12:23:34.694957  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:34.693922  8068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 868) took 1595 ms (client timeout 1750 ms). Trace:
I20260709 12:23:34.707351  8145 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:23:34.708026 13679 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:34.711683 13716 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:34.727236  8144 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:34.716600  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:34.718726  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:34.722151  8068 rpcz_store.cc:269] 0709 12:23:33.098141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.120721 (+ 22580us) service_pool.cc:224] Handling call
0709 12:23:34.693668 (+1572947us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400347e54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.693850 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3267198336}
I20260709 12:23:34.729221  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:34.731068  8061 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.003s	sys 0.020s
W20260709 12:23:34.730520  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 257524us
I20260709 12:23:34.678370 13221 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.726886 13716 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.734438  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.716418 13512 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:23:34.755610  8138 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:34.756699 13716 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.757030 13658 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:34.757750 13658 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.761240 13679 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:34.761953  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:34.762616 13679 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.763139  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.763835 13720 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:34.764582 13720 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.765537 13216 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:34.766134 13216 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:34.736616  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 778822us
I20260709 12:23:34.767354 13216 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.767849  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:34.742425  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.769107  8070 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
W20260709 12:23:34.769522  8062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 863) took 1997 ms (client timeout 1982 ms). Trace:
I20260709 12:23:34.735374  8066 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.744493 13312 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:34.745967  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:34.747920 13445 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:34.748811  8139 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:34.765021 13398 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:34.768343  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 840) took 1643 ms. Trace:
W20260709 12:23:34.771257  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.674922 13670 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.774035 13627 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:34.770002  8062 rpcz_store.cc:269] 0709 12:23:32.772115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.772274 (+   159us) service_pool.cc:224] Handling call
0709 12:23:34.769089 (+1996815us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54003949d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.769303 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948893952}
I20260709 12:23:34.773867 13312 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.744228 13293 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.776491  8759 rpcz_store.cc:276] 0709 12:23:33.124924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.205711 (+ 80787us) service_pool.cc:224] Handling call
0709 12:23:34.767846 (+1562135us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54005f0354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.768082 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240716032}
W20260709 12:23:34.788061  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.789201  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.793713 13584 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:34.794109 13512 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:34.794708 13512 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:34.795080 13514 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:34.795274 13584 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:34.795709 13584 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:34.793699 13722 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.797446 13722 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:34.800532  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.763356 13214 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.802438  8068 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:34.807394  8070 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:34.756702 12942 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.806209 13669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.019s	sys 0.010s
I20260709 12:23:34.772109 13720 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.760423 13658 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:34.817552  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 71874us
I20260709 12:23:34.824421  8065 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:34.815347 13669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.020s	sys 0.011s
I20260709 12:23:34.796200 13512 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.841043  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:34.842010  8758 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:34.842197  8760 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:34.832341  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:34.859073  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:34.856017  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:34.864399  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.830776 13293 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.877209  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:34.867993 12942 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.881757  8756 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:23:34.883098 13727 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:23:34.857772 13627 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:34.885375  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:34.888465 12942 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.889438  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:34.891141  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:34.890120 13696 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:34.891568 13488 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:34.892076 13488 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.892514 13488 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:34.892944  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.838768 13584 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.893741 13657 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:34.894383 13657 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.896733 13673 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.901724 13673 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:34.902537  8760 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:34.872134 13221 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:34.904242 13221 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:34.905663 13221 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.906486 13221 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:34.906548  8068 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:34.896945  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.909020  8757 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:34.887220  8759 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:23:34.913775  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 57346.6us
I20260709 12:23:34.874437 13720 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:34.934552  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.934484 13720 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:34.936127  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.907717 13221 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:34.913604 13731 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:34.948086  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:34.949841  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:34.908178  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 991) took 1291 ms. Trace:
I20260709 12:23:34.896868 13514 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:34.940099  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50895.3us
I20260709 12:23:34.886904 13627 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:34.913862 13657 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:34.951344  8146 rpcz_store.cc:276] 0709 12:23:33.617022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.632179 (+ 15157us) service_pool.cc:224] Handling call
0709 12:23:34.897583 (+1265404us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400253854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:34.907973 (+ 10390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945119616}
I20260709 12:23:34.912847 13734 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.944160 12942 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:23:34.976114  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88778.1us
I20260709 12:23:34.961404 13627 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.978850  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:34.956019 13514 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:35.019215  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43560.1us
I20260709 12:23:35.028014 13734 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.029138  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:35.028168 13221 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.029876  8067 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:35.004233 13445 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:35.026162 13514 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:35.038059  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:35.036896  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 98896.9us
I20260709 12:23:35.033458  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:35.018489 12942 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.041193  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:35.042038  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 878) took 1578 ms. Trace:
I20260709 12:23:35.045259  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:35.045859  8760 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:35.040338  8066 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:35.044250  8036 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:35.044044  8061 rpcz_store.cc:276] 0709 12:23:33.461760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.053084 (+591324us) service_pool.cc:224] Handling call
0709 12:23:34.053396 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.053603 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:34.776583 (+722980us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.953351 (+176768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.965799 (+ 12448us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:34.974607 (+  8808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.018809 (+ 44202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.039980 (+ 21171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7390,"prepare.queue_time_us":594135,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1788,"raft.queue_time_us":22187,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":22696,"thread_start_us":780165,"threads_started":2,"wal-append.queue_time_us":171717}
I20260709 12:23:35.048610 13639 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:35.049153 13639 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.042047 13312 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.049561 13639 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.049817 13672 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:35.050642 13672 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.051523 12942 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.051846 13672 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.049576  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:35.056537  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:35.061334 13293 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:35.062817 13255 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.072383 13724 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.113s
W20260709 12:23:35.075139 13728 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 12:23:35.061419  8757 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:35.082707  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.093346  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:35.094615  8763 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:35.093593  8756 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:35.096912  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.098888  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.101248 13679 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.101882 13679 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.105187 13679 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.105402 13734 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:35.106086  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.106153  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.109656  8759 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:35.114055 12644 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:35.111404  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.077859 13671 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.043972 13488 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.130805  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.132810 12644 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:35.132169  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103156us
I20260709 12:23:35.142063  8757 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:35.135159 13445 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:35.144652  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.131127 13679 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:35.149395  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:35.149138 13445 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.150009  8761 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:35.150669  8761 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:35.152163 13668 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:35.152697 13668 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.153898  8061 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:35.091897 13591 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:23:35.157552  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:35.141369 13733 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:23:35.163429 13398 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.164906 13592 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.165436  8764 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:23:35.165856 13732 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:23:35.165486 13592 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.153151 13668 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:35.166249 13488 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.168145 13746 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.164044 13398 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.170303  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.170555 13398 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.168247 13592 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.158807  8146 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:35.159655 12644 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:35.160749 13671 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:35.171934 13746 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.172147 13671 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.172662 13671 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.174620 13746 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:35.175685 13514 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.176827  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.178265 13514 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:35.178946 13746 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:35.181481 13671 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.159610  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:35.184880 13592 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.185422 13592 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:35.185899 13592 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.186770 13722 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.186731 13668 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.194464 13592 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.196746  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:35.197774  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:35.202088  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:35.180413  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.213040  8216 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:35.147565 13679 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.217903 13221 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:35.226244 12644 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.228255 13514 consensus_queue.cc:1048] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:35.229435 13743 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:35.209453 13591 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 12:23:35.233330 13738 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:23:35.232400 13716 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.237620  8141 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:35.238210 13716 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.241452  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 866) took 1878 ms. Trace:
I20260709 12:23:35.241920  8765 rpcz_store.cc:276] 0709 12:23:33.362491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.568134 (+205643us) service_pool.cc:224] Handling call
0709 12:23:34.773698 (+1205564us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:34.774526 (+   828us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:34.774561 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:34.775332 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 12:23:34.829689 (+ 54357us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:34.829739 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.838044 (+  8305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.938863 (+100819us) raft_consensus.cc:1685] finished
0709 12:23:34.938882 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.240990 (+302108us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005f0350. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:35.241227 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5191,"raft.queue_time_us":2764,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":22152,"spinlock_wait_cycles":2764232576,"thread_start_us":53653,"threads_started":1,"wal-append.queue_time_us":111861}
I20260709 12:23:35.250880  8216 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:35.205268 13671 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.220165 13679 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:35.255064  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 154583us
W20260709 12:23:35.259940  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 79598.9us
I20260709 12:23:35.291494  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.298413 13672 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:35.300122  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.300432 13752 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:23:35.301143  8036 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.301605 13722 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:35.298105  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 156234us
I20260709 12:23:35.305099  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:35.309796  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 73576us
I20260709 12:23:35.311488  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.314380  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.303784 13668 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.302881 13672 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.323079 13639 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.318022 13214 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:35.325372 13214 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.309983 13221 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:35.316242 13746 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:35.331910 13749 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:35.332805 13749 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.335477 13749 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:35.336794  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.338702 13673 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.352773 13754 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:35.353893 13754 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:35.354274 13754 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:35.355192 13754 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.316521 13734 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:35.385659  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67859.1us
W20260709 12:23:35.389747  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82853.6us
I20260709 12:23:35.396718 13752 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.397260 13511 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:35.397846 13511 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.397495 13752 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.398205 13511 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.399614 13512 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.400247 13752 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:35.330152 13221 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.357184 13746 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:35.402905  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 86287.4us
I20260709 12:23:35.407068  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.331090 13722 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.409888  8730 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.412432  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.412523  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.413349  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.414322  8145 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:35.415235  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.415419  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:35.415732 13593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.012s	sys 0.023s
I20260709 12:23:35.415954 13658 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:35.416814  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:35.404047 12942 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:23:35.418463 13221 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.421697 13659 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.429770  8139 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:35.423408 13590 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.408515  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.426244  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.380156 13734 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:35.356585 13754 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:35.428655  8142 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:35.430361  8137 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:35.428575  8138 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:35.434273  8137 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:35.435263  8137 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:35.431035 13659 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.436228 13739 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:35.437345 13659 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.437759  8219 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:35.438005  8145 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:35.439584 13516 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.439862  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.442094 13756 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:35.441872 13627 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.442529 13756 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.443034 13756 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:35.444216 13627 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.444921  8217 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:35.445417 13592 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.446514  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.447527 13748 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.448025 13748 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.448648  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.450316  8144 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:23:35.451757  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 55195.1us
W20260709 12:23:35.442585  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.458385  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.457429 13648 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:35.461170 13648 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.461454  8146 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:35.461540 13648 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.448712 13734 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.465974 13592 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:35.466661  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.467379  8146 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:35.404806 13639 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.450807  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:35.431079 13593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.016s	sys 0.023s
I20260709 12:23:35.469833  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:35.427232 13746 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.427906 13722 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.456990  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.474452  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.480873 13504 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:35.468052 13720 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.480449 13511 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:35.481897 13740 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.335s	user 0.003s	sys 0.000s
I20260709 12:23:35.483417 13511 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:35.475652 13722 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.489154  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.490303  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.492753 13734 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.472759 13658 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:35.475809 13221 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.493994 13722 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.493914 13658 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.473060 13659 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.496117 13734 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.497802 13504 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:35.497951 13663 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:35.498883 13504 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.500763 13722 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.500955  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.496095 13658 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:35.503434 13755 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:23:35.529805  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58085.2us
W20260709 12:23:35.530614  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73707.8us
I20260709 12:23:35.530920  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:35.504583 13718 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.803s	user 0.000s	sys 0.004s
I20260709 12:23:35.533411 13720 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:35.533859 13720 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.534209 13720 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:35.535319  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3260) took 2032 ms. Trace:
I20260709 12:23:35.506800 13724 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:35.536863 12942 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:35.537446 13724 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.537899 12942 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:35.538308 12942 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:35.538754 13724 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.540194 13657 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:35.513545 13529 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:35.515908  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64456.5us
I20260709 12:23:35.517583 13293 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:35.518977 12644 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:35.519565 13742 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.532748  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.520728 13488 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:35.520529  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:35.542135 12644 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:35.561677  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.575274  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 74418.4us
I20260709 12:23:35.520519 13741 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:23:35.579337  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:35.580034  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 103388us
I20260709 12:23:35.579610  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:35.583943  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51289.9us
I20260709 12:23:35.541868 13724 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.539155 12942 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.589092  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:35.535854  8064 rpcz_store.cc:276] 0709 12:23:33.502714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.304991 (+802277us) service_pool.cc:224] Handling call
0709 12:23:34.305906 (+   915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.306652 (+   746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.306727 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.314725 (+  7998us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.586499 (+271774us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:34.678142 (+ 91643us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.727366 (+ 49224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.727461 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.503912 (+776451us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:35.534962 (+ 31050us) raft_consensus.cc:1685] finished
0709 12:23:35.535098 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.535242 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78656,"prepare.queue_time_us":141707,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":58875,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":236,"spinlock_wait_cycles":36386560,"thread_start_us":313804,"threads_started":2,"wal-append.queue_time_us":335168}
I20260709 12:23:35.596062  8139 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:35.596288  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:35.573808 13669 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:35.601239  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:35.602485  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:35.603078  8137 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.598868 12644 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.540853 13657 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.587733 13214 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:35.613793  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.589351 13682 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:35.588680 13670 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:35.611138  7964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 260) took 51029 ms (client timeout 15000 ms). Trace:
I20260709 12:23:35.589515 13293 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:35.630594  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:35.629072 13682 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:35.644054 13748 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:35.654471 13753 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:23:35.655010  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 107260us
W20260709 12:23:35.793136  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.606716 12942 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:35.610225 13141 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:23:35.638368 12644 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.602229 13669 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.627676 13658 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:23:35.900010  8143 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:35.612162 13734 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.580226 13659 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:23:35.604051 13511 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:35.906798  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 386330us
I20260709 12:23:35.660817 13761 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.601297 13722 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:35.552804 13672 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:35.612025 13764 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.608698 13742 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:35.610442 13188 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:35.898619  8137 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:23:35.867187 13732 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.224s	user 0.000s	sys 0.005s
I20260709 12:23:35.928674 13761 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.924939  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:36.012003 13761 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.929940  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:36.013003  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 105286us
I20260709 12:23:36.013914  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:36.015229  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:35.865254 13741 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.009150 13504 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.924223  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:36.017241 13504 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:35.932502  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.018316  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:36.018949  8760 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:36.019547 13504 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:35.935775  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.017485  8764 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
W20260709 12:23:35.929774  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.681s (SENT) [suppressed 18 similar messages]
I20260709 12:23:36.024312  8757 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:23:36.009811  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.025251  8142 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:36.016539  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:36.026466  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:36.027052  8761 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.018339  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:36.029484  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:35.899488 13669 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.926986 13593 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.930794 13722 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.929279 13214 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.024264 13221 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
I20260709 12:23:36.038842  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:36.045450  8137 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:36.048084  8764 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.024116 13742 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:36.051237  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.054965  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:36.056140  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.030773 13584 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.023057 13511 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:35.893568 13670 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.028741 13764 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.029588 13663 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.050501  8214 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:36.052553  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 421999us
I20260709 12:23:36.059429  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.056186 13512 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:36.063362  8756 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:36.063457  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 993) took 2415 ms. Trace:
I20260709 12:23:36.039278 13748 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.049448 13722 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.066022  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.084612  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.057668 13742 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:36.066555 13639 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.069062 13504 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.071228 13668 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:36.098858  8110 leader_election.cc:336] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.557s (SENT)
I20260709 12:23:36.051348 13741 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.101367  8212 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:36.047699 13593 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.073613 13764 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:36.104456  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 478867us
I20260709 12:23:36.058178 13214 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.075385  8140 rpcz_store.cc:276] 0709 12:23:33.617662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.625824 (+  8162us) service_pool.cc:224] Handling call
0709 12:23:33.626181 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.626531 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.626558 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.144344 (+1517786us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b2c00010c48. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:35.148701 (+  4357us) log.cc:844] Serialized 26 byte log entry
0709 12:23:35.303179 (+154478us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:35.315028 (+ 11849us) log.cc:844] Serialized 14 byte log entry
0709 12:23:35.315268 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.317982 (+  2714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.466486 (+148504us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18002e6c00. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:36.025133 (+558647us) raft_consensus.cc:1685] finished
0709 12:23:36.025155 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.032646 (+  7491us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9997,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":1301,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"spinlock_wait_cycles":171704320,"thread_start_us":153988,"threads_started":1,"wal-append.queue_time_us":177372}
I20260709 12:23:36.090958 13216 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.109709  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 54868.1us
I20260709 12:23:36.110601  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:36.106058 13639 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.090224 13511 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.096532 13512 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.064284 13188 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.113485 13657 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.104446 13668 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.106241 13504 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.162099  8760 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:36.068867 13682 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.133255 13512 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.170454  8212 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:36.170677 13763 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:23:36.134881 13657 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:36.171361  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.153331 13668 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:36.164994 13648 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.703s	user 0.005s	sys 0.010s
W20260709 12:23:36.174214 13679 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.874s	user 0.010s	sys 0.005s
I20260709 12:23:36.174410  8761 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:36.071393 13293 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.114931 13221 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:36.178956 13529 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:36.180262 13724 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.002s
W20260709 12:23:35.870792  7964 rpcz_store.cc:269] 0709 12:22:44.581176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.581837 (+   661us) service_pool.cc:224] Handling call
0709 12:23:35.610875 (+51029038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:26.489214 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:26.552703 (+ 63489us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:26.562869 (+ 10166us) write_op.cc:435] Acquired schema lock
0709 12:23:26.562894 (+    25us) tablet.cc:662] Decoding operations
0709 12:23:26.564032 (+  1138us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:26.564119 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:26.564144 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:23:26.583256 (+ 19112us) tablet.cc:701] Row locks acquired
0709 12:23:26.583304 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:23:26.583504 (+   200us) write_op.cc:270] Start()
0709 12:23:26.583672 (+   168us) write_op.cc:276] Timestamp: P: 1783599806583429 usec, L: 0
0709 12:23:26.583710 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:23:26.584586 (+   876us) log.cc:844] Serialized 4795 byte log entry
0709 12:23:27.243510 (+658924us) op_driver.cc:464] REPLICATION: finished
0709 12:23:27.606410 (+362900us) write_op.cc:301] APPLY: starting
0709 12:23:27.606552 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:27.760485 (+153933us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:27.760668 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:27.775233 (+ 14565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:27.775606 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:23:27.775673 (+    67us) write_op.cc:312] APPLY: finished
0709 12:23:27.800750 (+ 25077us) log.cc:844] Serialized 113 byte log entry
0709 12:23:27.855040 (+ 54290us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:27.886048 (+ 31008us) write_op.cc:454] Released schema lock
0709 12:23:27.886118 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:27.886577 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:27.886606 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2180951,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":295920,"apply.run_cpu_time_us":18170,"apply.run_wall_time_us":303088,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54335,"num_ops":12,"prepare.queue_time_us":195951,"prepare.run_cpu_time_us":13607,"prepare.run_wall_time_us":220539,"raft.queue_time_us":323323,"raft.run_cpu_time_us":22451,"raft.run_wall_time_us":185570,"replication_time_us":659608,"thread_start_us":514621,"threads_started":4,"wal-append.queue_time_us":331980,"wal-append.run_cpu_time_us":57940,"wal-append.run_wall_time_us":2094345}]]}
I20260709 12:23:36.127338 13639 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.093181 13663 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.119863 13214 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.135144 13188 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.214814  8218 raft_consensus.cc:2410] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:23:36.172008 13504 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.221505  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:36.188458 13720 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
W20260709 12:23:36.188269 13746 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.005s
W20260709 12:23:36.188795 13754 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.009s
I20260709 12:23:36.147359 13216 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.132441 13764 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.173528  8214 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:36.227854 13221 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:36.214432 13766 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:23:36.223057  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105326us
I20260709 12:23:36.287642  8220 raft_consensus.cc:2410] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:23:36.241273 13724 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.231256  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 216133us
W20260709 12:23:36.243696  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 158114us
W20260709 12:23:36.233249  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69934.1us
I20260709 12:23:36.232941  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.231784  8764 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:36.239552 13682 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.245126 13657 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.240833 13529 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:36.244067 13663 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.280334  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:36.292579  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 362467us
I20260709 12:23:36.297061  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.303369  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.229851 13777 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:36.307638  8138 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:36.309219  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.310039  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:36.313037  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.287614 13221 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:36.244745 13679 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.230700 13648 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.292765 13776 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:36.332579  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.344861  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.325552  8218 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:36.338305  8214 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:36.375559  8062 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.288508 13674 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:36.338493 13512 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.343641  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.367727  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.306216 13639 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:36.338809  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.379959  8061 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.273636 13720 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.337261  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.338804  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.341118  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:36.344281  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64024.3us
I20260709 12:23:36.342072  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.341372  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.344581  8066 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:36.379508  8220 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:36.279328 13746 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.392318  8141 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:36.395902  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.391579  8065 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:36.398949  8216 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:36.344100 13488 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:36.406054 13488 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:36.407413 13488 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.408988  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.402112  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.343103 13672 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.346205 13739 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:36.322573 13772 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:36.404510  8068 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:36.402872  8215 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:23:36.411610  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 121708us
I20260709 12:23:36.318617 13724 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.403019  8140 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:36.415748  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.418128  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.381768 13674 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.420024 13741 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.420858 13722 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.421213 13670 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.422540 13216 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.340996 13774 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:23:36.341660 13529 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.425978 13764 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.387665 13512 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.532235  8220 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.533775  8063 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:36.534111  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:36.534153  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.560s (SENT)
I20260709 12:23:36.341054 13657 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.534111 13739 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:36.591553  8144 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.592378 13739 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.593326 13722 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.593485 13529 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:36.581669 13792 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:23:36.397716 13777 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.151s
I20260709 12:23:36.549038  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:36.597146  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 123202us
I20260709 12:23:36.597800  8214 raft_consensus.cc:2410] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 12:23:36.598371  8110 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.603s (SENT)
I20260709 12:23:36.598870  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:36.599002  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.599294 13657 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.600584  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.601805  8138 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:36.549703 13648 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:36.556473  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.603093  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.581236 13679 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:36.604712  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 89173.5us
I20260709 12:23:36.606099  8064 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:36.609347  8146 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
W20260709 12:23:36.538698  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.622567  8062 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:36.625813  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:36.627172  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:36.657474  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.670742  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:36.663094  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.671726  8140 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:36.673590  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46994us
W20260709 12:23:36.630604  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.062s	sys 0.112s
W20260709 12:23:36.675977  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.063s	sys 0.113s
I20260709 12:23:36.676294  8144 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:36.677595  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:36.574563 13724 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.603204 13512 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:36.631058  8729 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.750s (SENT)
W20260709 12:23:36.682322  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.592473 12942 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
I20260709 12:23:36.685650  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.687134  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.684294  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1039) took 1100 ms. Trace:
I20260709 12:23:36.399602 13776 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:36.633765 13756 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.190s	user 0.011s	sys 0.002s
W20260709 12:23:36.638494 13761 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.005s
I20260709 12:23:36.556118 13593 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:36.682847 13742 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
W20260709 12:23:36.694862 13669 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 12:23:36.403589 13639 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.679669 13488 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.691248 13780 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:36.686445 13216 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:36.739624  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.698066 13679 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.696787 13768 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:36.690435  8730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.031s	sys 0.080s
W20260709 12:23:36.704578  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73571.4us
I20260709 12:23:36.710963  8146 raft_consensus.cc:2393] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:36.717808 13648 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.713778  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:36.753667  8144 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:36.678555 13214 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.435680 13672 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.699801  8139 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:36.761633  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 346457us
I20260709 12:23:36.733675  8137 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:36.703364  8216 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:36.693624 13512 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.703524  8218 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:36.688860  8213 rpcz_store.cc:276] 0709 12:23:35.573146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.573345 (+   199us) service_pool.cc:224] Handling call
0709 12:23:35.602685 (+ 29340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.885520 (+282835us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:36.096254 (+210734us) log.cc:844] Serialized 14 byte log entry
0709 12:23:36.672775 (+576521us) log.cc:844] Serialized 14 byte log entry
0709 12:23:36.672946 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:36.672987 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:36.673029 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.673092 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.673198 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326325,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":6185,"raft.queue_time_us":50093,"spinlock_wait_cycles":22210176,"thread_start_us":693793,"threads_started":2}
I20260709 12:23:36.711232 13756 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.769335  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.770576  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.771664  8068 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:36.697330 13722 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:23:36.559015  7962 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 10 to 14, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 14 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.686668 13734 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:36.734982  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.754575  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.760079  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2277) took 1349 ms. Trace:
I20260709 12:23:36.761175  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:36.773435  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.734202 13742 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.804144  8144 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:36.784864  8146 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:23:36.780716 12942 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.787216 13756 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:36.851373 13293 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:36.788163 13764 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.760574 13648 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.792691 13670 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:36.794351  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.795055  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.795909  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2150) took 2323 ms. Trace:
W20260709 12:23:36.845604 13682 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
W20260709 12:23:36.799227  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.711578 13761 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.880980  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.783924  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.882408  8211 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
W20260709 12:23:36.747817  8730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.031s	sys 0.081s
W20260709 12:23:36.807004  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.883291  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 847501us
I20260709 12:23:36.810287  8061 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:36.844893  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.763295 13791 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.850234  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.888427  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:36.888779  8216 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:36.849858 12942 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:36.787829  8145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.022s	sys 0.085s
W20260709 12:23:36.889879  8145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.022s	sys 0.086s
I20260709 12:23:36.889623  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.890642  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2289) took 1296 ms. Trace:
I20260709 12:23:36.803838  8141 rpcz_store.cc:276] 0709 12:23:35.405876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.406029 (+   153us) service_pool.cc:224] Handling call
0709 12:23:35.415013 (+  8984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:36.393104 (+978091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.754478 (+361374us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54000523d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:36.754693 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247095168}
I20260709 12:23:36.737943 13669 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.849071  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:36.853250  8144 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:36.862797  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.891872  8144 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:36.796741  8219 raft_consensus.cc:2368] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17.
I20260709 12:23:36.868887  8143 rpcz_store.cc:276] 0709 12:23:34.472017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.497451 (+ 25434us) service_pool.cc:224] Handling call
0709 12:23:34.907850 (+410399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.907359 (+999509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.532195 (+624836us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400253854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:36.795712 (+263517us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400253850. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:36.795842 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3207689856}
I20260709 12:23:36.884866  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:36.892892  8764 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:36.885179  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:36.773177 13504 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:36.863859 13658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.015s	sys 0.064s
I20260709 12:23:36.756691 13216 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.760838 13679 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.896246  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.909397  8065 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:36.886935  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:36.804083 13789 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.933754  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.929080  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:36.938494  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:36.948367  8141 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:36.939707  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 90746.2us
I20260709 12:23:36.760939 13780 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.890985  8145 rpcz_store.cc:276] 0709 12:23:35.594354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.594549 (+   195us) service_pool.cc:224] Handling call
0709 12:23:35.594986 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.600987 (+  6001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.601036 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.614145 (+ 13109us) log.cc:844] Serialized 26 byte log entry
0709 12:23:36.890268 (+1276123us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:36.890311 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.890411 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:36.890454 (+    43us) raft_consensus.cc:1685] finished
0709 12:23:36.890466 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.890591 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2814,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9869,"thread_start_us":1275587,"threads_started":1,"wal-append.queue_time_us":488116}
I20260709 12:23:36.949920  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:36.944355  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:36.946759  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 59949.2us
W20260709 12:23:36.955302  8110 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.777s (SENT)
I20260709 12:23:36.782670 13512 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.960314  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:36.879688 13734 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.961493  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.973821  8216 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:36.763445 13768 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.984046 13774 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:36.963030  8068 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:36.967805  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.984802 13774 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:36.985706  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.985886 13774 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.986822  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:36.987133  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.987428  8211 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.968245  8764 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:36.967757  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:36.988554 13780 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.988910  8761 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:36.977587 13682 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:36.989197 13667 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.962462 13593 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:36.989830 13783 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:23:36.990084 13593 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.990540 13593 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.991209  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.992013  8061 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:36.880326 13720 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.970414  8212 raft_consensus.cc:2368] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:36.970448  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:36.992903 13789 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:36.993781  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63099.4us
W20260709 12:23:36.994668  8110 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.837s (SENT)
I20260709 12:23:36.995028  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:36.995368 13789 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.973760  8066 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
W20260709 12:23:36.989204  8184 connection.cc:256] RPC call timeout handler was delayed by -2.2257993990001523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 12:23:36.996447  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.989841 13667 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:36.992925  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.997627  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.986822 13639 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.998730  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:36.980142  8141 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:36.980882  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:36.982295 13748 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.885s	user 0.012s	sys 0.000s
I20260709 12:23:36.981642  7962 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 12, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 12 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.984154 13669 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.967746  8759 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:23:36.989630 13682 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:36.925470 13658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.016s	sys 0.065s
I20260709 12:23:36.975379  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:36.991210 13216 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.953094  8146 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:36.975122  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:36.937512 13504 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.064213  8065 raft_consensus.cc:2368] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18.
I20260709 12:23:36.996016 13789 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.008998  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.014707 13739 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.998600 13639 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:36.960062  8144 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:36.972556 13511 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:37.033181  8220 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:37.081151  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3290) took 1170 ms. Trace:
I20260709 12:23:37.081317  8214 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:37.081806  8220 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:37.081545  8219 rpcz_store.cc:276] 0709 12:23:35.911277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.911425 (+   148us) service_pool.cc:224] Handling call
0709 12:23:37.080978 (+1169553us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:37.081103 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721434368}
I20260709 12:23:37.083091  8219 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:37.083803  8061 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:37.084045  8214 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:37.084254  8220 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:37.035305  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:36.956260 13746 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:36.897903 13764 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.080432 13511 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.039539  8761 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:23:37.047479  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.040529  8218 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 11.
I20260709 12:23:37.069319 12942 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.069968  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.070611  7962 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:37.040865 13221 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.653s	user 0.014s	sys 0.000s
I20260709 12:23:37.072587 13674 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.072870 13756 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:37.074018 13216 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:37.041042 13748 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.074184  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.030131 13734 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.074687 13789 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:37.075712 13668 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.841s	user 0.006s	sys 0.004s
I20260709 12:23:37.077142 13776 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:36.933259 13791 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.077558 13512 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:37.079533 13772 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:23:37.079978  8144 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:37.085361  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.112150 13768 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.112699  8066 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.113029  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.114372 13784 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:37.114807 13784 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:37.115685 13784 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.085740 13511 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:37.116430  8144 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:23:37.086970 13764 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.088128  8215 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:37.088264 13593 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.120781  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1102) took 1186 ms. Trace:
I20260709 12:23:37.086463 13679 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.121244  8759 rpcz_store.cc:276] 0709 12:23:35.934354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.934479 (+   125us) service_pool.cc:224] Handling call
0709 12:23:36.029966 (+ 95487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.038634 (+1008668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.120482 (+ 81848us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400605254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:37.120710 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144104704}
I20260709 12:23:37.089385 13221 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.122525 13593 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.089685 12942 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.089897 13756 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:37.084265  8219 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:23:37.125588  8219 pending_rounds.cc:85] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 9
I20260709 12:23:37.124995 12942 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.125856  8219 pending_rounds.cc:107] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:23:37.126266  8219 raft_consensus.cc:2889] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.126307 13761 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.091282  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.125710 13756 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.127835  8065 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:37.128289 12942 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.128958  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.123991 13221 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.089088  7962 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:37.117380  8144 pending_rounds.cc:85] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 12
I20260709 12:23:37.129401  8062 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:37.102779  8063 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:37.127884 13771 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:37.090063 13674 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.094089  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:37.096271  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.096562 13789 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.097790 13748 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.099269  8218 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:37.092067  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.141206  8065 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:37.096316 13734 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.124105  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.102001 13668 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.134068 13667 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.102532 13786 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.164906  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.165565  8140 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:37.165381 13786 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.151839 13771 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:37.166646 13668 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.166707 13771 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.167616 13786 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.168660  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.169976  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.170538  8065 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.135991 13784 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.052374 13682 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.136459 13777 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.128778 13756 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.099593 13746 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:23:37.188912 13746 consensus_queue.cc:1243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:23:37.189492 13746 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:37.189599 13674 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.189854 13746 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:37.190757 13746 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.141736 13739 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.191895 13746 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:37.194775 13739 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:37.103257 13785 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:23:37.118737 13742 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.196815 13777 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.198907 13777 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:37.139843  8035 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.507s (SENT)
W20260709 12:23:37.201534  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61731.6us
I20260709 12:23:37.102424  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:37.143839  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.146279  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.153213  8068 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:37.146289  8066 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:37.111657  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:37.156010  7962 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 10 to 12, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 12 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.104131 13791 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.157877  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.210037  8139 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:37.109182 13772 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.107093 13657 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.158478 13748 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.160473 13768 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.161509  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.161689  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.160287 13670 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:37.149777  8211 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:37.171895  8064 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.142023  8144 pending_rounds.cc:107] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:23:37.231402  8144 raft_consensus.cc:2889] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.231223  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:37.160328  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47420.4us
I20260709 12:23:37.084839  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.232923  8061 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:37.183233  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.234262  8062 raft_consensus.cc:2410] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:37.184271  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.125224 13672 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.185731 13648 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.187335 13504 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.209106  8065 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:37.207441  8070 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:37.211953  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.212790  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.215756  8214 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:37.216957  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3294) took 1155 ms. Trace:
I20260709 12:23:37.236346  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.237957  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.239625  8217 rpcz_store.cc:276] 0709 12:23:36.061761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.061895 (+   134us) service_pool.cc:224] Handling call
0709 12:23:37.215290 (+1153395us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002b4654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:37.216894 (+  1604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304310528}
I20260709 12:23:37.238338  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.243486  8066 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:23:37.249754  8067 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:37.253540  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.268806  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:37.269418  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.277076  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 396264us
I20260709 12:23:37.279654  8061 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:37.282426  8061 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:37.284914  8067 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:37.284305  8069 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:37.281805  7962 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 14, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:37.287096  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.304067  8063 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:37.304100  8070 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:37.305696  8061 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:23:37.310616  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 332255us
I20260709 12:23:37.254824 13768 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.311053  8061 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:37.311071  8184 connection.cc:256] RPC call timeout handler was delayed by -2.0196993989998191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:23:37.323248  8184 connection.cc:256] RPC call timeout handler was delayed by -1.9044993990000876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 12:23:37.323822  8184 connection.cc:256] RPC call timeout handler was delayed by -1.7568993989998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 12:23:37.324329  8184 connection.cc:256] RPC call timeout handler was delayed by -1.0425639599998249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:23:37.324746  8184 connection.cc:256] RPC call timeout handler was delayed by -1.040763959999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:23:37.328279  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.328997  8146 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
W20260709 12:23:37.329922  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.333534  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 101004us
I20260709 12:23:37.300596 13775 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:37.332083  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.333891  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.284018 13657 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.310400 13670 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.359422  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.288620 13511 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.353574  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.366343  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.295765 13682 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:37.386588  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51983.1us
I20260709 12:23:37.387593  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:37.371358  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.333287 13771 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:37.390267  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.394675  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.392158  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.397255  8760 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:37.397264  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:37.337769 13672 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:37.338099 13775 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.393977  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.352736 13668 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:37.398684  8146 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:37.417919  8216 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.419401  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.418711  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:37.423005  8764 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:37.424384  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.425225  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.425912  8756 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:37.427707  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65538.9us
I20260709 12:23:37.362600 13667 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.395488 13214 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:37.434335  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.439164  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.392992 13742 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.352734 13512 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:23:37.465155  8765 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:37.400691 13673 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.346339 13800 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:23:37.476593  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:37.401369 13776 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.421099 13775 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:37.386221 13670 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.469730  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:37.504475  8759 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.488338  8764 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:37.491293  8760 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:37.362432 13293 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260709 12:23:37.493049  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 498365us
I20260709 12:23:37.501281  8763 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:23:37.519402 13670 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.521755 13657 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.522887  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.523164 13682 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.501122 13749 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:23:37.492672 13668 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:37.524482  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.525352  8211 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.491353  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:37.492782  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98922.4us
I20260709 12:23:37.528332  8756 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.400391 13216 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:23:37.438050 13667 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:37.463456  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 261291us
I20260709 12:23:37.530416  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.470080 13673 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.530893  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.533653  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.534941  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.535895  8217 raft_consensus.cc:2368] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:37.540326  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.541250  8138 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:37.543622  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.504272 13776 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.546685  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:37.548103  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.531088  8143 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:37.548983  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.556736  8211 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.557803  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.559128  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.549073  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.560913  8220 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:37.561748  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.562242  8220 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.548103  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.511276  8761 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:37.564728  8140 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:37.566329  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.567248  8137 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.501534 13808 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:37.553092  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.507073 13512 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:37.554347  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.463402 13672 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.506471 13754 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:37.572497  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.595810  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.560520  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:37.596392  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.597528  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.576217  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.578740  8220 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:37.587574  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.578951  8146 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:37.579818  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.467375 13593 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:23:37.515559 13214 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:37.528822 13748 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:37.585026  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.584983  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:37.609412  8062 raft_consensus.cc:2376] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17. Re-sending same reply.
I20260709 12:23:37.609756  8141 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:37.588773  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:37.591815  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.593986  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:37.607080  8211 raft_consensus.cc:2393] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.536921 13667 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.548580 13673 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.585420  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.616674  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.617513  8217 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:37.617736 13214 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.618502  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.619752  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.620378  8218 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:37.621299  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.621877  8218 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:37.622736  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.623095  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.623301  8218 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:37.624190  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.594534 13512 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.625020 13512 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.626020  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.619321  8217 raft_consensus.cc:2410] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:23:37.631067 13764 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:37.631624  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.632653 13764 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:37.633301  8035 leader_election.cc:400] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:37.633657  8035 leader_election.cc:403] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:37.634011  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:37.634611  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 128532us
I20260709 12:23:37.635012  8146 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:37.594975  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.637549  8756 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:37.621299  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.638749  8069 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:37.639849  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.642828  8212 raft_consensus.cc:2410] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:37.644943 13293 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:23:37.633018  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.646816  8220 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.624210  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.648425  8062 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.481962 13807 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 12:23:37.616720  8214 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.648531  8068 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:37.649542 13672 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.650067 13799 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:37.650738  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.652112  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.589367 13808 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.653139 13808 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.653561 13768 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.654485 13668 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.657691  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.658387  8070 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:37.658795  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2180) took 1246 ms. Trace:
I20260709 12:23:37.659333  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:37.660046  8070 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:37.659179  8142 rpcz_store.cc:276] 0709 12:23:36.413165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.728445 (+315280us) service_pool.cc:224] Handling call
0709 12:23:36.735683 (+  7238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.210768 (+475085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.210800 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:37.249755 (+ 38955us) log.cc:844] Serialized 26 byte log entry
0709 12:23:37.464081 (+214326us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:37.464135 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.464235 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.658586 (+194351us) raft_consensus.cc:1685] finished
0709 12:23:37.658607 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.658739 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45365,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":650767,"threads_started":2,"wal-append.queue_time_us":320781}
I20260709 12:23:37.662827 13639 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:37.607682 13754 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:37.669656 13754 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.669579 13639 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.672200 13639 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:37.634166 13764 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.663950  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:37.664422 12644 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:37.683467 12644 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:37.665288 13682 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:37.506623 13742 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.645745  8069 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:37.677837 13511 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:37.677366  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44191.8us
W20260709 12:23:37.784163  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.663107 13775 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.687510  8218 raft_consensus.cc:2393] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.616504  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:37.676599  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69559.2us
I20260709 12:23:37.786002  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:37.690992  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.788126  8140 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:37.544400  8138 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:37.569316 13776 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.698967  8217 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:23:37.709905  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.395246  7962 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 14, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 14 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:37.869935 13670 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:37.871361  7962 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.873205 12644 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:37.568130 13657 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.161s
W20260709 12:23:37.771986  8110 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.169s (SENT)
I20260709 12:23:37.772574  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.715689 13786 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:37.772544  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 86281.1us
I20260709 12:23:37.602859  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:37.779847  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105735us
W20260709 12:23:37.782145  8064 consensus_meta.cc:287] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 12:23:37.890105  8064 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:37.890278  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.890906  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 889) took 1102 ms. Trace:
I20260709 12:23:37.794576  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.876442  8756 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:37.891455  8064 rpcz_store.cc:276] 0709 12:23:36.788489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.091839 (+303350us) service_pool.cc:224] Handling call
0709 12:23:37.890825 (+798986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:37.793700  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:37.893258  8063 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:37.802083 13742 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:37.814226 13789 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
W20260709 12:23:37.816725 13746 consensus_meta.cc:287] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.624s	user 0.003s	sys 0.013s
I20260709 12:23:37.821653 13807 consensus_queue.cc:1243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:37.822172 13679 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:37.838440 13788 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:23:37.838510  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 890) took 1049 ms. Trace:
I20260709 12:23:37.849033 13803 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:37.891033  8217 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:37.892076  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 97609.7us
I20260709 12:23:37.972997 13803 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:37.973536 13803 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.973646  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.796921 13775 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:37.893769  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:23:37.984073  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 90412.6us
W20260709 12:23:37.894187  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 291448us
I20260709 12:23:37.898844  8759 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:37.910778  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.905215  8137 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:37.912331  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:37.913707  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 225087us
I20260709 12:23:37.930516  8142 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:37.930856  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.932916  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.991425  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.992115  8212 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:37.936522  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.772580 13216 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:37.919945 13682 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:23:37.993646  8761 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:37.993777  8217 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:37.943054  8066 rpcz_store.cc:276] 0709 12:23:36.788814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.248674 (+459860us) service_pool.cc:224] Handling call
0709 12:23:37.265704 (+ 17030us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:37.298424 (+ 32720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.298468 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:37.305355 (+  6887us) log.cc:844] Serialized 52 byte log entry
0709 12:23:37.550368 (+245013us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:37.606756 (+ 56388us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.630081 (+ 23325us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.630301 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.630376 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.838169 (+207793us) raft_consensus.cc:1685] finished
0709 12:23:37.838201 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.838413 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22716,"prepare.queue_time_us":98266,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":11249,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":3870,"thread_start_us":160778,"threads_started":1,"wal-append.queue_time_us":413158}
I20260709 12:23:37.945415  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:37.995564  8765 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.945572  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.931419 13504 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:23:37.946678  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:38.007941  8760 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:37.947082  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.947458  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:37.948947  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:37.873827  7962 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 13, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 13 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:23:37.950639  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72653.2us
W20260709 12:23:37.950521  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 348646us
I20260709 12:23:37.959002  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.962245 13748 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:23:37.964931  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:37.965855 13764 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:37.932706 13648 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:37.968498 13808 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:37.920560 13791 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:37.997119 13657 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.975118  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:37.931816 13784 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:37.997891  8218 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:37.990103  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:38.103010  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 112970us
I20260709 12:23:37.942219 13789 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.021026  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2209) took 1177 ms. Trace:
I20260709 12:23:38.022748  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:37.942601 13679 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:38.038352  8758 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
W20260709 12:23:38.080909  8145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.036s	sys 0.062s
W20260709 12:23:38.249148  8145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.037s	sys 0.062s
W20260709 12:23:38.162297 13741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.020s	sys 0.032s
W20260709 12:23:37.980924  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.248049  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 225376us
W20260709 12:23:38.023765 13771 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
W20260709 12:23:38.097476  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 122421us
I20260709 12:23:38.252934  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:38.159343 13754 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.105880  8070 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:38.253423  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.259740  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.105295  8186 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.106523 13590 raft_consensus.cc:2764] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:23:38.260915  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 155786us
W20260709 12:23:38.264092  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.213393 13756 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:38.211697  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.027s	sys 0.027s
I20260709 12:23:38.120110  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.080147 13670 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:38.287005  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.032s	sys 0.031s
I20260709 12:23:38.100960 13657 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:38.065241 13639 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:23:38.254621  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:38.160409 13827 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:23:38.028091 13799 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:23:38.100476 13724 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:38.104043 13807 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:38.286835 13749 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:38.019563 13216 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.314797 13216 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:38.141788  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 182862us
I20260709 12:23:38.316651  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.317446 13808 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:38.317615 13748 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:38.318127 13748 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:38.318548 13748 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.318795 13830 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:38.027797 13772 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 12:23:38.319278  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:38.108752  8065 rpcz_store.cc:276] 0709 12:23:36.843455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.285965 (+442510us) service_pool.cc:224] Handling call
0709 12:23:37.286336 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.286602 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:37.308525 (+ 21923us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.666703 (+358178us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b18002a03a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:37.985390 (+318687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:37.985479 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:38.020107 (+ 34628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.020399 (+   292us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.020827 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16513,"prepare.queue_time_us":17529,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3236,"raft.queue_time_us":5271,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":30418,"spinlock_wait_cycles":2336640,"thread_start_us":316546,"threads_started":1}
I20260709 12:23:38.119392  8211 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:38.320436 13839 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:23:38.245091 13836 log.cc:927] Time spent T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:38.211637 13720 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.322429  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.322176 13720 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.105412 13784 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.324852 13784 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:38.179116  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 194032us
I20260709 12:23:38.265823 13764 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.121567  7962 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 16, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 16 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:38.331804  7962 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 12, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 12 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:38.067282 12644 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.201854 13667 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.338860 13667 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:38.339260 13673 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:23:37.999446  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:38.287411  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 674889us
W20260709 12:23:38.339969  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 340575us
I20260709 12:23:38.341006  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.334029  7962 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.341320  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.340173  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.343199  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.343401 13682 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.305588 13807 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.344810 13830 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:38.344942 13807 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:38.345304 13830 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:38.345718 13830 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:38.348934 13761 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:38.349557 13761 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:38.343242 13742 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:38.350318 13742 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:38.350569 13761 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.351322 13742 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.353108 13216 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:38.353715 13216 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:38.354689 13216 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.269229  8138 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:23:38.356871 13772 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:38.357508 13772 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.295480  8214 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:38.239997 13776 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.344378  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.365844  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:37.986723 13512 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.286605 13771 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:38.254331 13741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.021s	sys 0.034s
I20260709 12:23:38.250484 13791 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:38.258280 13821 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:23:38.265686 13722 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:38.298875 13825 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:23:38.308966 13789 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:38.311762  8137 raft_consensus.cc:1217] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Deduplicated request from leader. Original: 8.9->[9.10-11.11]   Dedup: 9.10->[11.11-11.11]
I20260709 12:23:38.380505  8137 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:23:38.287942 13756 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:38.318689  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.321631 13754 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:38.161494  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 381853us
I20260709 12:23:38.004911 13593 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:23:38.325704  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:38.292069 13657 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:38.326400  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.327862  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:38.231448  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.250193  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2302) took 1046 ms. Trace:
W20260709 12:23:38.299692  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 179686us
I20260709 12:23:38.379679 13802 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:38.324522 13720 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:38.358108 13772 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:38.370783  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.325178 13749 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:38.455556  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 195890us
W20260709 12:23:38.385608  8219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.016s
I20260709 12:23:38.388216  8146 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:38.401804  8140 raft_consensus.cc:2368] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:23:38.440263  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:38.457121  8758 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:23:38.457057  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:38.447938  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.458305  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.408000  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 82366.7us
I20260709 12:23:38.369313  8765 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:38.450753  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:38.376133 13771 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:38.452950  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125159us
I20260709 12:23:38.468417  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.444867  8145 rpcz_store.cc:276] 0709 12:23:37.203973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.204677 (+   704us) service_pool.cc:224] Handling call
0709 12:23:37.204921 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.205101 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:37.426390 (+221289us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.249676 (+823286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.249752 (+    76us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:38.249814 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.249991 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.250134 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23584,"prepare.queue_time_us":715175,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":20914,"raft.queue_time_us":7416,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":14192,"spinlock_wait_cycles":5965568,"thread_start_us":1003126,"threads_started":3,"wal-append.queue_time_us":681291}
I20260709 12:23:38.436235 13724 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:38.292176 13670 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:38.456198  8219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.012s	sys 0.016s
I20260709 12:23:38.405228  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:38.368010 13829 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:38.386837 13722 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.470109  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.442042 13667 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:38.479471  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:38.469264 13720 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:38.482836  8110 connection.cc:256] RPC call timeout handler was delayed by -1.5278104349999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 12:23:38.396775 13673 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.467936 13786 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:23:38.488008  8110 connection.cc:256] RPC call timeout handler was delayed by -1.4029417400001876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 12:23:38.387218 13803 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.342440  7962 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:38.469501 13746 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:38.467463 13764 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:38.491792  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:38.467196 13511 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:38.493924  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:38.472764 13771 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:38.498625  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:38.502382  8068 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:38.501627  8070 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:38.510246  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:38.481302 13722 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.512560  8068 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:23:38.514832  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:38.515017  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:38.515578  8062 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.516927  8757 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:38.522290  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2228) took 1458 ms. Trace:
I20260709 12:23:38.488351 13802 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:38.490881 13829 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:38.490768 13667 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:38.499135 13799 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:38.489754 13786 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:38.535254  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:38.534555  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:38.486619 13504 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:23:38.476595 13846 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:23:38.497758 13849 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:38.561432  8110 connection.cc:256] RPC call timeout handler was delayed by -1.2746878769999057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:23:38.562139  8110 connection.cc:256] RPC call timeout handler was delayed by -1.0339417400000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24860000000000004s for a response
I20260709 12:23:38.557438  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:38.566264  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:38.572049  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 80360.5us
I20260709 12:23:38.572184  8069 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:38.522909  8067 rpcz_store.cc:276] 0709 12:23:37.064385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.328232 (+263847us) service_pool.cc:224] Handling call
0709 12:23:37.351953 (+ 23721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:37.683764 (+331811us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:37.770287 (+ 86523us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.829963 (+ 59676us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180046d320. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:38.082945 (+252982us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.084389 (+  1444us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:38.084473 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:38.084550 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.401752 (+317202us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b180046d320. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:38.474010 (+ 72258us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b180046d320. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:38.521276 (+ 47266us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180046d320. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419
0709 12:23:38.521932 (+   656us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54003958d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:38.521990 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.522203 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15650,"prepare.queue_time_us":93639,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":16238,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":40889,"spinlock_wait_cycles":850036608,"thread_start_us":236089,"threads_started":1,"wal-append.queue_time_us":391245}
I20260709 12:23:38.573964  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.574968  8145 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:38.531872 13754 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:38.576484  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.577343  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.513474 13511 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.581781  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.579457  8137 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:38.539258 13845 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:23:38.589156  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 94245.4us
I20260709 12:23:38.590909  8062 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:38.593766  8143 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:38.560039 13764 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.567932 13593 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.568161 13849 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.543696 13799 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.496201 13756 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.683571  8186 leader_election.cc:400] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:23:38.653916  8764 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:23:38.725673  8186 leader_election.cc:403] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:23:38.691912  8761 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:38.728149  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.650338  8765 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:38.693961  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.696745  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.605222  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:38.638531 12644 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:38.598309  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:38.651018  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:38.730952  8760 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.597851  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.679657  8763 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.734747  8140 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:38.725270  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.736917  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.734826 12644 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:38.738803  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:38.739110 12644 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.740537 12644 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.602046  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.661814  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3310) took 1109 ms. Trace:
W20260709 12:23:38.745188  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51310.4us
I20260709 12:23:38.746585  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.743996  8061 rpcz_store.cc:276] 0709 12:23:37.552870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.694572 (+141702us) service_pool.cc:224] Handling call
0709 12:23:37.773134 (+ 78562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.773559 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:37.932114 (+158555us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.450288 (+518174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.461503 (+ 11215us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.461720 (+   217us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:38.461776 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.461881 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:38.661534 (+199653us) raft_consensus.cc:1685] finished
0709 12:23:38.661560 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.661736 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32629,"prepare.queue_time_us":71981,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":83055,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":35925,"thread_start_us":386877,"threads_started":2,"wal-append.queue_time_us":360556}
W20260709 12:23:38.747802  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 82710.1us
I20260709 12:23:38.730150 13799 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:38.753893  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 179984us
I20260709 12:23:38.756479  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:38.616081 13823 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
I20260709 12:23:38.578732 13724 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.563791 13749 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.707702 13776 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:38.628198 13746 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:38.641289 13529 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.708272 13673 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:38.690423 13775 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.644615 13845 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:38.785181  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 180061us
I20260709 12:23:38.642716  7962 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 11, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.593874 13754 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.708595 13786 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.640978 13850 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.755550 13808 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.782675 13590 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.610777 13679 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.729786 13849 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.749967 13293 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:23:38.787508 13851 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:38.790593 13854 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.793467 13746 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.751484 13512 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:38.794348  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.601497 13741 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.173s
I20260709 12:23:38.772393 13669 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:38.797523  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.679433 13789 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:23:38.805724  8762 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:38.798938 13648 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:38.845670 13648 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.846177 13648 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.800736 13754 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:38.819370 13855 raft_consensus.cc:2764] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:38.850405 13855 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.795769 13845 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:38.851109 13855 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:38.850430  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.856961  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.828791  8146 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:38.818496 13851 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.865396 13673 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:38.866043 13673 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:38.867652 13673 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.870451 13673 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:38.872265 13873 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:38.882499 13875 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:38.886015 13875 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:38.888644 13875 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.886948 13648 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.883908 13873 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:38.839195  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 468468us
I20260709 12:23:38.752158 13593 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.863801 13851 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:38.911062  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.813027 13529 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.916265 13529 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:38.918087  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 162158us
I20260709 12:23:38.906222  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:38.806706 13843 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 12:23:38.804765 13842 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:23:38.934056  8146 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:38.798442 13786 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:38.940915  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:38.819386 13847 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:38.805686 13791 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:38.749876 13667 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.805305 13293 consensus_queue.cc:1243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:38.903100 13873 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:38.943524  8141 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:38.742236 13802 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.929934  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:38.808260 13854 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:38.795186 13670 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:38.949260  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:38.750020 13829 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:38.929420 13803 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:38.998310  8729 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.809s (SENT)
I20260709 12:23:38.798950 13850 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:38.952710  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 206197us
I20260709 12:23:39.000530  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:39.001494 12644 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.003604  8184 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:38.795559 13775 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.004498 12644 raft_consensus.cc:2764] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:23:39.006230 13775 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:38.944857 13668 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:38.804018 13846 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
W20260709 12:23:38.952023  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 350076us
W20260709 12:23:39.011075  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.940501 13856 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:38.797829 13214 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 12:23:38.994988  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:38.996971  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67097.8us
I20260709 12:23:38.943531 13512 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:38.951357 13791 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:39.035722  8146 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:39.008543  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:38.997251  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 239562us
W20260709 12:23:39.110694  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.992689  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 195224us
I20260709 12:23:39.018746  8138 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:38.979774 13872 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.023813  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 202420us
I20260709 12:23:39.024183  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:39.025269  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.112498  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 68099.3us
I20260709 12:23:39.020901  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:39.114492  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93733.9us
I20260709 12:23:39.095762  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1058) took 1147 ms. Trace:
I20260709 12:23:39.076876 13512 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:39.026137 13670 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.026898 13775 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:38.797716  7962 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.011119 13776 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:39.113700  8729 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.034s (SENT)
I20260709 12:23:38.944325 13800 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:23:39.153169  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:39.075574 13856 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:39.117331  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 108909us
W20260709 12:23:39.119006 13838 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.465s	user 0.001s	sys 0.000s
I20260709 12:23:39.119370 13879 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.123540 13830 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.777s	user 0.000s	sys 0.009s
I20260709 12:23:39.115134  8212 rpcz_store.cc:276] 0709 12:23:37.948197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.992741 (+ 44544us) service_pool.cc:224] Handling call
0709 12:23:37.993079 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.035096 (+ 42017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.035152 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.068456 (+ 33304us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.404082 (+335626us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:38.404130 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.404206 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.095503 (+691297us) raft_consensus.cc:1685] finished
0709 12:23:39.095525 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.095691 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6468,"raft.queue_time_us":41674,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":32431,"thread_start_us":295838,"threads_started":1,"wal-append.queue_time_us":448148}
I20260709 12:23:39.125720  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:39.126432  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 102307us
I20260709 12:23:39.124336 13742 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.106189 13511 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:39.161393  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:39.165422  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51766.5us
I20260709 12:23:39.169957  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:39.178495  8729 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 2.050s (SENT)
I20260709 12:23:39.179044  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:39.129256 13775 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:39.181820  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56231.6us
I20260709 12:23:39.155319 13776 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:39.152318 13866 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:23:39.197012  8110 leader_election.cc:336] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.557s (SENT)
I20260709 12:23:39.197974  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.198880  8070 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:39.098462 13873 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.201654  8061 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:39.172124 13214 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:23:39.203660  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91210.2us
I20260709 12:23:39.170598 13803 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.204246  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:39.131454 13846 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:23:39.114734 13875 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.172283 13742 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.191524 13800 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:39.210263  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:39.210567 13824 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.003s	user 0.000s	sys 0.006s
I20260709 12:23:39.211200  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:39.230525  8066 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:39.214260  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.211771  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:39.133306 13670 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.231573  8063 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:39.219095  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.189651 13512 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.201992 13776 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.228174  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2198) took 1447 ms. Trace:
I20260709 12:23:39.181933 13720 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:23:39.117336 13872 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.223711 13742 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:39.247280 13869 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:23:39.222079 13772 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.748s	user 0.014s	sys 0.004s
I20260709 12:23:39.246227 13859 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:23:39.206234 13789 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:39.222908 13771 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.002s
I20260709 12:23:39.272464 13775 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.307446 13679 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.338445 13775 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:39.298836 13668 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:39.341189 13668 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:39.316290 13853 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:23:39.344918  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2204) took 1074 ms. Trace:
I20260709 12:23:39.345086  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2200) took 1078 ms. Trace:
W20260709 12:23:39.288223  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.345417  8142 rpcz_store.cc:276] 0709 12:23:38.266486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.266933 (+   447us) service_pool.cc:224] Handling call
0709 12:23:38.294304 (+ 27371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:38.450120 (+155816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.450160 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:38.455121 (+  4961us) log.cc:844] Serialized 52 byte log entry
0709 12:23:38.560250 (+105129us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:38.595924 (+ 35674us) log.cc:844] Serialized 14 byte log entry
0709 12:23:38.681102 (+ 85178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.681210 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.259577 (+578367us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18003ebba0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:39.260159 (+   582us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b18003ebba0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:39.312787 (+ 52628us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18003ebba0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:39.315594 (+  2807us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:39.344861 (+ 29267us) raft_consensus.cc:1685] finished
0709 12:23:39.344879 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.345033 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127834,"prepare.queue_time_us":32912,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":117108,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":8234,"spinlock_wait_cycles":100852992,"thread_start_us":216253,"threads_started":2,"wal-append.queue_time_us":232637}
I20260709 12:23:39.348816 13771 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.300674 13593 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:39.351470 13771 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:39.345309  8144 rpcz_store.cc:276] 0709 12:23:38.270737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.271499 (+   762us) service_pool.cc:224] Handling call
0709 12:23:38.293583 (+ 22084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:38.448862 (+155279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:38.448917 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:38.449723 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.932668 (+482945us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:38.932706 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.932779 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.344699 (+411920us) raft_consensus.cc:1685] finished
0709 12:23:39.344719 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.344857 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23191,"raft.queue_time_us":25402,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":570854,"threads_started":2,"wal-append.queue_time_us":625082}
I20260709 12:23:39.233791 13862 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:23:39.124747 13791 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.166605 13874 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.305s
I20260709 12:23:39.358960 13791 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:39.206226 13877 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:39.359412 13883 log.cc:927] Time spent T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:39.359684 13877 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:39.231003  8069 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:39.360695 13877 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.272416 13756 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.361523  7962 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 11, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.209146 13214 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:39.363866 13214 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:39.307564 13849 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 12:23:39.365110 13214 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.364683  7962 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.365314 13849 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.367369  7962 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 14, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 14 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:39.256726  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47210.8us
I20260709 12:23:39.335188 13875 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:39.210870 13876 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.282465 13670 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:39.372946 13876 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.373334 13876 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.311221 13216 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:39.185281 13529 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:39.258657 13866 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:39.259583 13858 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:23:39.259943 13886 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:23:39.263115 13854 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:39.202772 13749 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:23:39.231508 13800 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:39.175856 13830 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.173969 13879 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.267069 13639 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:39.269301 13855 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:39.272105 13808 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:23:39.215238 13648 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:39.255915  8139 rpcz_store.cc:276] 0709 12:23:37.780704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.780888 (+   184us) service_pool.cc:224] Handling call
0709 12:23:37.887675 (+106787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:37.930971 (+ 43296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:37.931010 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:37.944973 (+ 13963us) log.cc:844] Serialized 26 byte log entry
0709 12:23:38.376677 (+431704us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:38.376724 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.376798 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:39.225790 (+848992us) raft_consensus.cc:1685] finished
0709 12:23:39.225816 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:39.228086 (+  2270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43009,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":29106,"thread_start_us":431210,"threads_started":1,"wal-append.queue_time_us":528994}
I20260709 12:23:39.352363  8064 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:39.352852 13669 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.463414  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:39.464824  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 349966us
W20260709 12:23:39.305486 13807 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.960s	user 0.002s	sys 0.009s
I20260709 12:23:39.297282 13856 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:39.340256 13772 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.354506 13789 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.472649 13789 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.473928 13772 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:39.308151  8757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 875) took 1919 ms. Trace:
I20260709 12:23:39.474745  8757 rpcz_store.cc:276] 0709 12:23:37.388834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.388990 (+   156us) service_pool.cc:224] Handling call
0709 12:23:37.417057 (+ 28067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.524188 (+1107131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.307902 (+783714us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400213754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:39.308092 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528861568}
I20260709 12:23:39.475571  8214 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:39.292240 13741 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:39.443572 13590 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.357528  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.305408 13867 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.390s	user 0.004s	sys 0.000s
I20260709 12:23:39.375067 13216 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.254029  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:39.489406  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 235450us
I20260709 12:23:39.320295 13845 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.383276  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:39.328378  8063 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:39.409559  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:39.408497  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 207674us
I20260709 12:23:39.429107  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:39.430171  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:39.501757  8213 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
W20260709 12:23:39.431569  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.432914  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:39.434552  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:39.328533 13722 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
W20260709 12:23:39.295759 13748 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.931s	user 0.011s	sys 0.000s
W20260709 12:23:39.328258 13784 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.961s	user 0.009s	sys 0.000s
I20260709 12:23:39.441756  8061 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:39.441802  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:39.521152  8760 raft_consensus.cc:2410] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:23:39.258193 13873 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:39.441605 13724 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:39.447423 13672 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:39.447553  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:39.448380  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:39.378659 13886 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:39.402788 13746 consensus_meta.cc:287] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.002s
I20260709 12:23:39.462062 13849 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:39.425073 13799 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.672s	user 0.002s	sys 0.017s
I20260709 12:23:39.475992  8214 pending_rounds.cc:85] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 6
I20260709 12:23:39.436880 13800 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.280489 13872 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:39.479681  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:39.553589  8765 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:39.480301  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:39.555480 13786 consensus_meta.cc:287] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.003s
I20260709 12:23:39.474805 13669 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:39.379213  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 206244us
I20260709 12:23:39.558362 13669 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:39.558583  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.559559  8731 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:39.492805  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 279689us
I20260709 12:23:39.561416  8064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:39.562305  8064 raft_consensus.cc:606] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:39.563306 13893 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:39.563907 13893 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.566684  8763 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:39.510052 13754 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:39.495922  8146 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:39.467305 13529 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:39.497658  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:39.498730  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:39.502662  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:39.505427 12644 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:39.699361  8145 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.510289  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:39.699620  8213 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
W20260709 12:23:39.489215 13657 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 1.017s	user 0.008s	sys 0.004s
I20260709 12:23:39.519274  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:39.703701  8141 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:39.630959 13639 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:23:39.477170 13741 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:39.529804  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.529064  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:39.535455  8215 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:39.540609  8070 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:23:39.540409  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.843303  8063 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:39.542135  8214 pending_rounds.cc:107] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:39.849987  8214 raft_consensus.cc:2889] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:39.541023  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:39.543300  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.545751 13746 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.851557  8069 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:39.488951 13590 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.486651  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:39.568208  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.576260  8765 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:39.854678  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.478672 13807 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.855600  8070 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:39.578941  8216 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:39.485249 13772 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:23:39.858496  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:39.545121 13847 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.001s
W20260709 12:23:39.638128  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 71792.3us
I20260709 12:23:39.537742 13886 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:39.544643 13672 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.567715  7962 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.572911  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:39.653697  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.533978 13784 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.528053 13748 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.518811 13722 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.538628 13667 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 12:23:39.690186  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:39.538328 13724 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.695291  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:39.508916  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:39.699642 12644 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:39.700968  8213 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:39.568156 13799 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.523524  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:39.705746  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:39.689051 13894 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:23:39.726625  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.672338 13768 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:39.844272 13844 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.845333 13789 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:39.845782 13890 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:23:39.849289 13741 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.491770 13856 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:23:39.859578  8211 raft_consensus.cc:2368] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:39.859427  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:39.860908  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 374386us
I20260709 12:23:39.860746  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:40.020925  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 160294us
I20260709 12:23:40.021938  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:40.021790  7962 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.023102  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:39.694527 13529 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:40.025133 13293 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.025463 13772 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:40.026005 13772 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:40.025782 13293 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.027027 13799 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.026888 13772 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.001839 13768 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.027843 13293 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:39.854584  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.028286 13768 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.888780  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:39.872161  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:39.838195 13754 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.976472  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:40.027701 13799 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:39.889391 13742 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.007s
I20260709 12:23:39.979775  8146 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:39.993723  8142 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:39.996075  8220 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:39.996116  8064 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:39.996493  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 473028us
I20260709 12:23:40.047379  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:39.948072 13847 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:39.998817 12644 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:39.999786  8065 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:39.849397 13771 consensus_queue.cc:1059] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 12:23:39.887458 13862 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:39.767560 13657 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.025054  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.028724  8061 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:40.001628 13593 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:39.767061 13888 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.017060  8070 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.017329  8067 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:23:40.029881  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.031229  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:40.032308  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.032040 13529 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:39.869724  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:40.086349  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.035529 13892 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:23:39.975500  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.096982  8140 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
W20260709 12:23:40.037664  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 165649us
I20260709 12:23:40.097481  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.098006  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.039983  8145 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:40.099649  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.054718  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:40.057040  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80774.8us
I20260709 12:23:40.102445  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:40.037043 13877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.021s
I20260709 12:23:40.015456 13830 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.063545 13879 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.082499  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.091655  8213 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:40.094908  8064 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:23:40.103794  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.104176  8066 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:40.060205 13293 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:40.083691 13896 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:40.008535 13844 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.024001  7962 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 1 to 14, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:40.137084  8142 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:23:40.137606  8142 pending_rounds.cc:85] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 11
I20260709 12:23:40.137882  8142 pending_rounds.cc:107] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:23:40.138164  8142 raft_consensus.cc:2889] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:40.111230 13529 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.110947 13667 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:40.114224 13847 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:40.114529 13907 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.154057 13907 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.154273 13748 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.154493 13907 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.101883 13888 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.114619 13786 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:40.156940 13888 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.157231 13786 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:40.157642 13786 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:40.115435 13904 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:40.157970 13784 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:40.116374 13902 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:40.062199 13886 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.053396 13754 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.117058  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:40.119102 13668 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.777s	user 0.004s	sys 0.004s
I20260709 12:23:40.160137 13668 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.161257 13754 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.162241 13668 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:40.121505  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.162829 13776 consensus_meta.cc:287] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.887s	user 0.007s	sys 0.003s
I20260709 12:23:40.124658  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.163241 13776 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.165270 13776 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.134689 13896 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:40.166066 13896 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:40.169943  8137 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.169698 13907 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.171835 13907 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.178206 13657 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.179596 13672 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.058866 13742 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.182137 13742 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:40.193370 13903 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:40.194613 13893 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.083107 13673 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:23:40.207036  8137 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:40.211405 13679 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.000s
I20260709 12:23:40.157984 13786 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:40.199977 13847 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:40.110031 13877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.004s	sys 0.021s
I20260709 12:23:40.090610 13862 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:40.148497 13900 log.cc:927] Time spent T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:23:40.150154 13898 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:23:40.110361  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 241901us
W20260709 12:23:40.202780 13775 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.003s
W20260709 12:23:40.232317  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.238190  8070 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:40.232923  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:40.216857 13893 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.244596  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:40.242844  8213 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
W20260709 12:23:40.246575  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 673715us
I20260709 12:23:40.247633  8758 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:40.247502  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:40.245756  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 223892us
W20260709 12:23:40.257555  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 234517us
I20260709 12:23:40.263176  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:40.264019  8758 raft_consensus.cc:2368] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:40.265794  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:40.269479 13908 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:40.272845 13791 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.913s	user 0.013s	sys 0.000s
I20260709 12:23:40.277245  8063 raft_consensus.cc:2410] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:23:40.279148  8760 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:40.241580 13724 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.243240 13776 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:40.282200  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:40.283769  8758 raft_consensus.cc:606] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.284144  8758 raft_consensus.cc:614] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:40.249641 13722 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.276118  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:40.259282  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.292675  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.292685  8762 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:40.295859  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:40.300096  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.287931 13873 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 12:23:40.303057  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.303792  8070 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:40.316164  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:40.316998  8762 raft_consensus.cc:606] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.317354  8762 raft_consensus.cc:614] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:40.317919 13590 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.286137 13776 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:40.264411 13893 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:40.302242 13876 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.926s	user 0.006s	sys 0.007s
I20260709 12:23:40.345038  8070 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:40.345232  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 85944.8us
I20260709 12:23:40.291059 13682 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:23:40.244050  7962 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 10 to 13, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 13 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.356746 13876 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.359264 13876 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.358280  7962 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 11, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 11 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:40.344111 13862 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.361426 13741 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.362545 13786 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.297963 13847 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.371649 13855 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:40.372200 13855 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:40.373355  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.360514 12644 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.374960  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:40.394455  8061 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:40.396924  8070 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:40.397284  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:40.368533 13800 consensus_meta.cc:287] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.000s
I20260709 12:23:40.403163  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.326792 13776 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:40.406476  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:40.406515  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 351869us
I20260709 12:23:40.408511  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.375913 13722 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:40.375859 13866 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.330822 13667 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:40.412647  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 304118us
I20260709 12:23:40.414536  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:40.416416  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.419879  8061 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:40.420948  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:40.400794 13772 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.426885  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.422495  8070 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.427790  8061 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:40.409011 13791 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.428776 13214 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:40.430579  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.431110 13873 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:40.432410 13863 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.432777  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "767edb8a304f440591a33aae36a36252"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:40.443725  8762 raft_consensus.cc:606] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.444178  8762 raft_consensus.cc:614] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:40.415769 13722 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:40.433034 13855 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.428870 13874 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:40.404531 13912 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:40.410004 13844 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.412261 13529 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.410768 13800 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.438457 13791 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:40.425732 13866 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.433125  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.407563 13887 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:23:40.429136 13876 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:23:40.443123 13863 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.450419 13722 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.450050 13639 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:40.452283 13912 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:40.458774  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.460809  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.469439  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.475648  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.488503  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.488867  8137 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:40.452823 13786 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.477392  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.453159 13874 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:40.476210  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:40.492870  8139 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:40.496642  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.505739  8213 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:40.497872  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.507843  8070 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
W20260709 12:23:40.490557  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 219315us
I20260709 12:23:40.514963  8070 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:40.461037 13791 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.471463 13863 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.524508  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.531541  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:40.526343  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 251793us
I20260709 12:23:40.529093  8035 leader_election.cc:400] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:40.479489 13639 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:40.452208 13768 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.506851 13844 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.514778 13724 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:40.537236  8035 leader_election.cc:403] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:23:40.494153 13912 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:40.508385 13874 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:40.504611 13772 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:40.540970 13756 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 1.179s	user 0.008s	sys 0.011s
I20260709 12:23:40.537114  8109 leader_election.cc:400] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:40.548319 13639 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.551673 13768 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:40.561496 13915 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:40.560869 13844 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.562021  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:23:40.592222  8109 leader_election.cc:403] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:23:40.595932  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 292824us
W20260709 12:23:40.598526  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69667.7us
I20260709 12:23:40.603981  8762 raft_consensus.cc:606] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.605965  8762 raft_consensus.cc:614] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:40.601720  8212 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:23:40.607352  8212 pending_rounds.cc:85] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 10
W20260709 12:23:40.607575  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 76994.7us
I20260709 12:23:40.566625 13214 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:40.608958  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.609227  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:40.610018  8110 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.606s (SENT)
I20260709 12:23:40.607616  8212 pending_rounds.cc:107] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:23:40.610777  8212 raft_consensus.cc:2889] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:40.611241  8110 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.613s (SENT)
I20260709 12:23:40.616261  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.617179  8220 raft_consensus.cc:2376] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13. Re-sending same reply.
W20260709 12:23:40.620225  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.538328 13657 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:23:40.493676 13667 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.545589 13891 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:23:40.597847 13724 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:40.606983 13784 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:40.641561  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.642194  8070 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:40.601078 13893 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.665138  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3321) took 1466 ms. Trace:
I20260709 12:23:40.665560  8065 rpcz_store.cc:276] 0709 12:23:39.198706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.198804 (+    98us) service_pool.cc:224] Handling call
0709 12:23:40.664929 (+1466125us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400321ed4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:40.665079 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768768768}
I20260709 12:23:40.666963  8062 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:40.644304 13872 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:40.622568 13679 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:40.628212 13829 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:23:40.628736 13639 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:40.646330  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.647114  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.667s (SENT)
I20260709 12:23:40.647305 13807 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.651518 13873 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:40.688783  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.663256  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3313) took 1466 ms. Trace:
I20260709 12:23:40.663991 13746 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:40.669181  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.593322 13786 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:23:40.679735  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.685441  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.639355 13802 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:40.689412  8137 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:40.688687  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:40.641038 13927 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.751333  8063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 916) took 1058 ms. Trace:
I20260709 12:23:40.751739  8063 rpcz_store.cc:276] 0709 12:23:39.692985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.857950 (+164965us) service_pool.cc:224] Handling call
0709 12:23:40.751111 (+893161us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400320fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:40.751273 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961148928}
I20260709 12:23:40.695824  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.753652  8143 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:40.706667  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.754659  8065 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.689419  8067 rpcz_store.cc:276] 0709 12:23:39.196422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.196567 (+   145us) service_pool.cc:224] Handling call
0709 12:23:39.201407 (+  4840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.091244 (+889837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.662967 (+571723us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001f5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:40.663187 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875914112}
I20260709 12:23:40.755987  8211 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:40.757393 13849 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.758024 13849 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.711483 13874 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.690639  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:40.762930  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:40.764009  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.629384 13214 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.674448 13593 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.765002 13593 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.766348 13214 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:40.714890 13896 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.004s
I20260709 12:23:40.773137 13896 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.775278 13896 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.775868 13927 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.777225  8070 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:40.778191 13927 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.780799 13776 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.781781 13722 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.783926 13722 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:40.793504  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.778245 13912 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.800418 13912 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.689144 13873 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:40.721853  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 909) took 1203 ms. Trace:
I20260709 12:23:40.723034 13845 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.732256 13893 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.802270 13873 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.802721 13893 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.803551 13873 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:40.801957  8068 rpcz_store.cc:276] 0709 12:23:39.518182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.518470 (+   288us) service_pool.cc:224] Handling call
0709 12:23:39.518804 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.547638 (+ 28834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.547676 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:39.548233 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.119686 (+571453us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800080860. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:40.420721 (+301035us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:40.637854 (+217133us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.643309 (+  5455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.643629 (+   320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:40.721018 (+ 77389us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b2400172178. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:23:40.721603 (+   585us) raft_consensus.cc:1685] finished
0709 12:23:40.721627 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.721788 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33371,"prepare.queue_time_us":310128,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":37016,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"spinlock_wait_cycles":53968000,"thread_start_us":517409,"threads_started":2,"wal-append.queue_time_us":990510}
I20260709 12:23:40.805042 13893 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.732745 13720 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:40.805683 13720 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:40.806357  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 159267us
W20260709 12:23:40.807003  8110 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.682s (SENT)
I20260709 12:23:40.807343  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:40.807703 13720 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.734972  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 911) took 1207 ms. Trace:
I20260709 12:23:40.808255  8062 rpcz_store.cc:276] 0709 12:23:39.527094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.527226 (+   132us) service_pool.cc:224] Handling call
0709 12:23:40.666691 (+1139465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.667537 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.734725 (+ 67188us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400321ed0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:40.734888 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561156992}
I20260709 12:23:40.739286  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:40.809703  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 70557.4us
I20260709 12:23:40.811192  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.811977 13669 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:40.812718 13724 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.813462 13909 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:40.813858 13909 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.814195 13909 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:40.741745 13800 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.817420 13800 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.743359 13844 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.745862 13855 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:40.748941 13830 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.820868 13830 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.822728  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.823014 13830 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.749469 13854 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.768939  8066 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:23:40.823462  8068 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:40.823686  8066 pending_rounds.cc:85] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 13
I20260709 12:23:40.824826  8066 pending_rounds.cc:107] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:23:40.825124  8066 raft_consensus.cc:2889] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:40.822793  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.827950  8062 raft_consensus.cc:2376] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13. Re-sending same reply.
I20260709 12:23:40.829797 13916 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.830153 13844 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:40.830363 13916 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.830896 13866 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.830683 13844 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.812359  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:40.834196  8729 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:40.837173  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:40.846208  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:40.852185  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.855208  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:40.856091  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2324) took 1362 ms. Trace:
I20260709 12:23:40.856546  8139 rpcz_store.cc:276] 0709 12:23:39.494094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.494259 (+   165us) service_pool.cc:224] Handling call
0709 12:23:39.511564 (+ 17305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.506406 (+994842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.855844 (+349438us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400253d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:40.856032 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240953600}
I20260709 12:23:40.855333  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.823271 13669 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:40.865859  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:40.867409 13789 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:40.868206 13916 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.872221  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.874302  8062 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:23:40.876349  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 380272us
I20260709 12:23:40.880604  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 1031) took 1188 ms. Trace:
I20260709 12:23:40.881011  8144 rpcz_store.cc:276] 0709 12:23:39.691761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.691930 (+   169us) service_pool.cc:224] Handling call
0709 12:23:39.836982 (+145052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:39.843246 (+  6264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:39.843406 (+   160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:40.539966 (+696560us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b2c00010c48. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:40.565636 (+ 25670us) log.cc:844] Serialized 26 byte log entry
0709 12:23:40.840033 (+274397us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:40.840087 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.840176 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:40.880334 (+ 40158us) raft_consensus.cc:1685] finished
0709 12:23:40.880353 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.880544 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5449,"raft.queue_time_us":5621,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":42456320,"thread_start_us":237780,"threads_started":1,"wal-append.queue_time_us":289394}
I20260709 12:23:40.888617  8137 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:40.895103  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.895927  8068 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:40.897046  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.898033  8061 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:40.900317  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:40.855801 13927 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:40.907271  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.861641 13741 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:40.901624 13800 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:40.812245 13863 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.860600 13803 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:40.913316  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:40.914409  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:40.904181 13893 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.917261 13893 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.917687 13891 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:40.918691 13891 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:40.919066 13891 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:40.915730 13896 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:40.921686 13216 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.924834 13670 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:40.925452 13670 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:40.925762 13593 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.926358 13670 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.927780 13863 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:40.823746 13854 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:40.921205 13935 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:23:40.930202 13854 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.916493  8070 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:40.920006 13891 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.932294 13891 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.940724 13942 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:23:40.941951 13942 consensus_queue.cc:1243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:23:40.942473 13854 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:40.943837 13886 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:40.946171 13668 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:40.946681 13668 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:40.947674 13668 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.949122 13887 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:40.949409 13784 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:40.894397 13849 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:40.920202 13893 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:40.959683  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.968951  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:40.969856  8220 raft_consensus.cc:2368] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:40.967897  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:40.970366  8140 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:23:40.965499  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.971087  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:40.971601  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.972478  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.973863  8143 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:40.974323  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:40.974512  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167528us
W20260709 12:23:40.975205  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.976369  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.977596  8146 raft_consensus.cc:2410] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:40.978359  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.979635  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.980301  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:40.980504  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:40.862864 13909 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:40.986526  8213 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:40.950941 13927 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:40.985476  8139 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:40.980315  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.989391  8143 raft_consensus.cc:2393] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:40.986469  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.957249 13741 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:40.958351 13887 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:40.999907  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:40.993901  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.001737  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.001935  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:40.992786  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:40.993393 13742 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.993538  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:40.993903 13908 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:41.003585 13786 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.004701  8146 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:40.966091 13872 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:23:40.994858  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:40.991429 13791 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:40.997440  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:40.998750 13909 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:40.966717 13776 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.002341  8142 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.974140 13863 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:41.020233  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.020509  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.020866  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.021267  8144 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:41.007869  8110 leader_election.cc:336] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.699s (SENT)
I20260709 12:23:41.003782 13908 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.009868  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.010526  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.024505  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.011777  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.012727 13887 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.015295  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.015763  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.016147  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.027318  8143 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:41.022528  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.023159  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.023324  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.024115  8758 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:41.027422  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 172316us
I20260709 12:23:40.999723 13668 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.028561  8765 raft_consensus.cc:2410] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:23:41.029260  8220 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:41.029592  8213 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:41.023694  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.757s (SENT) [suppressed 34 similar messages]
I20260709 12:23:41.030469  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.032115  8218 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:41.030753  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:41.028247  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.033442  8211 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:23:41.028321  8216 raft_consensus.cc:2376] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15. Re-sending same reply.
I20260709 12:23:41.033985  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:41.004727 13789 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:41.038230  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.038627  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.033273  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:41.021721 13748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.022s
I20260709 12:23:41.035168  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:41.040652  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.047168  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.038833  8218 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:41.049561  8211 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:41.036260  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.049853  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.050341  8214 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:23:41.036375  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.046510  8143 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:41.032159  8110 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.780s (SENT)
I20260709 12:23:41.047224  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.036052  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.051713  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.051888  8215 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:41.052585  8144 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:41.048547  8219 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:41.048398  8758 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:41.053017  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.035322  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.050529  8137 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:41.053797  8215 raft_consensus.cc:2368] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:41.051141  8146 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:41.055279  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.055823  8761 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:41.056447  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.056741  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.057025  8220 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.057521  8216 raft_consensus.cc:2368] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16.
W20260709 12:23:41.058421  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.058971  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.060011  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.060644  8214 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:41.020304 13863 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.069428  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.070060  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.070401  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.070935  8146 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.071194  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.071902  8143 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 13: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:41.071949  8110 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.959s (SENT)
I20260709 12:23:41.072430  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.061432  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.070091  8070 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.058014  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.064723 13927 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:41.049165 13748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.006s	sys 0.022s
I20260709 12:23:41.067806  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.075335  8213 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:41.076174  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:41.088020  8110 leader_election.cc:336] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.984s (SENT)
I20260709 12:23:41.014467 13742 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.077291  8214 raft_consensus.cc:2368] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:41.095873  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.081559  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.080046  8220 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:41.097249  8216 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.068735  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:41.101495  8761 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:41.084069  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.039284 13916 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:41.113026  8756 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:41.115010  8762 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:23:41.115605  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.075757  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.089228  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:41.091144  8142 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:41.116812  8215 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:41.039110 13756 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:23:41.051530 13909 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:41.093370  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.104508  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.107052  8216 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:41.107797  8035 leader_election.cc:400] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:41.081106 13863 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.117547  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.064731 13791 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.089715  8143 raft_consensus.cc:2410] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:23:41.050258 13529 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:23:41.121074  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.192556  8142 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:41.113283 13918 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.113447 13720 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:41.092311 13849 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:23:41.125398 13909 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.184844 13913 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.185791  8035 leader_election.cc:403] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:41.171448  8146 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:41.149078  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.240700  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.241135  8146 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:41.241528  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.128237  8070 raft_consensus.cc:2468] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:41.189415  8759 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:41.092070 13945 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:41.050169 13789 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.105345 13862 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:41.108935 13874 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.194015  8142 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:41.085455 13802 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.109025 13872 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:41.092795 13941 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:41.121603 13847 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.116040 13741 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.076602  8140 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:41.208614  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.308833  8219 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:41.208122  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:41.225541  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.226241  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.227164  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.229559  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.231796  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.208108 13720 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.235239 13669 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.183812 13916 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:41.183665 13776 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:41.201453 13902 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:23:41.141819  8110 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.054s (SENT)
W20260709 12:23:41.339926  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 198133us
I20260709 12:23:41.126794  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:41.342008  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 215274us
W20260709 12:23:41.243762  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 136103us
I20260709 12:23:41.244617  8146 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:41.245076 13942 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:41.246726  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.139668  8137 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:41.239276 13909 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:41.358105  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.311805  8216 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.313724  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.360981  8219 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:41.318591  8214 raft_consensus.cc:2410] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:41.297283 13791 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.323741 13720 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:41.330022 13669 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:41.331004 13946 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:23:41.331552 13940 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:23:41.332295 13844 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:41.348068  8110 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.080s (SENT)
I20260709 12:23:41.401283  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.351395  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.299120 13945 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:41.300820 13872 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:41.211498 13918 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.368119  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.380131  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:41.381307 13936 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:23:41.383140 13855 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.000s
I20260709 12:23:41.298962 13862 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.356751 13672 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:41.392604 13953 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.419699 13724 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.419608  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.374701 13950 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.449513  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 108915us
W20260709 12:23:41.450544  8110 leader_election.cc:336] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.116s (SENT)
I20260709 12:23:41.451155  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:41.421013  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53024.3us
I20260709 12:23:41.425496 13862 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:41.429056 13742 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:41.391963 13913 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 12:23:41.415870  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64569.7us
I20260709 12:23:41.460650  8035 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.352716 13776 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.409873 13872 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:41.433094  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.434166 13672 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.433714 13844 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:41.468400  8218 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
W20260709 12:23:41.469013  8110 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.128s (SENT)
I20260709 12:23:41.470181  8216 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:41.443912 13639 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.472347  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.495494  8220 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:41.496531  8215 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:41.500286  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.501327  8220 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:41.472355  8763 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:23:41.470355  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.502312  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.457710 13849 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.501873  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.476799 13672 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:41.460469 13942 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:41.492578  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.494403 13724 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.513362  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.532500  8216 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:41.531536  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.509783  8070 raft_consensus.cc:1240] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:41.531536  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:41.514676  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.534271  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:41.515918  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.535503  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.535805  8068 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:41.409024 13945 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.540026  8063 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [9.9-12.10]
W20260709 12:23:41.530104  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61110.9us
I20260709 12:23:41.540498  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.536113  8215 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:41.538185  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.538287  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.544034  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.457944 13950 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.533532  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.545814  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:41.542213  8110 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.181s (SENT)
I20260709 12:23:41.554703 13756 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.554849  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.555749  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.584944  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.555881  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.586365  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.586503  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.556157  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.556797 13529 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.448297 13916 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.560932  8063 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:41.562808  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.556829 13789 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:41.566990  8070 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:41.454598 13953 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.569599 13918 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:41.572974 13639 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:41.597317  8110 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.415s (SENT)
I20260709 12:23:41.582914  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.605489  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.591941 13756 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.592832  8064 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:41.602523  8061 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:41.581460  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.599398  8216 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:41.608577  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.610299  8216 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:23:41.612303  8216 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:23:41.629998  8137 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:41.630543  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.633634  8220 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:41.542779  8184 connection.cc:256] RPC call timeout handler was delayed by -1.6142714090001391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 12:23:41.634919  8218 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
W20260709 12:23:41.628917  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 304583us
I20260709 12:23:41.633349  8216 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:23:41.637801  8216 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:41.589689 13856 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.642850  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.643218  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.593127 13847 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:41.601511 13639 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.634923  8220 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:23:41.646651 13847 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.648922 13847 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:41.649659  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.650396 13921 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.651111 13921 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:41.651401 13908 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.629501 13789 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.639127 13958 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:41.634943  8061 raft_consensus.cc:2393] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:41.653708  8061 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:23:41.654879  8061 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:41.654500 13856 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.655161 13669 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:41.658689  8218 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:23:41.659152  8218 pending_rounds.cc:85] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 11
I20260709 12:23:41.600878 13529 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.641993  8064 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:41.531828 13849 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.645565  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.659389  8218 pending_rounds.cc:107] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:23:41.661214  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2329) took 2165 ms. Trace:
I20260709 12:23:41.677632  8218 raft_consensus.cc:2889] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:41.661559  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 201015us
I20260709 12:23:41.680025  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.681933  8764 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:41.682336  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.664109  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.685410 13748 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.685623  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:41.666761  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.689073  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.665531  8216 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:23:41.634125 13742 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.670372  8063 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:41.692144  8216 pending_rounds.cc:85] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
I20260709 12:23:41.692764  8216 pending_rounds.cc:107] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:23:41.694353  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.681668  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.696831  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.697798  8757 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:41.666060 13639 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.677450  8138 rpcz_store.cc:276] 0709 12:23:39.495955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.496281 (+   326us) service_pool.cc:224] Handling call
0709 12:23:39.496575 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.219410 (+722835us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:40.235771 (+ 16361us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.486266 (+250495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:40.486343 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:40.486403 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.921770 (+435367us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800400d80. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419
0709 12:23:41.656617 (+734847us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400311d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:41.661005 (+  4388us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.661150 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49583,"prepare.queue_time_us":21597,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":48,"raft.queue_time_us":27667,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":17983,"spinlock_wait_cycles":1685080192,"thread_start_us":206271,"threads_started":1,"wal-append.queue_time_us":372335}
I20260709 12:23:41.657425 13927 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:23:41.693583  8216 raft_consensus.cc:2889] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:41.702116  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52527.7us
W20260709 12:23:41.698348  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 101055us
I20260709 12:23:41.659775 13844 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:41.639155 13918 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:23:41.641681 13866 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:23:41.685621  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:41.707844  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.711241  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:41.700125 13668 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.007s
W20260709 12:23:41.715632  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.721334  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.712575 13963 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.647179 13593 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:23:41.717494  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:41.717885  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.698724 13724 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:41.719985  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:41.651121 13952 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:23:41.728359  8141 raft_consensus.cc:2410] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:23:41.732057  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:41.673949 13954 consensus_queue.cc:1059] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:23:41.747797  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.750958  8757 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:41.754470  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:41.754969  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64290us
I20260709 12:23:41.698495 13748 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:23:41.758577  8764 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:41.739955 13916 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:41.743631 13802 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:23:41.756678 13863 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.008s
I20260709 12:23:41.750867 13668 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.761547  8035 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.762284  8110 leader_election.cc:400] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
W20260709 12:23:41.774407  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 79725us
I20260709 12:23:41.754791 13921 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.753633 13856 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.781503  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.782644  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.787379  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:41.801510  8137 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:41.790453  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:41.789290  8110 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.913s (SENT)
I20260709 12:23:41.778748  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:41.804934  8216 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:41.770514 13748 consensus_queue.cc:1243] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 1659f359000d40bda3fc864911b1c75c log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:41.790916  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.807282  8220 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:41.744452 13963 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.770807 13967 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.775139 13667 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:41.809140  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.810302  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3326) took 1520 ms. Trace:
I20260709 12:23:41.827036  8066 rpcz_store.cc:276] 0709 12:23:40.289476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.290095 (+   619us) service_pool.cc:224] Handling call
0709 12:23:40.752569 (+462474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.825591 (+ 73022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.810090 (+984499us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400320fd0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:41.810237 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062776192}
I20260709 12:23:41.777309 13593 raft_consensus.cc:3055] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:23:41.809508 13961 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:41.776561 13943 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.808460 13856 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.825671  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:41.826998  8216 raft_consensus.cc:2376] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16. Re-sending same reply.
I20260709 12:23:41.777076 13916 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:41.835842  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 150297us
I20260709 12:23:41.847580  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:41.833433 13593 raft_consensus.cc:740] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:41.820936  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:41.845259  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.845489  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:41.811023 13724 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:41.851686  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.858863  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.859478  8066 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:41.859869  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.852864  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:41.857980  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.861253  8064 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:41.860383  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.834100 13776 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.780450 13863 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.838469 13855 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:41.843010 13886 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.887s	user 0.013s	sys 0.000s
I20260709 12:23:41.826591 13667 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:41.862335  8066 raft_consensus.cc:2410] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:23:41.879057  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:41.851980 13791 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:41.881489  8216 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:41.875005 13963 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.843612 13976 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:41.779114 13844 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:41.885329  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92590.7us
I20260709 12:23:41.885601  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.909713  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:41.864051 13962 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:23:41.909900  8063 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:41.843207 13756 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.847647 13953 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.895511  8061 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:41.913815 13978 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.914080  8061 pending_rounds.cc:85] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 10
I20260709 12:23:41.914474  8061 pending_rounds.cc:107] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:41.914824  8061 raft_consensus.cc:2889] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.898852  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3329) took 1475 ms. Trace:
I20260709 12:23:41.865855 13967 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:41.915619  8212 rpcz_store.cc:276] 0709 12:23:40.423472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.428933 (+  5461us) service_pool.cc:224] Handling call
0709 12:23:40.429253 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:40.632887 (+203634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.898565 (+1265678us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002256d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:41.898775 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391026432}
I20260709 12:23:41.873150 13849 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.881738 13802 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:41.874951 13893 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:41.837248 13866 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.917376 13893 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:41.917708 13866 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.918599 13893 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.920166 13893 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:41.861986 13977 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:41.920768 13866 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.903144 13886 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.905791  8215 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 17. Ops: [15.12-15.12]
I20260709 12:23:41.846724 13748 consensus_queue.cc:1059] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:41.922464 13748 raft_consensus.cc:3055] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:41.922194 13872 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.922856 13748 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:41.923805 13748 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.875702 13724 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.911706  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.909999 13529 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:41.864610 13965 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:41.877719 13672 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.886876 13776 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:41.907837  8216 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:41.913570 13667 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.863152 13856 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.913213  8062 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:23:41.908566 13974 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:23:41.929616  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 50665.3us
I20260709 12:23:41.948252  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.904735 13976 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:41.864943 13916 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:41.942807 13969 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:23:41.943387 13972 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:41.958732 13863 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:41.932933 13776 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.924605 13872 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.960989  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.951675 13963 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:41.964104 13847 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:41.967150 13720 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:23:41.967950 13639 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.955063 13981 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:23:41.954811 13667 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.926455  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.938803  8220 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
W20260709 12:23:41.983022  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56661.8us
I20260709 12:23:41.983897  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:41.984614  8066 pending_rounds.cc:85] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 11
I20260709 12:23:41.984503  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:41.985001  8066 pending_rounds.cc:107] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:23:41.985291  8066 raft_consensus.cc:2889] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.986276  8068 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:41.986344  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:41.944036  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98623.7us
I20260709 12:23:41.990098  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.998075  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:41.998507 13847 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:41.998925  8063 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:41.932963 13791 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:41.927567 13918 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:23:41.938035 13977 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:42.001570 13977 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:41.980276 13984 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:42.004949 13982 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.005936 13982 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.007984  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.972007 13776 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.010295  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 876) took 1014 ms. Trace:
I20260709 12:23:41.925338 13529 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.017518  8761 rpcz_store.cc:276] 0709 12:23:40.995910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.011001 (+ 15091us) service_pool.cc:224] Handling call
0709 12:23:42.010111 (+999110us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b54005307d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:42.010233 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79115648}
I20260709 12:23:42.027271  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:41.929170 13593 consensus_queue.cc:260] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:41.930693 13672 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.031612  8063 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:42.006667 13921 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.034361  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:42.039759  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:42.009091 13847 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.010224 13863 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.047092  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.048756  8761 raft_consensus.cc:2410] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:41.978650 13720 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.052325 13593 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:42.065205  8069 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:42.066259 13720 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.036204 13986 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 12:23:41.960022 13968 consensus_queue.cc:1175] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1659f359000d40bda3fc864911b1c75c" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 12:23:42.071620  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2355) took 1016 ms. Trace:
I20260709 12:23:42.072116  8142 rpcz_store.cc:276] 0709 12:23:41.055007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.301093 (+246086us) service_pool.cc:224] Handling call
0709 12:23:41.301395 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.374152 (+ 72757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.374199 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:41.374258 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:41.374304 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.071336 (+697032us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b5400352854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:42.071390 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.071548 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166772096}
I20260709 12:23:42.036335 13941 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.031381 13679 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:42.076879 13742 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:42.077421 13742 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:42.078356 13742 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.079444 13742 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:42.083667 13975 log.cc:927] Time spent T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.178s	user 0.001s	sys 0.003s
I20260709 12:23:42.086391  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.087142  8759 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:42.088181  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:42.089164  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.091959 13943 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.033481 13971 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.095350  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.096580  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:42.096971  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.097728  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.098567  8758 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:42.099054  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:42.099583  8758 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:42.101284  8759 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:42.102296  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:42.084400 13909 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 12:23:42.103077  8729 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:42.103780  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.104053  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.105019  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:42.103762  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 67793.4us
I20260709 12:23:42.113883  8216 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:42.114120  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.115335  8220 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:42.122821  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.123073  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.123627  8216 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.119760  8140 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:42.124955  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 85499us
I20260709 12:23:42.116849  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:42.127300  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.128111  8220 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.128355  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.039180 13873 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:23:42.134330  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:42.102892 13847 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:42.142541  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.142931  8220 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:42.145332  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.115909 13953 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:42.123785 13803 raft_consensus.cc:2804] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:42.141345 13682 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:42.151713 13953 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:42.161640 13639 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.103183 13921 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:42.162252 13682 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.123477 13909 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.148177 13669 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:42.145155 13855 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:42.166270  8139 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:23:42.169384  8216 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:42.174455  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1131) took 1107 ms. Trace:
I20260709 12:23:42.172914  8211 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:23:42.170284 13991 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 12:23:42.164916 13512 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:23:42.185915  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 874) took 1192 ms. Trace:
I20260709 12:23:42.186233  8757 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:42.186430  8756 rpcz_store.cc:276] 0709 12:23:40.993162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.993291 (+   129us) service_pool.cc:224] Handling call
0709 12:23:42.185698 (+1192407us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54005f1c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:42.185844 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251949824}
I20260709 12:23:42.180143  8765 rpcz_store.cc:276] 0709 12:23:41.066564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.066680 (+   116us) service_pool.cc:224] Handling call
0709 12:23:41.066984 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.310897 (+243913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.310938 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:41.310982 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:41.311015 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.174109 (+863094us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400477054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:42.174184 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.174380 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560483200}
I20260709 12:23:42.195173 13953 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.178381 13720 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.197077 13720 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.199138 13909 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:42.199947 13720 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.172912 13803 raft_consensus.cc:697] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:42.176505 13669 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.201191 13669 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.201432 13803 consensus_queue.cc:237] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.205875  8110 leader_election.cc:400] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:42.206386  8110 leader_election.cc:403] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:23:42.217958  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:42.218684  8070 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.173637 13682 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:42.222481  8068 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:42.220615  8765 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:23:42.223052  8757 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:42.226400  8110 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.231099  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.253643  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.259230  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.255940  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.261758  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.262890  8070 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:42.274811  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.276058  8213 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:42.240603 13941 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:42.240062 13512 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:42.271976  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:42.222158 13854 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:23:42.252018 13999 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.264271 13957 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:42.230396 13960 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:23:42.278529 13741 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.262938 13800 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:23:42.285341 13941 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:42.271907 13639 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:23:42.321507 13960 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.322264 13941 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:42.300984 13994 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:23:42.334861  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 61283.1us
I20260709 12:23:42.337592  8110 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.339262 13512 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:42.335554 13741 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:42.362423  8761 raft_consensus.cc:1240] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:42.339745 13960 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:42.371271  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103921us
I20260709 12:23:42.360845 13741 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:42.379420  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.379107  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.380930  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.381400  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.355166 13512 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.377523  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.383656  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:42.386797  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.387004  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.387315  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:42.387981  8068 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:42.390281  8068 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:42.390681 13918 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:42.394889  8066 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:23:42.390477  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.401317 14004 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:23:42.402235 14005 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:23:42.390687 13982 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.382915 13855 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.403627 13855 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.393539  8065 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: [9.9-12.10]
I20260709 12:23:42.366868 13776 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.383456 13529 consensus_queue.cc:1059] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:23:42.385197 13977 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.419049 13977 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.421301 13977 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:42.421747 14006 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:42.399021 13741 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.424081  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:42.388281 13992 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:23:42.390312  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.413261 13529 raft_consensus.cc:3055] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:42.414336 13964 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
I20260709 12:23:42.418267 13512 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.422138  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:42.410761 14002 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:23:42.434391  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.434655  8066 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:42.434019  8109 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:42.436669  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46438.6us
I20260709 12:23:42.444784 13756 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:42.446671  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:42.433876 13529 raft_consensus.cc:740] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:42.441776 13982 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.442988 13512 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.398548 13669 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.468945 13960 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:42.473003 13949 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.221s	user 0.004s	sys 0.000s
I20260709 12:23:42.476397  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2339) took 1500 ms. Trace:
I20260709 12:23:42.476786  8145 rpcz_store.cc:276] 0709 12:23:40.975861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.976012 (+   151us) service_pool.cc:224] Handling call
0709 12:23:40.987086 (+ 11074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:40.987421 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:40.987461 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.009222 (+ 21761us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.254555 (+245333us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:41.254609 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.254692 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.472353 (+1217661us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:42.476096 (+  3743us) raft_consensus.cc:1685] finished
0709 12:23:42.476119 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.476334 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":311,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14012,"spinlock_wait_cycles":93060992,"thread_start_us":204498,"threads_started":1,"wal-append.queue_time_us":224252}
I20260709 12:23:42.478412 13682 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.480610 13529 consensus_queue.cc:260] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.481575 13742 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.482156 13529 raft_consensus.cc:3060] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:42.482242 13742 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.484710 13742 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.486234 13682 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:42.442757 13863 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:23:42.487641 13863 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:42.487978 13863 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:42.488780 13863 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.489535  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 1037) took 1513 ms. Trace:
I20260709 12:23:42.490005  8141 rpcz_store.cc:276] 0709 12:23:40.975846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.978043 (+  2197us) service_pool.cc:224] Handling call
0709 12:23:42.489304 (+1511261us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400312c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:42.489465 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706292480}
I20260709 12:23:42.492280 13776 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.492554 13941 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.454114 13807 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:23:42.494964 13941 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.497045  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:42.502830 13639 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:42.503742 13927 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:42.504172 13927 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:42.510860  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.513062 13748 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:42.515076  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.515793  8220 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:42.519644  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:42.481647 14008 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 12:23:42.489879 13863 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.532078  8066 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:42.534520  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.509248 13945 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:42.525468 13873 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:42.532310 13776 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:42.549736  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 104176us
I20260709 12:23:42.562906  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.554244 13982 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.573604 13529 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:23:42.545339 13839 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:42.577522 13669 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.566025 13776 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.586239 13776 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:42.587262  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.588055  8759 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:42.591874  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:42.577612 13529 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.585256 13918 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.557596 13873 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.549659 13945 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.557966 13927 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.617538 13927 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.616317 13945 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:42.640069  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 77280.7us
I20260709 12:23:42.606806 13512 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:42.643678 13512 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.644021 13873 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:42.647580  8758 raft_consensus.cc:1240] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:23:42.642072  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:42.649781 13918 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:42.650254 13918 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.650421  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:42.650703 13918 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.651300  8759 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:42.652269  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.652985  8137 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:42.653798 13982 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:42.654300  8138 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:42.654543  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3369) took 1293 ms. Trace:
I20260709 12:23:42.655464  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.655890  8139 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:42.656211  8138 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:42.656620  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.659132  8137 raft_consensus.cc:2410] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:23:42.655298 13982 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:42.657261  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.670591  8139 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:42.657374  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.657855  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.654951  8218 rpcz_store.cc:276] 0709 12:23:41.360944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.635997 (+275053us) service_pool.cc:224] Handling call
0709 12:23:41.636287 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.692479 (+ 56192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.654328 (+961849us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b540014e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:42.654486 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27053312}
I20260709 12:23:42.671195  8143 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.667292  8142 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:23:42.668198 14021 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:42.660646  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:42.671849  8142 pending_rounds.cc:85] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 11
I20260709 12:23:42.674518  8142 pending_rounds.cc:107] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:23:42.674826  8142 raft_consensus.cc:2889] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:42.644073 13512 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:42.677182 13917 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:42.685014  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.686154  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.686959  8217 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:42.680671 14029 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.693542 13921 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:42.686894 13917 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.694928 13917 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.700233 13950 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.701730 14021 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:42.703429  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2183) took 1665 ms. Trace:
I20260709 12:23:42.716676  8217 rpcz_store.cc:276] 0709 12:23:41.037529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.074662 (+ 37133us) service_pool.cc:224] Handling call
0709 12:23:41.075062 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.686728 (+1611666us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002ef520. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:42.687378 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.703119 (+ 15741us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b54002ef520. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8fa02 00007f498ca8bdd6 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:42.703367 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326931200}
I20260709 12:23:42.682721 13741 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:23:42.710469  8140 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:42.711704  8138 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:42.723893 13748 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:42.724618 14021 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.711890  8143 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
W20260709 12:23:42.722107 14016 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:23:42.730814  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:42.735246 14029 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:42.737798 13742 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:42.759788 14029 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.764230  8141 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:42.764746 13847 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:42.766726  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.768316 13855 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:42.766134  8146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2357) took 1710 ms. Trace:
I20260709 12:23:42.758659 13742 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:42.777403  8145 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:23:42.776691 13742 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.778445 13921 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.778990 13921 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.780294 13748 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:42.781181 13921 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.782429 13982 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:42.782859 14021 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:42.769618  8146 rpcz_store.cc:276] 0709 12:23:41.055645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.344299 (+288654us) service_pool.cc:224] Handling call
0709 12:23:41.344884 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.498280 (+153396us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:41.680781 (+182501us) log.cc:844] Serialized 14 byte log entry
0709 12:23:42.082942 (+402161us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:42.764199 (+681257us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b180031d1a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a
0709 12:23:42.764459 (+   260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.764506 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:42.764545 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.765930 (+  1385us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001c39d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:42.765968 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.766082 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29202,"prepare.queue_time_us":248083,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1627,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":375635840,"thread_start_us":236889,"threads_started":2,"wal-append.queue_time_us":178185}
I20260709 12:23:42.786377  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:42.786927  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.787199  8146 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:42.791100 13976 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.792872 13971 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.795413  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1135) took 1566 ms. Trace:
I20260709 12:23:42.793355 13971 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.802632  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:42.803779  8137 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:42.804111  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.804222  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.805140  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.798444 13943 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:42.795876  8763 rpcz_store.cc:276] 0709 12:23:41.229017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.229218 (+   201us) service_pool.cc:224] Handling call
0709 12:23:42.795249 (+1566031us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:42.795348 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242148224}
I20260709 12:23:42.805207  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.811484  8138 raft_consensus.cc:2368] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:42.805572  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.812959  8142 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.809160  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:42.764549 14029 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:42.818735  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.819509  8139 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 18: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:42.792552 13976 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:42.827824  8140 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:42.810427 13943 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:42.834056 13943 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.850353  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.854213  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.851039 14036 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.855533  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.856244  8218 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:42.854427  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:42.866336  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:42.872174  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 87809.6us
I20260709 12:23:42.873303  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.873915  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.875351 13776 raft_consensus.cc:2764] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 12:23:42.880295  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.855736 14036 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.889065  8216 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:42.889395 14036 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:42.889622  8216 pending_rounds.cc:85] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 10
I20260709 12:23:42.890036  8216 pending_rounds.cc:107] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:42.890282  8216 raft_consensus.cc:2889] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:42.880332 13776 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:42.892122 13776 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.892671  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.903118  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:42.907451  8219 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:42.903995  8140 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:42.909885  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.849515 13918 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:42.911170  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3357) took 1576 ms. Trace:
I20260709 12:23:42.911351  8217 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:42.909370  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:42.913722  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:42.912302  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.872998 13921 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:42.920858  8215 rpcz_store.cc:276] 0709 12:23:41.334805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.592219 (+257414us) service_pool.cc:224] Handling call
0709 12:23:41.592538 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.921622 (+329084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.910924 (+989302us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540016a3d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:42.911114 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719573248}
I20260709 12:23:42.924358  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.929235  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.911487 13999 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.935189  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:42.945508  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.992102  8213 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:42.992805  8215 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.945878  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:42.935916 14010 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:42.943096  8216 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:42.942502  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.921129 13529 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:42.998366  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.948769  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:42.991992 13874 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.926744 13682 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.932404 13982 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.991621 13756 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:43.078917  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.069494  8216 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:43.072125  8215 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:42.927084 14036 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:42.993623 14021 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:43.010965 14040 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:42.993728 13667 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:23:43.008210 13512 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.008885 14010 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:43.082520 14043 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:23:43.076889 13776 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:42.993326 14029 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:23:42.933157 13921 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:42.936942 13983 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.158s
I20260709 12:23:43.083581 14036 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.101366  8145 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:43.007341 13999 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.106578 14036 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:43.105185  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 129915us
I20260709 12:23:43.084558 13874 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.114547  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.115890  8142 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:43.119086 13921 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.123394 13999 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:43.124157  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 189033us
I20260709 12:23:43.097759 14021 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.126153  8218 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:43.117147  8139 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:43.117210 13512 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.113937  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.127163  8216 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:43.103310 13971 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.140666  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:43.143781  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:43.144615  8220 raft_consensus.cc:2376] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14. Re-sending same reply.
I20260709 12:23:43.147303  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:43.124804 13863 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.005s
I20260709 12:23:43.153088  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:43.153214  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.155040  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.155674  8763 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:43.155714  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:43.158067  8763 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:23:43.158215  8215 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:43.112787 13917 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.164106  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:43.164927 13839 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:43.153913 13971 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.165889  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:43.168211  8220 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:43.124758 14036 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.189657 13918 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.155797 13999 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:43.191190 14021 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:43.189116 14045 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:23:43.201994  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.202404  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.157161 13512 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:43.153579 13945 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:23:43.163424 13808 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:43.246955  8219 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:43.200464 14046 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:43.204736 13839 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:43.268484  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61194.2us
I20260709 12:23:43.202930 13953 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:23:43.204252 13983 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:23:43.251263 13808 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:43.204843 13742 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:23:43.261164 13954 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:43.275074 14036 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:43.277765 13917 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.266556 14046 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:43.280296  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:43.279994 14046 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.284724  8141 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:43.285054 13872 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:43.285713  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 791743us
I20260709 12:23:43.286417  8035 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:43.287853 14014 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.844s	user 0.008s	sys 0.012s
I20260709 12:23:43.289791 13874 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.273128 13957 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:23:43.290690 13808 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:43.292162  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 795163us
I20260709 12:23:43.292269 13720 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:43.292866 13720 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:43.293241  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:43.293736 13720 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.295583  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.298677  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:43.299396  8141 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.261258 13512 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.301936  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.291198 13968 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:43.298677  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:43.311518  8219 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.265161 13839 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:43.296767  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.315289  8061 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:43.309711  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.307343  8064 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:43.284468 13887 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.317871  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.322599 13791 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:23:43.323673 13967 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:43.313500 14021 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.325284 13855 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.325103 14021 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.325763 13855 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.327364 14021 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:43.295985 13954 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:43.327824 13855 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.328537 13954 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.330475  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.347465  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:43.348124  8765 raft_consensus.cc:2376] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16. Re-sending same reply.
I20260709 12:23:43.350507  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.346308  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.351161  8070 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:43.351547  8761 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:43.319497 13808 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.347991  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.312438 13512 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.316584 13844 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:43.357928  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:43.355244  8061 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:43.316970 13839 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.357872 13844 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.355700 13954 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:43.361225 13866 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:43.370901  8034 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:43.372802 13981 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:43.373400 13981 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.375598 13981 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.376770 13872 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.372386  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:43.379899  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 96750.9us
I20260709 12:23:43.385303  8141 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:43.387559  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:43.387849  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.363013 13844 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.394665  8034 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:43.379832 13784 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:43.365027 13866 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:43.390172 13963 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:43.381810 13724 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:43.393016 13913 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:43.377249 13872 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.406047 13669 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:43.424090 13967 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:43.422672 13845 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:43.426465 13967 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:43.426869 13967 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:43.407724 13807 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.416666 14057 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:43.407724 13784 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.448975  8139 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:43.420011 13963 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:43.468607  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93213.5us
I20260709 12:23:43.437261 13913 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:43.444319 14057 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.484308  8061 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:43.427659 13967 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.485906  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.486207  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.491335  8068 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:43.492759  8064 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:43.486579  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 91986.3us
I20260709 12:23:43.484364  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.493952  8070 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:43.494818  8068 raft_consensus.cc:1275] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:43.441458 13807 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.430469 13724 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.498618  8068 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:23:43.480242 14057 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:43.482028 13669 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:43.530138  8061 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:43.533902  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.538352  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.538806 13978 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:43.539103 13983 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:43.544015 14053 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 12:23:43.544842 13963 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.536175  8070 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
W20260709 12:23:43.501959  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 118738us
I20260709 12:23:43.553391  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:43.550977  8064 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:43.535753  8219 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:43.489280 13957 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:23:43.488935 14058 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:23:43.576735  8064 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:43.568445  8065 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:23:43.558889 14054 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.006s
I20260709 12:23:43.533257 13872 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.485766 13866 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.592178  8065 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:43.594451  8219 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:43.598855  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.603390  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.604260 14070 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:43.604400  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.596273 14067 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:43.614653  8212 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:43.590150 13855 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:43.597012 13720 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.617610  8219 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:43.607105 13847 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:43.627051 13720 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.627295 13847 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.629930 13847 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.580520 13913 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.633947 13720 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.636837  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:43.613732 14067 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:43.656366  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56386.7us
I20260709 12:23:43.642328 13593 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:43.638630 13976 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:43.681159  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.645892 13784 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.625396 13855 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:43.677835  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 124552us
I20260709 12:23:43.684230  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:43.615967 13669 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.676599 13978 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:43.745957 13862 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:43.758147  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.758556 13862 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:43.759276 14075 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:43.759665 13862 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:43.761180 14076 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:43.761475 13862 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.756953  8036 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:43.709527  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.762450  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80041.2us
W20260709 12:23:43.727298 14059 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
W20260709 12:23:43.749969 13999 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.004s
W20260709 12:23:43.721719 14069 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:23:43.765720 14082 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.746798 13863 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:43.704481 13748 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.714473 13807 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.686967 13916 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:43.685930 13593 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.797818  8069 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:43.690032 13976 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.784817 13999 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.771831 13957 consensus_queue.cc:1048] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:23:43.766670 13978 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.775635 14079 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:23:43.820675  8144 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:43.805444 13916 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.824712 13916 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:43.826885 14049 log.cc:927] Time spent T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.662s	user 0.003s	sys 0.000s
I20260709 12:23:43.804391 13724 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.810467 13855 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.805770 13802 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.800520 13863 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.802591 13748 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:43.833431  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67453.4us
W20260709 12:23:43.845395  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 70923.3us
I20260709 12:23:43.846141  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.833355 14067 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.849115  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:43.840361 13802 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.854650 14085 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:43.842087 13512 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.855185 13927 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:43.844360 13839 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.870425 13802 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.876756  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:43.882892  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.884301  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.884994  8064 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:43.885918  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:43.891784  8065 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:23:43.879601  8110 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:43.894237  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:43.897878  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:43.898144  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.899864  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:43.902011  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:43.901755  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.904176  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:43.906280  8063 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:43.861680 13951 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:23:43.913971 13512 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.914726 13512 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:43.915283 13512 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.900187 13873 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:43.916324 13873 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.916728 13873 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:43.919562 13808 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.000s
W20260709 12:23:43.922416 13887 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.001s
W20260709 12:23:43.923419 13954 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.559s	user 0.003s	sys 0.007s
I20260709 12:23:43.923915 14057 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.924954 13593 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:43.924769 13873 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:43.900535 13957 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:43.926663 14057 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.899132 13999 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:43.926925 13873 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.927269 13999 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.932294  8067 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:43.890381 13976 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:43.900453 14036 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.953764 14036 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.954298 14036 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.940764 13839 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:43.941570 14084 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:23:43.942781 13844 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
I20260709 12:23:43.927683 13999 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.926959 13957 consensus_queue.cc:1243] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:43.900830 13927 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:43.945523 13512 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:43.936110 13983 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:43.947919 13976 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:43.965728  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66593.9us
I20260709 12:23:43.980139  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:43.980763  8216 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.956607 14036 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:43.961370 13844 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.963037 13983 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.987939  8216 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:43.988229 13978 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:43.994199  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:43.994887  8216 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:43.996184  8068 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:23:43.989312 13983 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.997421 13927 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:43.990280 14036 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.002959  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.003638  8218 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:44.009804 13863 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.011889 14082 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:44.017444  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1081) took 1168 ms. Trace:
I20260709 12:23:44.017907  8217 rpcz_store.cc:276] 0709 12:23:42.849414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.849641 (+   227us) service_pool.cc:224] Handling call
0709 12:23:42.911113 (+ 61472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.921028 (+  9915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.017234 (+1096206us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b540016a3d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:44.017382 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140589824}
I20260709 12:23:44.005515 14036 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.023957 13950 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.024564 13950 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.026381 13967 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.026728 13950 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.028648 14036 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:44.031265 14051 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.860s	user 0.004s	sys 0.000s
I20260709 12:23:44.029565  8216 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:44.032941 13741 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.035276  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3399) took 1092 ms. Trace:
I20260709 12:23:44.041309 13942 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.041960 13942 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:44.044073 14080 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 12:23:44.045810  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.033665 13741 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.046485  8216 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:44.031291 13957 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:23:44.051390 13891 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:44.049888  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:44.055505  8144 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:44.053831  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3404) took 1091 ms. Trace:
I20260709 12:23:44.035627  8211 rpcz_store.cc:276] 0709 12:23:42.942739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.992990 (+ 50251us) service_pool.cc:224] Handling call
0709 12:23:42.995334 (+  2344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:42.995703 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:42.995999 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:23:43.163177 (+167178us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:43.163627 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:23:43.163772 (+   145us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:43.180564 (+ 16792us) log.cc:844] Serialized 14 byte log entry
0709 12:23:43.180994 (+   430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.181068 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.436653 (+255585us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800139840. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:44.030740 (+594087us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:44.035064 (+  4324us) raft_consensus.cc:1685] finished
0709 12:23:44.035088 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.035225 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23106,"prepare.queue_time_us":22130,"prepare.run_cpu_time_us":5656,"prepare.run_wall_time_us":60812,"raft.queue_time_us":13498,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":6626,"spinlock_wait_cycles":77864576,"thread_start_us":71504,"threads_started":1,"wal-append.queue_time_us":162698}
I20260709 12:23:44.056800  8214 rpcz_store.cc:276] 0709 12:23:42.962701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.002247 (+ 39546us) service_pool.cc:224] Handling call
0709 12:23:43.002530 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.094990 (+ 92460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.095026 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:43.095069 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:43.095103 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.053554 (+958451us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b54002256d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:44.053609 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.053749 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212166912}
I20260709 12:23:44.058096 13891 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.062261 13891 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.064255  8141 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:44.044358 13942 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.034461 14086 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.070622  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.072690  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.074680  8143 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:44.076645  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.077625  8214 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:44.081218 13808 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.075455 13957 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.081813 13808 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.082271 13957 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.071331 14070 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:44.084949 14070 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:44.085800 14070 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.087257 14070 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:44.088958 13808 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.080283 13786 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.092190 13844 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.094316  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.084611 13957 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.097329  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.121825  8142 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:44.098340 14064 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.101351 13893 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.080561 14086 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:44.102586  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 345773us
I20260709 12:23:44.131758  8036 leader_election.cc:400] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:44.132088  8036 leader_election.cc:403] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.103865 13981 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:44.105551  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.134151  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.105875  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:44.105578  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:44.106712  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.135212  8764 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:44.107671  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.108371  8144 raft_consensus.cc:2468] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:44.109499  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.111236  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:44.137665  8143 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:44.139575  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.140314  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:44.141117  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.141048  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.141211  8139 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 12: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:44.142704  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.111850  8219 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:23:44.143374  8144 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
I20260709 12:23:44.124197  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:44.125509  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.144651  8142 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:44.123389  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:44.140270  8065 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:44.131570  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:44.103114 13872 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:44.147228  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.121989 14021 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.122917 13741 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:44.155853  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.111390 14063 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:44.157814  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 1083) took 1305 ms. Trace:
I20260709 12:23:44.133916  8036 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:44.158286  8213 rpcz_store.cc:276] 0709 12:23:42.852100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.853985 (+  1885us) service_pool.cc:224] Handling call
0709 12:23:44.157606 (+1303621us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b54000e7254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:44.157753 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182654208}
I20260709 12:23:44.159816  8764 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:23:44.151937  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.157724  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.161002  8144 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:44.161275  8070 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:44.147863  8065 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:44.154333  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.148663  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:44.156605  8142 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:44.132094 14067 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.163141  8143 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:44.135763 13913 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18.
I20260709 12:23:44.119346 14048 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:23:44.165335  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.167536  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.150554 13954 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:44.170110  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.145742 13963 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:44.145942 13967 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.126187 13786 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.178148  8144 pending_rounds.cc:85] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
I20260709 12:23:44.188038  8186 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:44.188330  8144 pending_rounds.cc:107] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:23:44.188604  8144 raft_consensus.cc:2889] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:44.189471  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:44.134708 13893 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.183558  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.272570  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.184047  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.185041  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.274644  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:44.180400 13887 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:44.176973  8064 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:44.276160  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:44.276386  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2368) took 1472 ms. Trace:
I20260709 12:23:44.276877  8145 rpcz_store.cc:276] 0709 12:23:42.803660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.803890 (+   230us) service_pool.cc:224] Handling call
0709 12:23:44.276196 (+1472306us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000519d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:44.276325 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677612160}
I20260709 12:23:44.278136  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.165359 13909 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:44.160153 13791 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.134865 14064 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.227514  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.171275 14067 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.225351 13927 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:44.168864 13668 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.178380 13954 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.347355 13954 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.157192 14029 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:23:44.235174  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.236699  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.178393 13593 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:44.179270 13872 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:44.158264 14021 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.226104 14086 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.186302 13724 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:23:44.181783 13863 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:23:44.187448 14073 consensus_queue.cc:1059] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:23:44.245930 13839 raft_consensus.cc:2804] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:44.186362 13967 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.181137 13963 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.409637 13839 raft_consensus.cc:697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:44.348045 13791 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.410722 13839 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.191084  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:44.192104  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:44.273388  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:44.373492 14029 consensus_queue.cc:1243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:23:44.437556  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 246541us
I20260709 12:23:44.279146  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:44.284752  8064 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:44.340416  8142 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:44.137982 13981 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.445201  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:44.446957  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:44.348800  8140 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:44.354470 13668 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.280912 13909 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.361508  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:44.257310 13999 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.363126  8070 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:44.369091  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:44.340813 13862 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:44.364503 14098 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:23:44.393345  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:44.373422 13873 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.474220 13873 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.362089 13512 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.479609 13512 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.482064 13512 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.482637 13512 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:44.415486  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 223476us
I20260709 12:23:44.484745  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:44.485783  8186 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:44.485821  8109 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:44.361599 13593 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.280153  8145 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:23:44.375437 13891 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.268303 14048 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:44.453540  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 174480us
I20260709 12:23:44.456118  8764 raft_consensus.cc:2393] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:44.413827 14096 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:23:44.461898  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.375147 13979 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:23:44.467065  8759 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:44.466221  8065 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:44.500911  8138 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:44.473697  8765 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:44.441648 13802 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.443259 14036 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.459319 14086 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:44.465348 13909 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.463951 13950 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.476440 13786 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:44.502800  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.468175 14029 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:44.505820  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.510028  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.511425  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.512130  8064 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:44.496160 14103 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:44.494243 13593 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.514391 13950 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.498930 13891 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.497949 14094 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:44.515652 14029 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.530010  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.503392 13916 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.500470 13978 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.503335 14086 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.503700 14036 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.505347 13942 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:44.534797 14094 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:44.548466  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:44.483134 13512 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.545193 14094 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:44.553399 13942 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:44.554171 14104 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:23:44.538854 13978 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.537400 13967 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.504246 14048 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.505334 13802 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.537879 14029 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.544310 14086 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:44.604183  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1091) took 1462 ms. Trace:
I20260709 12:23:44.543212 14036 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:44.610123  8215 rpcz_store.cc:276] 0709 12:23:43.141607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.142087 (+   480us) service_pool.cc:224] Handling call
0709 12:23:43.142428 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:43.159717 (+ 17289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.603801 (+1444084us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5400372b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:44.604099 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32505216}
I20260709 12:23:44.550607 13863 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.543078 13916 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.595640 13893 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.604787 13978 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:44.613734 14067 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:44.657882 13983 consensus_meta.cc:287] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.650s	user 0.004s	sys 0.008s
I20260709 12:23:44.648305 13953 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:23:44.688162 14100 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:23:44.629420 13863 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.651963 14021 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.672886 13786 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:44.806824 13863 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.807868 13786 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.811175 13863 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.811986 13786 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.767668  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:44.769733  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.777455  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:44.799502 14119 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:44.802716 13512 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.812108 13863 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.699996 13942 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.704885 13999 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.816347 14092 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:44.851266 14092 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.696743 13983 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.854612 14092 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.855749 13983 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.706568 13950 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.718765 14029 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.695603 13953 consensus_queue.cc:1243] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 0c70d5020db543caa986f80b0adaa8d2 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:44.860881 13891 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.860565 14029 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.696242 13981 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.713145 14048 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:44.719715 14094 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.719250 14086 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.711647 14064 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:44.702265 14070 consensus_meta.cc:287] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.000s
I20260709 12:23:44.707695 14110 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:44.607328  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 109247us
I20260709 12:23:44.719933 13978 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.695878 13952 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.842043  8064 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:44.900403 14120 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.876899 13863 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.918493 13839 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:44.921206  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 144172us
W20260709 12:23:44.900800 14117 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:23:44.874621 13916 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.943089 14094 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:44.944790 13808 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:44.949715 13748 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.950727 14120 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.953785  8215 pending_rounds.cc:85] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 9
I20260709 12:23:44.863400 14119 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.956297  8215 pending_rounds.cc:107] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:23:44.957465  8215 raft_consensus.cc:2889] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:44.957206 13952 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.959205 13872 raft_consensus.cc:3055] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:44.959687 13872 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:44.961571 14120 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.961040 13808 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.961252 13872 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:44.963637 13512 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.977237 13872 raft_consensus.cc:3060] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:44.977468 13512 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:44.983976 13512 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:44.999037 13978 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.003456 14036 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.005046 14110 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.009568  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.011405 13512 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:45.022045  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.023975  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.025406  8759 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:45.028750 14086 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.036799  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:45.055415  8218 raft_consensus.cc:1240] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:44.988133 13943 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.057755  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.048440 13952 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.065997  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.067706  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.068547  8063 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:45.072806 14064 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.081290 13981 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.084806  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.085413 13981 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.088862  8064 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
W20260709 12:23:45.094223  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.096544  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.101768 14119 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.103819 13808 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.105707  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2270) took 1603 ms. Trace:
I20260709 12:23:45.106194  8068 rpcz_store.cc:276] 0709 12:23:43.501986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.502104 (+   118us) service_pool.cc:224] Handling call
0709 12:23:43.502377 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.000993 (+498616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.105078 (+1104085us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400202bd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:45.105508 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135077120}
I20260709 12:23:45.107877  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:45.109596  8067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34012 (request call id 2253) took 3566 ms (client timeout 1673 ms). Trace:
W20260709 12:23:45.110064  8067 rpcz_store.cc:269] 0709 12:23:41.543335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.555889 (+ 12554us) service_pool.cc:224] Handling call
0709 12:23:45.109193 (+3553304us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54003228d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:45.109389 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5370786176}
W20260709 12:23:45.112195  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 58388.5us
I20260709 12:23:45.116308  8144 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:45.116813 13512 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:45.119553  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.121282  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.075647 14110 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.128106 14064 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.131490  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.132436  8757 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:45.132812 14064 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.133828  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:45.140879  8063 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:45.142550 13512 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:45.203847 14102 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.816s	user 0.002s	sys 0.011s
I20260709 12:23:45.204942 13512 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.205964  8140 raft_consensus.cc:2410] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:23:45.153751  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.153693  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.150702  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.126101 13981 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.160009  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.162212  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.163239  8143 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:45.164858  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.165652  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.169062 13917 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.171885  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.173317 14036 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.175658  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.176180  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.223099  8211 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:45.178680  8214 pending_rounds.cc:85] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 12
I20260709 12:23:45.223965  8214 pending_rounds.cc:107] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:23:45.179103  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.179443 13866 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.222429  8215 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:23:45.182507  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.185045  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.186249  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.175698 13862 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:45.189678 14110 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.190587  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.197288  8065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 960) took 1057 ms. Trace:
I20260709 12:23:45.224275  8214 raft_consensus.cc:2889] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:45.199043 13808 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.181057  8219 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:45.230784  8218 raft_consensus.cc:2393] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:45.231336  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 952) took 1094 ms. Trace:
I20260709 12:23:45.223387  8765 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:45.231660  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:45.236891  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45240.8us
I20260709 12:23:45.245688 13917 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:45.250026 13909 consensus_meta.cc:287] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.733s	user 0.013s	sys 0.010s
I20260709 12:23:45.250646 13909 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.253104  8144 raft_consensus.cc:2410] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:45.254253  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:45.254933  8757 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:45.255910  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.256714  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:45.258538  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 105008us
I20260709 12:23:45.259038 14052 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:45.260804  8145 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:45.265563 13668 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.266011  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.267202 13668 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.267505  8141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 1077) took 1199 ms. Trace:
I20260709 12:23:45.267982  8141 rpcz_store.cc:276] 0709 12:23:44.068201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.068745 (+   544us) service_pool.cc:224] Handling call
0709 12:23:44.069014 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.069361 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.069387 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.069836 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:23:44.263474 (+193638us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b18000d9a80. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1
0709 12:23:44.263717 (+   243us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:44.263770 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.263886 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.199293 (+935407us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b18000d9a80. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:45.267070 (+ 67777us) raft_consensus.cc:1685] finished
0709 12:23:45.267098 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.267307 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4258,"spinlock_wait_cycles":136237824,"thread_start_us":9315,"threads_started":1,"wal-append.queue_time_us":9632}
I20260709 12:23:45.269520  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.274508 13808 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.278532  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.240448 13862 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:45.237948  8062 rpcz_store.cc:276] 0709 12:23:44.136875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.139767 (+  2892us) service_pool.cc:224] Handling call
0709 12:23:44.159366 (+ 19599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.477382 (+318016us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:23:44.759419 (+282037us) log.cc:844] Serialized 14 byte log entry
0709 12:23:44.924969 (+165550us) log.cc:844] Serialized 14 byte log entry
0709 12:23:44.926613 (+  1644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:44.928806 (+  2193us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:44.928914 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.230959 (+302045us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540011d0d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:45.231005 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.231176 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90904,"prepare.queue_time_us":63259,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":135,"raft.queue_time_us":91183,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":1350,"spinlock_wait_cycles":730844800,"thread_start_us":334939,"threads_started":2,"wal-append.queue_time_us":72097}
I20260709 12:23:45.281741  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.283046  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.283236  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.283987  8062 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:45.277626 13668 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.284125  8063 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:45.286415  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.233043  8065 rpcz_store.cc:276] 0709 12:23:44.139450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.915958 (+776508us) service_pool.cc:224] Handling call
0709 12:23:44.934981 (+ 19023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.945485 (+ 10504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.945538 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.948334 (+  2796us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.065723 (+117389us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:45.065787 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.065912 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.196870 (+130958us) raft_consensus.cc:1685] finished
0709 12:23:45.196893 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.197077 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1413,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":186,"thread_start_us":87886,"threads_started":1,"wal-append.queue_time_us":178197}
I20260709 12:23:45.270524  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.298406  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.304314 14119 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.305107 14119 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.307654 14119 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.308823 14106 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:45.309020  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.309646 14106 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.310570  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:45.311579  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.312995  8066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 955) took 1175 ms. Trace:
I20260709 12:23:45.313396  8066 rpcz_store.cc:276] 0709 12:23:44.137888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.139978 (+  2090us) service_pool.cc:224] Handling call
0709 12:23:44.160515 (+ 20537us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:44.173571 (+ 13056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.173609 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:44.179910 (+  6301us) log.cc:844] Serialized 52 byte log entry
0709 12:23:44.265945 (+ 86035us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:44.265992 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.266070 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.202873 (+936803us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:45.312474 (+109601us) raft_consensus.cc:1685] finished
0709 12:23:45.312500 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.312813 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11479,"raft.queue_time_us":12035,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7181,"spinlock_wait_cycles":44371840,"thread_start_us":85607,"threads_started":1,"wal-append.queue_time_us":173509}
I20260709 12:23:45.315438  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.321417 14052 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:45.321522  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.323133 13847 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.323877 14082 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:45.323822 13847 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.326756 13847 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.327881  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:45.328027  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 59453.5us
I20260709 12:23:45.329030  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.330250 13887 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.330888 13887 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.331488  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.295356 14036 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.329329  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.316380  8066 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:45.336310  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.322577 14094 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.343693 13968 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.343957 14094 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.345077 14114 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.345337 13786 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:45.322736 13512 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:45.345788 13786 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.346050 13512 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:45.346280 14094 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.346560 13512 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.322081 13951 consensus_queue.cc:1059] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:23:45.347573 13951 raft_consensus.cc:3055] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:45.347628  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:45.348021 13951 raft_consensus.cc:740] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:45.349196 13887 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.346678  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:45.349085 13668 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:45.332908 13808 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.295126 14110 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.360910  8213 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:45.354080  8070 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:45.322314 14091 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:45.335141 14052 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:45.337550 14106 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.346290 13786 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:45.353556 13668 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.375391 13950 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:45.375444  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.375838  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:45.376225 13950 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.376487  8761 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:45.376770 13950 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:45.376952 13593 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.014s
I20260709 12:23:45.381067 13593 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.383967 13593 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.345789 14114 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.387126 14114 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.387816 14110 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.388561  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.390182 13951 consensus_queue.cc:260] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.391670 13951 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.395102 14091 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:45.396154 13950 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.396698 13668 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.399217 13873 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.376701  8762 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.373735  8062 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:45.413224  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.367314 14082 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:23:45.429544  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.422317  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.446519  8213 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:45.456765  8066 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:45.373543 13909 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:45.414163 13954 consensus_meta.cc:287] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.912s	user 0.006s	sys 0.018s
W20260709 12:23:45.495827  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 77314.1us
I20260709 12:23:45.417662 14082 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.492313  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:45.512802  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:45.514418  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 93039.7us
I20260709 12:23:45.516196  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.519922  8762 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:45.522969  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 963) took 1083 ms. Trace:
I20260709 12:23:45.524891  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.529165  8216 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:45.396337 14091 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.485321 13917 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.424113 14036 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.506549 14082 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:45.560711 14131 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 12:23:45.570523 13963 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.574361 13847 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:45.575565 13847 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.579581 13847 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:45.581089  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 215264us
I20260709 12:23:45.582283  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:45.585479  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 69401.6us
I20260709 12:23:45.586512  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:45.587591 13847 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:45.588258 13847 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.588781 13981 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:45.588827 13847 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:45.589912  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:45.590750  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48066.1us
I20260709 12:23:45.591794 14108 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:45.592293 14108 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:45.388604 14052 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.592782 14108 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.527659 13954 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.595510 13954 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.527053 13668 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.598596 13668 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.527871  8064 rpcz_store.cc:276] 0709 12:23:44.439346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.090275 (+650929us) service_pool.cc:224] Handling call
0709 12:23:45.090865 (+   590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.092164 (+  1299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.092202 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:45.185835 (+ 93633us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.295610 (+109775us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:45.340087 (+ 44477us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.340988 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.341055 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.522760 (+181705us) raft_consensus.cc:1685] finished
0709 12:23:45.522782 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.522912 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73771,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":228,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":9167,"thread_start_us":100380,"threads_started":1,"wal-append.queue_time_us":167906}
I20260709 12:23:45.552597 13862 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.602713 13862 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.604846 14036 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:45.542193 13872 consensus_meta.cc:287] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.006s
I20260709 12:23:45.604256 14108 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.614758 14077 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.645349 13979 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:45.648932  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103198us
I20260709 12:23:45.649933  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:45.654991  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 314156us
I20260709 12:23:45.638157 13942 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:45.657919  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 904) took 1775 ms (client timeout 1543 ms). Trace:
I20260709 12:23:45.680459  8214 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:23:45.640136 14036 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:45.678690  8763 rpcz_store.cc:269] 0709 12:23:43.876226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.876401 (+   175us) service_pool.cc:224] Handling call
0709 12:23:45.631071 (+1754670us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54005f0354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:45.651088 (+ 20017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560562944}
I20260709 12:23:45.688788 13909 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:45.689687 13909 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.694365  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.695904  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.679618 13862 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:45.705739  8220 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
W20260709 12:23:45.712663  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 120817us
I20260709 12:23:45.718794  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.705432 13981 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:45.728962  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.741041 13909 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.710700 13791 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.712227 13862 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:45.730434 14077 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.734733 13951 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.753855  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:45.757999  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 108257us
W20260709 12:23:45.758876  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 102015us
I20260709 12:23:45.754491 13866 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.761511  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 65738.2us
I20260709 12:23:45.762024 13866 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.762563  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:45.764232 13866 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.765861 14137 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:45.766518 13847 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.768540  8212 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:45.758737  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:45.750974 13862 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.733322 14036 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.775288  8062 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:45.768419 13909 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:45.773258 13981 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:45.776927 13872 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:45.777068 13963 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:45.777516 14132 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:23:45.773239 13791 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:23:45.766538 14137 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.758328 14108 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:45.787966  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105616us
I20260709 12:23:45.774591 13866 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:45.786844 13963 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.794953 13981 consensus_queue.cc:1243] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:45.796725  8214 raft_consensus.cc:1240] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:23:45.798818  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.801559 13786 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.802345 13668 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:45.802947  8759 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:45.803985 13786 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.804591 14036 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:45.805510 13866 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:45.805786 14136 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:45.806002 13866 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.811313 13847 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.811717 13963 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.814834  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.816736 13954 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:45.817471 13593 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:45.818305 13593 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:45.818753 13593 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:45.819837 13593 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.820199  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:45.822101 13963 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:45.823114 13981 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:45.823544  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.824005  8213 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:45.825112 13593 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:45.825938 13943 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.006s
I20260709 12:23:45.820508 13512 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.823596 13981 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:45.803118  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.829573  8217 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:45.830283  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.832695  8212 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:45.840240  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.829391  8214 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:45.833892  8216 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: [16.9-19.11]
I20260709 12:23:45.845024  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:45.845374  8220 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:45.846614  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:45.840145 14108 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.850162 14108 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.852800  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.853730  8213 raft_consensus.cc:2410] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:23:45.854590  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.855821 14114 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.856091 13951 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:45.856726 14114 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:45.857661  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:45.858258  8139 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:45.842556 13981 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.866798 13512 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.864490 14082 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.876377  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:45.881443  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.882514  8142 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:23:45.868742 13891 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.886622 13891 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.873195 13791 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.887588 13802 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.887893 13791 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.874716 13872 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:45.889035 13872 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.890209 13791 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.890914  8145 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:45.891109 13872 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:45.885975  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.893410  8139 raft_consensus.cc:2368] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:45.893724 14137 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:45.893658  8138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2376) took 1710 ms (client timeout 2240 ms). Trace:
I20260709 12:23:45.874128 14114 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:45.894510  8138 rpcz_store.cc:269] 0709 12:23:44.182891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.183815 (+   924us) service_pool.cc:224] Handling call
0709 12:23:45.893296 (+1709481us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400253d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:45.893466 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522212736}
I20260709 12:23:45.894632 13748 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:45.897625 13807 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:45.899379 14114 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:45.906471  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.905364  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:45.908600  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.914462  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.915656  8069 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:23:45.916939  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.917248  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.917886  8219 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:45.918102  8140 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:45.918473  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.916982  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.919628  8066 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:45.922411  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.896052 13866 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:45.921651  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.902585 14108 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:45.917271  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.905777 13748 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.928066  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.929706  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:45.932536  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.933329  8214 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:45.910053 13802 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:45.935154  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:45.937286  8219 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:45.932885  8065 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:45.935063  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.940169  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.925489 13807 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:45.941572  8141 raft_consensus.cc:2410] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:45.934504 13872 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:45.942183  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.945015  8069 raft_consensus.cc:3060] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.941112  8217 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:45.946592 13807 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.951844  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.952813 13802 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.953279  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:45.954282  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:45.958606  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:45.959376  8146 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.932878 13748 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.976827  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.974416  8215 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:45.977922  8065 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:45.985059  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:45.988512  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:45.992215  8219 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:45.911298 13951 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:23:45.993549  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:46.007109  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 122207us
I20260709 12:23:46.008452  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.009466 13791 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:46.010032 13791 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:46.011343 13791 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.007395  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.012979  8143 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:46.013055 13872 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:46.014132  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.015053  8143 raft_consensus.cc:2410] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:46.016960  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:46.017180 14139 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:23:46.009968  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.020658  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.021337 13872 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:46.023063  8036 leader_election.cc:400] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:46.025065  8036 leader_election.cc:403] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:46.023320  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.026124  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:46.027053 13963 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.027854 13748 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:45.993125 13862 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.030525  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.031275 13862 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.024931  8146 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:46.031340  8220 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:46.033433  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.012153  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.036245  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.034744  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.037411  8146 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:46.037698  8069 raft_consensus.cc:2468] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:46.038516  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.037498  8213 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:46.048296 14077 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:46.049279  8215 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:23:46.050086 13862 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.050163  8215 pending_rounds.cc:85] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 8
I20260709 12:23:46.050822  8215 pending_rounds.cc:107] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:23:46.050767 13862 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.052973  8215 raft_consensus.cc:2889] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:46.054575  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:46.055421 13954 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:46.055779 13954 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:46.056124 13954 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.035550 13872 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:46.058315 13872 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.058715 13872 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.064159  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:46.073156  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47172.5us
I20260709 12:23:46.074491  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:46.074555  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.075444 13979 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:46.075505  8142 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:46.076028 13979 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.076557 13979 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.078883 13720 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:46.079454 13720 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:46.085995  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:46.086930  8213 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:46.088233  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:46.089036  8217 raft_consensus.cc:2368] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:46.089663  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:46.089815  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.090082  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.090528  8219 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:46.090623  8217 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:23:46.090853  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.091360  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.091612  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.092546  8219 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:46.093875  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.095209  8765 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:46.097721 13951 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:46.098423 13951 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.101109 13981 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.102720  8068 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:46.103484 13891 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:46.104183  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.104664 13981 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:46.105276  8758 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:46.105693  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:46.106420  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64202us
I20260709 12:23:46.114207 13963 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:46.115095 13963 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:46.117054 14114 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.118386  8216 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:46.120743 14082 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:46.123790  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.088325  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:46.128790  8064 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:46.131016  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.131699  8145 raft_consensus.cc:3060] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.131551 13954 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.134093  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.134348 13954 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.135070  8140 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:46.091691  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.136029  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.136180  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.137421  8139 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:46.136405  8217 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:46.096465 14085 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.141788  8140 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:46.092249  8218 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:46.142419  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.149282  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:46.149933  8069 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.156316  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.161901  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.056258 13862 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.131007 13866 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:46.167094  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.168285  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:46.172080  8213 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:46.179916  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.154048 13891 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.195637  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.195858  8142 raft_consensus.cc:2393] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:46.197225  8145 raft_consensus.cc:2468] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:46.197754  8140 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:46.144532 13909 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:23:46.201349 14082 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:46.204741  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 146125us
I20260709 12:23:46.207120  8142 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:46.184990 13951 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.212980 13748 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.213290 13866 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:46.213670  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67794.1us
I20260709 12:23:46.109848 13720 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.214818  8063 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:46.215090  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.215397  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.216043  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.217017  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.217784 14114 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:46.218564  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.152402 14085 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.169911 13981 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:23:46.218792  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.221400  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.227397  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:46.217044  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:46.245927  8217 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:46.239619  8069 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:46.293254  8141 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:46.244773 13891 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.295921 13891 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:46.251503  8218 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:46.307240  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.304407 13866 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:46.317904 13981 consensus_queue.cc:1243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:46.322963 13866 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.254976 13963 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:23:46.325448 14068 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:46.326109 14068 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:23:46.326568 14146 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.284s	user 0.000s	sys 0.015s
I20260709 12:23:46.327205 14068 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:46.318609  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 77115.9us
I20260709 12:23:46.329924  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.330334  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.330715  8141 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:46.380338  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.340009 13950 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:46.385629  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.386178  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.376886 13981 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:23:46.393976  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 178077us
W20260709 12:23:46.396236  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 87263.7us
I20260709 12:23:46.350430 13872 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.401183  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:46.394085 13593 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.004s
W20260709 12:23:46.409176  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 318426us
I20260709 12:23:46.414075  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.413225  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:46.401304 13720 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.398118 13981 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:46.400885 14082 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:46.426972  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:46.435639  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.440771  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.442162  8184 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:46.425328 14145 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:46.443709  8066 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:46.455039  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.450717 13802 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:46.452360  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.467430 13872 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:46.469200 13981 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.471063 13981 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:46.483345 14085 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:46.487730  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 169572us
W20260709 12:23:46.491779  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 49696.8us
I20260709 12:23:46.493144  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:46.525123  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 279914us
I20260709 12:23:46.536981  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.451395 14145 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.449784 13866 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:46.551091  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.543735  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:46.484825 14077 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:23:46.563210  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.542529 14036 raft_consensus.cc:2804] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:46.568707  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.564164  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.569391  8142 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.549307  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:46.567253  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.566000  8143 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.541273 14145 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.574123  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.577662  8730 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.541998 14082 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:23:46.571456 13909 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:46.588363  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 186238us
I20260709 12:23:46.584283  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.591612  8140 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:46.581990 13593 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:46.579771 14036 raft_consensus.cc:697] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:46.591961  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 261681us
I20260709 12:23:46.589231 13909 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.645215  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:46.647248  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:46.673496 14154 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:46.676309  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:46.677549  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:46.678434  8063 raft_consensus.cc:2393] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:46.602818 13866 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:46.688520  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.690646  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:46.694479  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.695472  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:46.647529 13909 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:46.698884  8067 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:46.699656  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:46.700402  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:46.702147  8765 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:46.702270  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:46.684914 13979 consensus_meta.cc:287] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
I20260709 12:23:46.707134 14036 consensus_queue.cc:237] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.709128  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.720959  8758 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
W20260709 12:23:46.721496  8213 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.002s
I20260709 12:23:46.649071 14151 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:46.714207  8139 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:46.721863  8213 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:46.721139  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.648873 14156 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:46.724476  8143 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:46.754441  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.754633  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:46.718829 14142 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:46.775648  8142 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:46.778050  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:46.763413  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 49519.3us
W20260709 12:23:46.760938  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 186851us
I20260709 12:23:46.718169 14089 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:46.693565 13802 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:23:46.805428  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:46.806624  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.802845  8067 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:46.809973  8758 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:46.821686  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.822631  8186 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:46.822394  8759 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:46.720384 13979 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:46.807546 14142 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:46.833225  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.832381 13891 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:46.826931 14089 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:46.824218 14170 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:46.846163  8063 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:46.848389 13891 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:46.854718 14143 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.863s	user 0.002s	sys 0.005s
I20260709 12:23:46.854238 13891 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.855841 13891 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.860781 13802 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:46.861474 13802 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.863902 13802 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:46.869652 14155 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:46.841555 14171 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:46.870391 14171 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.870831 14171 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.872247  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.872978  8759 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:46.873724  8731 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:46.875579  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 335359us
W20260709 12:23:46.876669  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.877547  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.611s (SENT) [suppressed 7 similar messages]
I20260709 12:23:46.880816 14082 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:46.881248 14082 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.881606 14082 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:46.898563 14089 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:46.905144 13872 consensus_queue.cc:1059] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:46.913463  8069 pending_rounds.cc:85] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 9
I20260709 12:23:46.913931  8069 pending_rounds.cc:107] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:23:46.914463  8069 raft_consensus.cc:2889] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:46.930573 14153 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.439s	user 0.004s	sys 0.000s
I20260709 12:23:46.932674  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:46.936811  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:46.960019  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.020s
I20260709 12:23:46.962134  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:46.978219  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.021s
W20260709 12:23:46.979575  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 569481us
I20260709 12:23:46.956990 14163 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:46.989064  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:46.989959  8765 raft_consensus.cc:2368] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
W20260709 12:23:46.992014  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114504us
I20260709 12:23:46.990958 14163 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:46.994197  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:46.978402 13791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.030s	sys 0.026s
W20260709 12:23:47.001449  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 457144us
W20260709 12:23:47.002364 14110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.003s	sys 0.021s
W20260709 12:23:47.002894 14110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.003s	sys 0.021s
I20260709 12:23:47.003875  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:46.997684 13791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.030s	sys 0.026s
I20260709 12:23:47.015340  8066 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
W20260709 12:23:47.017385  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 407791us
I20260709 12:23:47.019995  8758 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:47.021258  8765 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.999465 14168 raft_consensus.cc:3055] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:47.004251 13950 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:47.023847 14172 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:23:47.020769 13963 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:47.021513 13807 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.038496 13909 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.043938 13917 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.044445 14126 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.925s	user 0.007s	sys 0.006s
I20260709 12:23:47.049162  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.048830  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.000728 14145 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.054982 14145 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.050012 13917 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.059623 13917 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.052541  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2283) took 3170 ms. Trace:
I20260709 12:23:46.995770 14142 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.057092 13909 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.060564  8061 rpcz_store.cc:276] 0709 12:23:43.881982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.887001 (+  5019us) service_pool.cc:224] Handling call
0709 12:23:43.902284 (+ 15283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.104515 (+202231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.104558 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.117574 (+ 13016us) log.cc:844] Serialized 26 byte log entry
0709 12:23:45.099203 (+981629us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b180011ddc0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:45.300170 (+200967us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:45.371357 (+ 71187us) log.cc:844] Serialized 14 byte log entry
0709 12:23:45.489436 (+118079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.498259 (+  8823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.095449 (+597190us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180011ddc0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:46.850994 (+755545us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:47.052154 (+201160us) raft_consensus.cc:1685] finished
0709 12:23:47.052175 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.052357 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324002,"prepare.queue_time_us":69279,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":273658,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":37227,"spinlock_wait_cycles":310767488,"thread_start_us":175846,"threads_started":1,"wal-append.queue_time_us":1257695}
I20260709 12:23:47.069710  8758 raft_consensus.cc:1240] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:47.028008 13979 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.026300 14168 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:47.065577 13807 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.074977 14145 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.079114 14145 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:47.080255  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.080611 14166 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:47.081239 14166 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:47.081429 14145 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.082226 14166 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.084118  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:47.085317  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:47.086162  8140 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:47.093147  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.096349 13891 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:47.096797 13891 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.097189 13891 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:47.097114 14168 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.098356 14168 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.099156  8145 raft_consensus.cc:1240] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:47.093914 13776 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:47.103400  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 84021.4us
I20260709 12:23:47.104038  8064 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:47.104418 13963 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:47.104059 14173 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:47.106856 14177 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.107497 14177 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.108371 14170 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.108888 14170 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.109941 14177 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:47.111093 14170 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.112118 13963 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:47.112553 13963 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:47.113607 13963 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.115010 13963 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.118175  8144 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:47.119879 14164 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:47.103493 13807 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.112437  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.126940  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:47.072544 13981 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.001s
I20260709 12:23:47.128577  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.131719  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.132241  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:47.145709 13791 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:47.153424  8067 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:47.154327  8070 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:23:47.155007  8070 pending_rounds.cc:85] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 10
I20260709 12:23:47.155267  8070 pending_rounds.cc:107] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:23:47.155494  8070 raft_consensus.cc:2889] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.156941  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.157312  8763 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:47.157035 14163 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.158792 14163 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.130424 13866 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:47.162381  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.163017  8216 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:47.165197 14082 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.166297  8759 raft_consensus.cc:2368] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:47.169946  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.170737  8218 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:47.177999  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:47.184592  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56111.4us
I20260709 12:23:47.187587  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.173046  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.194713  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:47.195132  8763 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:47.195349  8220 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:47.196432  8765 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:47.183368 13802 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.197280  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.205063  8762 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:47.133340 13807 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:47.197392  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.198292  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:47.200605  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68940.1us
I20260709 12:23:47.217459  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.217722  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.212752  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.220342  8762 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:47.220228  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.222752 14085 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:47.205951  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:47.188927 14145 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:47.228999  8758 raft_consensus.cc:2368] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:47.225762  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:47.232915  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:47.233498  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.223151  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:47.230186  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:47.235996  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:47.235729  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 142658us
I20260709 12:23:47.215939 13791 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.242470  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.216195 13807 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.241304  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:47.228487 13776 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:47.231541 13866 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:47.262409  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.263712  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.231580 14085 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:47.237206 14142 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:47.269824  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.232767 14192 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:47.234943 14164 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.239042 13720 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:47.274739  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:47.265908 14145 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:47.238448 14151 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:47.223496 13802 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.255159 13862 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:47.247005 13917 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:47.279987  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:47.281136 14183 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:47.269347  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:47.261483 13807 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.268321 13776 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.275312  8184 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.322021  8066 raft_consensus.cc:606] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.325444  8066 raft_consensus.cc:614] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:47.278177 14089 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:47.330799  8220 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:47.279095 14192 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:47.287849 13720 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.320785  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:47.283017 13593 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:47.358000  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82746.4us
I20260709 12:23:47.370122  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.280063 13981 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:47.361624  8219 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:47.282915 14182 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:47.321717 14183 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.368702  8212 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:47.309692 14145 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.321107 14187 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:47.283356 14173 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 12:23:47.331665 13776 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.324489 13917 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.324914 14151 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:47.375806  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.369863 13720 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:47.371882  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 137908us
I20260709 12:23:47.371356 14077 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.423030 14077 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.425802 14077 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.404951 14085 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.428957 14173 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:47.429416 14173 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:47.430254 14173 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.431524 14173 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:47.404772 14082 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.324064 14164 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.326884 14142 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:23:47.366184 14192 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:47.434518  8110 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:47.437407  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61670.4us
I20260709 12:23:47.389312 13979 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:47.388788 14165 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.389245 14183 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.392985 14145 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.445145  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:47.514882  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 80452us
I20260709 12:23:47.369547 13866 raft_consensus.cc:2804] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:47.437160 13917 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:47.405736 14151 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:47.528918  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.457132 13593 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:47.537187  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:47.519117 13981 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.414726 14152 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.209s
I20260709 12:23:47.536130 14170 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.525374 14082 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.547075  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 307493us
I20260709 12:23:47.558292  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:47.546535  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 234983us
I20260709 12:23:47.559378  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:47.564813  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:47.565671  8220 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:47.535552 13866 raft_consensus.cc:697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:47.535316 14180 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.577145  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:47.579289  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 299379us
I20260709 12:23:47.589771  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:47.586625  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.591010  8213 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:47.594172 13891 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.597589 13866 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.608247  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:47.581904  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 136886us
I20260709 12:23:47.527755 14165 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.571967 14077 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.575248 14082 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:47.630343  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93254.5us
I20260709 12:23:47.631228  8211 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:47.631106  8213 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:47.643798  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.632934  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:47.639858  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:47.619433  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:47.646072  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:47.647032  8063 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:47.556448 13981 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.582124 13802 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.647706  8213 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:47.642856  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.596472 13891 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.654944  8220 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:47.657783  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:47.658380  8759 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:47.658532  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.659899 13593 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:47.660902  8761 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:47.661440  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.661073  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:47.661057 13593 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.617336 14110 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:47.719806  8062 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:47.725137  8065 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:47.652259 13748 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:47.731282  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.653995 14187 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:23:47.665079 14171 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.794s	user 0.011s	sys 0.002s
W20260709 12:23:47.737860  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 102024us
I20260709 12:23:47.737262  8144 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
I20260709 12:23:47.719198 14170 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.725193 14142 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.732313 13802 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:47.665548 14205 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.604328 14180 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.727730 14164 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.650310 14077 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.757787  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:47.755544  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 193511us
I20260709 12:23:47.764153  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.737824 14198 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:47.775801  8142 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:47.775375  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.770720  8145 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:47.730716 14110 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.781117  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:47.773588  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 129881us
I20260709 12:23:47.774669  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.748732 14187 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:47.744920 14171 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.753702 14170 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.755156 13979 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:47.836937  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 62342.7us
I20260709 12:23:47.786408  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.838388  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:47.842743 13951 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.849013 13951 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.851262 13951 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.851872 14217 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:23:47.854210 14077 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.854648 14170 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:47.855098 14160 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.856304 14216 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.856803 14166 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:47.857214 14166 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.857602 14166 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.858173 14180 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.860167 14202 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.855623 14160 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.862846 14160 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.865592 14082 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.865217 14187 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.866779 13981 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.788501 14205 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:23:47.869117 14205 consensus_queue.cc:1243] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:47.772092 13872 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:47.870464 13872 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.871414 13776 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:47.787575 14201 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:47.873070  8066 raft_consensus.cc:2410] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:23:47.875173  8146 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:47.787789 14213 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:47.860736 14202 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.756480 14142 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.787171 14186 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.801590  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:47.801455  8759 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:47.772573 14164 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:47.782891 13802 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:47.872498 13872 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:47.903329 14195 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.544s	user 0.002s	sys 0.000s
I20260709 12:23:47.906416 14142 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:47.907791 14202 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:47.908758 14168 consensus_meta.cc:287] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 12:23:47.786453 14222 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:47.855674 14077 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.797636 14165 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.794467 14203 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:47.903471 14192 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:48.031025  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 265750us
I20260709 12:23:47.929319  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.786998 14207 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:48.110984  8142 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:48.079530  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.967792  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.064746  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:48.024200  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 175875us
I20260709 12:23:47.953361  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.952883  8215 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:47.918201  8140 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:23:48.016114  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 426435us
I20260709 12:23:48.064059  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.049602  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:47.837626 14198 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.950321  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:48.127370  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 177127us
I20260709 12:23:48.128899  8110 leader_election.cc:400] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:48.129380  8110 leader_election.cc:403] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:48.131142  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.112650  8144 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:48.133674  8034 leader_election.cc:400] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:47.927857 13802 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.151010  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.132077 14198 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:47.934648 14110 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:47.925127 14151 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:47.921553 13776 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.174671 14216 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:48.175137 14151 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:48.175676  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44640.6us
I20260709 12:23:48.176496  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.177279 14216 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:48.178898  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.180012 13776 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.180367  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.132692 14077 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.181191 14230 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:48.181598 14230 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:48.181962 14230 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:48.182623 14077 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:47.917225 13807 consensus_meta.cc:287] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 12:23:48.149418 14203 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.149232 14142 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:48.152477  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.184228 13807 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.152763 13866 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:47.916216 14145 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.186419 13807 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:48.186925 14145 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.153496  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:47.939016 14183 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:47.931363 13917 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.154009  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.189152 14183 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.151362  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:48.164614  8211 raft_consensus.cc:2393] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:47.925421 14163 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.002s
W20260709 12:23:48.165666  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45729.6us
I20260709 12:23:48.189185 13917 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.155225  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:47.941423 14171 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.191792  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.198474  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.077332 14232 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:48.197312  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:48.150720 14187 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:47.881496 13979 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:48.193542 14177 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.017s	sys 0.038s
I20260709 12:23:47.881722 14036 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.312s
I20260709 12:23:47.915704 13720 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.206468  8186 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.221750 13720 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.222730 13862 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:48.168262 13802 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:48.163509 14207 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:48.200132 14145 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:48.202179 14205 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:48.212275  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.006686 14166 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.203836 14220 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:48.206534 14232 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:48.212010 14177 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.017s	sys 0.039s
I20260709 12:23:48.215886 14217 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:48.208930  8036 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:47.918586 14186 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.250802  8067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273de299acf94214b44aab4591da9b3a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:48.198529 14152 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:48.253315  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48891.2us
W20260709 12:23:48.211217  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.252221  8067 raft_consensus.cc:606] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:48.255503  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47102.2us
I20260709 12:23:48.255688  8067 raft_consensus.cc:614] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:48.211365 13963 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:48.258210  8070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.020s
I20260709 12:23:48.260389  8063 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:48.261678  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 417859us
W20260709 12:23:48.263092  8070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.004s	sys 0.020s
W20260709 12:23:48.257722  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 492539us
I20260709 12:23:48.163942 14222 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.266561  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:48.267246  8066 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:48.264228  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.269294  8066 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:48.207715 14151 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:23:48.210615 13866 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:23:48.231026 13951 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:48.250744 14145 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:48.270820  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:48.229592 14187 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:48.213366 13891 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:23:48.528107  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:48.408941  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.319732  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:48.364776  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.505054  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.257186 13720 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:48.499753  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:48.567370  8219 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:48.425508  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.428282  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:48.428378  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.573220  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:48.364094  8216 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:48.269371 13963 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:48.481833  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.524362 14186 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.370551 14192 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.371588 13979 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.370460  8144 raft_consensus.cc:1275] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:48.574553  8070 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:23:48.567302  8213 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:48.574558  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69624.7us
I20260709 12:23:48.274492  8217 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:48.262228 13872 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:48.542919 14236 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:23:48.421792 14225 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.371594  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.581755  8757 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.394636  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:48.557221  8063 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:48.605603  8067 raft_consensus.cc:3060] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:23:48.606998  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.587867 13963 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.611553  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:48.513362  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59612.6us
I20260709 12:23:48.274096 14182 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:48.347098 14183 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.585462  8140 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:48.586165  8142 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:23:48.583864  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 171705us
W20260709 12:23:48.537549 14237 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.003s
I20260709 12:23:48.258226 14167 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.317s
I20260709 12:23:48.588704  8761 raft_consensus.cc:2368] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16.
W20260709 12:23:48.517007 14242 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:23:48.320444  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:48.311829 14171 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:48.502086 14220 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:48.575774 14165 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.569211 13720 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:48.265563 14168 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.321s
I20260709 12:23:48.366746 13776 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:48.582020 14232 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.615878 14241 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:48.616904 14230 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.624224  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.594861 14180 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:48.511986 13807 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:23:48.629352  8065 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:48.632002  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:48.606793 14077 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.635234 13917 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:23:48.564877 13951 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.619445 14222 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.626289 14151 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:48.624850 14192 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:48.644613 13720 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:48.653710 14180 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:48.637588 14205 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:48.611049 13872 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:48.688997  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64901.2us
I20260709 12:23:48.690253  8219 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:48.692282  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.689257  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2242) took 1395 ms. Trace:
I20260709 12:23:48.633513 14183 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:48.714336  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 131446us
I20260709 12:23:48.722831  8730 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:48.733553  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.719697  8214 rpcz_store.cc:276] 0709 12:23:47.284878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.286078 (+  1200us) service_pool.cc:224] Handling call
0709 12:23:47.320392 (+ 34314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:48.070216 (+749824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.070250 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:48.070854 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:23:48.271388 (+200534us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:48.271470 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.365745 (+ 94275us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400373054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:48.365792 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:48.676135 (+310343us) raft_consensus.cc:1685] finished
0709 12:23:48.676159 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:48.679912 (+  3753us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1273,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":1723451648,"thread_start_us":191446,"threads_started":1,"wal-append.queue_time_us":323549}
I20260709 12:23:48.737176  8219 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:48.740852  8109 leader_election.cc:400] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:48.689631 14151 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.696364 14171 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:48.752542  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.754717  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:48.755379  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 123297us
I20260709 12:23:48.731086 13786 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.760991  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:48.761830  8065 raft_consensus.cc:606] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:48.762261  8065 raft_consensus.cc:614] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:48.680388 14077 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.678328 13776 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.765177  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.764273  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:48.694198 14216 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:23:48.715440 14192 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.756157 14151 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:48.749485 14085 raft_consensus.cc:2804] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:48.763816 13807 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:48.677340 14187 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.818497 14171 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:23:48.851713  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 91812.9us
W20260709 12:23:48.852468  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88759.1us
W20260709 12:23:48.855253  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 90180.2us
I20260709 12:23:48.763929 13786 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.764292 14167 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:23:48.680107 14145 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.857422  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.874764 14244 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.259076 14217 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.883340  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:48.633671 14182 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.852365 14241 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:48.855931 14222 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:48.854101 14233 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:48.916822 14233 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:48.917516 13917 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.918138 13917 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.887005  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.875030 14246 consensus_queue.cc:1059] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:23:48.924799 14246 raft_consensus.cc:3055] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:48.925259 14246 raft_consensus.cc:740] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:48.926139 14246 consensus_queue.cc:260] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.609944 14225 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.927686 14246 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.929281 14225 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.929628 14166 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.930521  8063 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:48.931658 14110 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:48.932134 14110 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:48.884521 14085 raft_consensus.cc:697] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:48.639302 14198 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.893355  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:48.951586  8764 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:48.893594  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.262267 14152 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.894018 14253 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:48.895349 14255 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:48.897872 13776 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.889423 14216 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:23:48.643812 14220 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.902755  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.906188 14077 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.408138 14207 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.878182 14157 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:48.776675 14180 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.914134 14217 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.916085 14182 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.917908 14233 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:48.886907  8214 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:48.881574  8109 leader_election.cc:400] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:48.934464  8757 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:48.939231  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.992125  8109 leader_election.cc:403] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:48.992496  8145 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:48.993889  8145 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:48.948257  8216 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:48.949079  8067 raft_consensus.cc:2468] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:48.871310 14206 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.287s
I20260709 12:23:48.964725  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:48.899128 14171 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.966362  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.000216  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:48.896739 14192 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:48.968117  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:49.001464 14256 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.001871 14245 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:23:48.988391 14157 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.002091 14256 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.003104  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:49.003759  8216 raft_consensus.cc:2376] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17. Re-sending same reply.
I20260709 12:23:49.004271 14157 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:48.963758 14110 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.007253  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:48.964509 14255 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.974674  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:48.978881 14251 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:48.981709  8139 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:48.985759  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 102520us
I20260709 12:23:49.004880 13720 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.013540 14262 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:48.989168  8142 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:49.015046 14152 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.957993 14230 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.015451 13720 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.016191  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:48.985021 14253 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:49.017199 14253 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.017584  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:48.993695 14170 consensus_queue.cc:1175] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d67d00ae45b444cbe343726df1760e8" responder_term: 17 status { last_received { term: 17 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:49.019795 14253 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:48.991595  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:49.020777 13951 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:48.995123  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 113714us
I20260709 12:23:48.985837 14183 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.004788  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:48.996909 14180 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.026476 14151 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:48.969939  8759 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:49.010169  8761 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:49.029062  8213 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:49.010329  8758 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:49.029966 14198 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.032610  8215 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:23:49.033041  8215 pending_rounds.cc:85] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 12
I20260709 12:23:49.033278  8215 pending_rounds.cc:107] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:23:49.033617  8215 raft_consensus.cc:2889] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:49.033299 14253 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:49.035383 14253 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:49.035692  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.036393  8220 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:49.036811 14186 consensus_queue.cc:1048] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:49.037321  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.038688  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.039180  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2323) took 1265 ms. Trace:
I20260709 12:23:49.039927  8220 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:48.997797 13872 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.050375 13963 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.057426 14220 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:49.004505 14252 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:23:49.061159  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.061659 13786 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.062112  8143 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:49.063769 14171 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.064788 14233 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.068734 13917 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:49.011809 14217 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:49.071667 13979 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.072842 14255 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.073982  8219 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:49.075047  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.075407  8219 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:49.076387  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.076989  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:49.077800 14250 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:49.078228 14254 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.078781 14254 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.079941  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:49.081218  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.094933 14171 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.117141  8068 raft_consensus.cc:2410] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:23:49.072253 13979 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.118777  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:49.125192  8070 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.129164  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:49.039618  8139 rpcz_store.cc:276] 0709 12:23:47.773819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.773947 (+   128us) service_pool.cc:224] Handling call
0709 12:23:49.038979 (+1265032us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540008f7d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:49.039122 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488118528}
I20260709 12:23:49.137342  8145 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:49.137499  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.119199 14165 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:49.138962 14189 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:49.139292  8065 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:49.139415 14189 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:49.139056 14165 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.141537 14165 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.118366 13791 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:49.142077 13979 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.142578 13791 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.143553 14256 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:49.144795 13802 consensus_meta.cc:287] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.900s	user 0.007s	sys 0.006s
I20260709 12:23:49.118249 14166 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:23:49.145260 13802 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.145588  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.145745 14166 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:49.146196 14166 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:49.147008 14166 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.147552 13802 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.148254 14166 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.156778  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.157390  8146 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:49.157974 14220 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.140317 14189 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.158800 14189 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.158485 14220 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.117085 14077 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:49.116822 14225 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:49.160161 14225 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.161419  8140 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:49.008147 14241 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.162492 14225 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.122605 14254 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:49.163357 14238 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.757s	user 0.003s	sys 0.000s
I20260709 12:23:49.164945  8138 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:49.158551  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.166265  8146 raft_consensus.cc:2410] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:49.148367 13963 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.118506 14168 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:49.172410  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 195582us
I20260709 12:23:49.150014 13891 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:49.150666  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.179767  8139 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:49.180066  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 2332) took 1019 ms. Trace:
I20260709 12:23:49.150023  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51784 (request call id 1139) took 1167 ms. Trace:
I20260709 12:23:49.180701  8138 rpcz_store.cc:276] 0709 12:23:48.150459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.153208 (+  2749us) service_pool.cc:224] Handling call
0709 12:23:49.169134 (+1015926us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b5400042754. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:49.169311 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246887808}
I20260709 12:23:49.128415  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.152128 13862 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.179785 13802 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:49.154145 14183 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.117856  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:49.154651 14249 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.305s	user 0.001s	sys 0.002s
I20260709 12:23:49.155083 13791 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:49.156327  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:49.149096  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.167769  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.169842  8212 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:23:49.172730  8218 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:49.173211  8764 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
W20260709 12:23:49.173439  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.168646 14217 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18.
I20260709 12:23:49.138669 14142 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:49.175619  8070 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:49.179337 13891 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:49.191754 13862 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.224125 13891 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.225234 13862 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.225654 13891 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.152863 14085 consensus_queue.cc:237] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.180964  8217 rpcz_store.cc:276] 0709 12:23:47.960902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.967465 (+  6563us) service_pool.cc:224] Handling call
0709 12:23:49.082071 (+1114606us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400133b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:49.128166 (+ 46095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368932224}
I20260709 12:23:49.187505  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:49.232688  8068 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 13: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:49.191979  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74206.8us
I20260709 12:23:49.233634 14220 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.188884 14262 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:49.234421 14262 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.192662  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.191541 14186 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.207381 14183 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.240473  8066 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:49.216976  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.244457  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.245102  8146 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:49.203449 13963 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:49.217170 14142 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:49.236979  8065 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:49.194965  8063 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:49.246908  8070 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:23:49.255807  8070 pending_rounds.cc:85] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 12
I20260709 12:23:49.256176  8070 pending_rounds.cc:107] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:23:49.256503  8070 raft_consensus.cc:2889] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:49.252663  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.257550  8062 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:49.264310  8062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:49.265182  8062 raft_consensus.cc:606] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.265604  8062 raft_consensus.cc:614] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:49.271893  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:49.272768  8764 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.285188  8068 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:49.285652  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.286586  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:49.287436  8759 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:49.236608 14262 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.295656  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:49.291198  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.290428  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.297305  8064 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:49.293361  8764 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:49.273574 14253 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:49.300519 14253 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:49.300786 14263 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:49.300993 14253 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.301323 14263 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.301777 14263 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:49.303823  8214 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:49.254592 13963 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.237068 14186 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.243986 14246 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:49.182457 14255 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.310633  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.383265  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.387161  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.382233  8142 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:49.279466 14189 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.382542  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:49.388885  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:49.389964  8764 raft_consensus.cc:2393] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:49.393150  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 243158us
I20260709 12:23:49.310987 13963 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:49.397235  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.397643  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.405416  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.406136  8064 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:49.416304  8068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:49.419073  8762 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:49.420363  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.421950  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:49.426249  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.304769 14256 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:23:49.416934  8186 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.434582  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.437968  8764 raft_consensus.cc:2393] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 14: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:49.446272  8064 raft_consensus.cc:1240] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:49.450593  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.450882  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.451362  8146 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
W20260709 12:23:49.450632  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.448868  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.348920 14156 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:23:49.468806  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 990) took 1235 ms. Trace:
I20260709 12:23:49.473536  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.474226  8218 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:49.396562 14189 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.475426  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.469491  8069 rpcz_store.cc:276] 0709 12:23:48.233413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.256748 (+ 23335us) service_pool.cc:224] Handling call
0709 12:23:48.268922 (+ 12174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:48.979792 (+710870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.979824 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:48.979892 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:48.979925 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.468455 (+488530us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54001da1d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:49.468527 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.468722 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634322688}
I20260709 12:23:49.476758  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.458922 13862 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:49.460466 14207 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:49.469199  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:49.488505  8064 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:49.454999 14192 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:49.483019  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.485790  8213 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:49.475481 14145 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:49.486804 14259 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.484859  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 861400us
I20260709 12:23:49.404590 14142 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.507504 14142 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:49.514824  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.517829  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.475719 14241 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:49.521401  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:49.484236 14233 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.532572  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.533607  8064 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:49.475612 14177 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:23:49.544355  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.493597 13862 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:49.559770  8034 leader_election.cc:400] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16.
I20260709 12:23:49.560292  8034 leader_election.cc:403] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:49.561975  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.520042 14207 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:49.523833 14145 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:49.570597  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.526726 14241 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.542989 13791 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.562111 13979 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:49.602600 14110 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:49.603554 14266 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:23:49.605562 14269 log.cc:927] Time spent T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:23:49.606511 14189 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.608428  8144 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:49.567093 13862 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.586740 14208 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:49.575142 13917 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:23:49.525589 14259 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.566879 14203 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:49.619634  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 199392us
I20260709 12:23:49.585281 14241 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.575279 14246 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:49.578157 14240 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16.
W20260709 12:23:49.619781  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.541324 14233 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:49.602697 14274 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:23:49.622531  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:49.627331  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:49.631104  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 180308us
I20260709 12:23:49.629027 14186 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.637645  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.638929  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:49.639716  8137 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:49.641355 14277 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:49.642012  8145 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:49.644721 13776 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:49.645177 13776 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:49.640512  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.646296 14207 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.633952  8061 raft_consensus.cc:1240] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:49.651343 14233 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.635385  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.651925 13866 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.652453 13866 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.652598  8216 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:49.613538 14208 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:49.662503  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 103347us
I20260709 12:23:49.631778  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.652416  8141 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 12.
I20260709 12:23:49.624348 14246 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.615397  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:49.634936 14171 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:49.651887 14233 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:49.673585  8757 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:49.670112  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:49.677330  8218 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:49.672420 14163 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.679176 14275 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:49.678750 14163 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:49.681497  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 527543us
I20260709 12:23:49.659436 14255 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:49.733147  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57797.7us
W20260709 12:23:49.737278  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.737874  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55508.9us
I20260709 12:23:49.739859 14285 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:49.739599 14216 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:23:49.735752  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 168352us
W20260709 12:23:49.734248  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 157064us
I20260709 12:23:49.663492 14208 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:49.748059  8184 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.750248  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.755069  8211 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:23:49.675010 14142 consensus_queue.cc:1059] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:23:49.758752  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.756119  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.759472  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.757541  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.737129 14203 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:49.757438  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:49.742008 14168 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.555s	user 0.015s	sys 0.001s
I20260709 12:23:49.761554  8215 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:49.743104 14233 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:49.759057 14220 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:49.760743  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.761821  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.779333  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.760782  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.764724 13917 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:49.766837  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:49.767982  8141 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:49.768494  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:49.768874  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:49.769578  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:49.771576  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:49.752123 14278 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:23:49.776620  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:49.779775  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.793537  8211 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:49.795897  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:49.741365 14217 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:23:49.794399  8036 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.775568 14285 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:49.751435 14192 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:23:49.794473  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:49.804250 14291 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:49.804802 14271 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 12:23:49.737735 14145 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:49.797235 14156 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:49.797390 14240 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:49.754681 14190 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:23:49.800777 14166 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.006s
I20260709 12:23:49.796550 14203 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:49.819201  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:49.800915 14186 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:49.837230 14259 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:49.837965 14110 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:49.838620  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:49.840013 13979 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:49.841454 13917 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:49.842042  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.842296 14263 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 12:23:49.756178 14198 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:23:49.757180 14255 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:23:49.794502 14168 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:49.826821 13866 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.825906 14287 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:49.843644 14253 consensus_meta.cc:287] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:23:49.844303 14163 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:49.844904 14233 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:49.887864  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56013.1us
I20260709 12:23:50.007742  8068 raft_consensus.cc:606] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:49.994787 14186 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.991557 14156 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.991438 14240 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:49.995195 14207 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:23:50.006168  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 210984us
I20260709 12:23:50.008152  8068 raft_consensus.cc:614] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:50.008545  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:49.907723 13891 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.001s
I20260709 12:23:50.010892  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:50.012485  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 251846us
I20260709 12:23:50.018679  8140 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:49.990629 13791 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:50.016860  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:50.032670  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 239795us
I20260709 12:23:50.018366 14163 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.034843  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.034968  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.037163  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.011806 14190 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:50.012521 14186 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:50.044250  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.013784 14156 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.014784 14240 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:50.045534  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.028716 13979 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.065004  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.013720 14287 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:50.054076  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.057147  8061 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:50.040158 14110 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:23:50.040040 14163 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.059787 14298 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:50.003782 14263 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:50.041716 13963 consensus_meta.cc:287] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.008s
I20260709 12:23:50.029975 14166 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.082041 13791 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.041477 14190 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:50.036499 13891 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:50.011548 14253 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.092932  7965 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:50.045534 13866 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:23:50.096454  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.015033 14208 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.117571  8217 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:50.101830  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.082507 14285 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:50.137506 14285 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.147939  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.148775  8069 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:50.152783  8069 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:23:50.153774 13862 consensus_meta.cc:287] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 12:23:50.154135  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.154331 13862 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.160300  8063 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:50.162554  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.107191 13891 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:50.164588  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:50.166054 14198 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:50.093207 14294 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:23:50.092868 14297 consensus_queue.cc:1059] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:23:50.167168 14302 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:50.046399 14203 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.167542 14297 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:50.167938 14297 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:50.168745 14297 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.169313 14301 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:50.125499  8062 raft_consensus.cc:2393] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 12: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:50.107651  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.171679 13866 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:50.171834  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64280.7us
I20260709 12:23:50.173077  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.173910 13866 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.174559 13866 consensus_queue.cc:1059] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:50.175045  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.116067  8756 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 21. Ops: []
I20260709 12:23:50.175503 13866 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:50.175911 13866 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:50.114792  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.176924  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.177585  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:50.100569 13963 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.117221 14190 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.180099 14190 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.181114 13963 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:50.181375  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 524170us
I20260709 12:23:50.182312  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:50.182675  8064 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:23:50.111696 14207 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:50.110285  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.184141 14207 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.184716 14302 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:50.115833 14163 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.117244 14253 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.185714 14302 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.186619  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:50.115490 14246 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.110165 14296 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.134948 14208 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.135748  8760 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:50.097751 14271 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:50.117908 14263 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:50.091526 13979 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.165601 13891 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.098620 14298 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.212929 13866 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.176965  8067 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 13.
I20260709 12:23:50.128686 14287 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:50.189529  8218 consensus_meta.cc:287] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.000s
I20260709 12:23:50.126389  8066 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:50.190825  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.140311 14285 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:50.194607  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110134us
I20260709 12:23:50.194599  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.195067  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.202668  8758 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:50.202988  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.204910  8061 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:50.178754 14142 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:50.235846  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.163985 14156 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.104862 14166 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.225718  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.236523  8764 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:50.230985  8064 raft_consensus.cc:2410] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:23:50.217823 13791 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:50.229821  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.230857  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.234405 14299 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:50.277523  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46757.6us
I20260709 12:23:50.277850  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:50.233569  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.278620 14253 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:50.279110 13963 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:50.228952  8218 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:50.230420  8062 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:50.280494  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.281242  8218 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:50.282035  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.278263  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:50.284142  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:50.285231 14263 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:50.285821 14263 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:50.286849 14263 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.288707  7965 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:50.290462  7965 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 7 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 8 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:50.284191  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:50.293947 13786 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:50.294482 13786 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:50.296029 14291 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.295740 13786 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.294498 13963 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:50.225433 13866 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:50.300609  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.300745 14233 raft_consensus.cc:2764] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:23:50.220608 14246 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.301903 14180 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.302120  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.303574  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.340425  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.334595  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.226284  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:50.303769  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.307667  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.231523  8065 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:50.309854  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3459) took 1303 ms. Trace:
I20260709 12:23:50.342414  8214 rpcz_store.cc:276] 0709 12:23:49.006148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.017275 (+ 11127us) service_pool.cc:224] Handling call
0709 12:23:50.309668 (+1292393us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400373f54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:50.309795 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655979392}
I20260709 12:23:50.311430  8069 raft_consensus.cc:1240] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:50.325201  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34716 (request call id 1109) took 1169 ms. Trace:
I20260709 12:23:50.325973  8144 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:50.327772  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.296698 14291 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.223651 14297 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.233500 14302 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.335572  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.222896 13891 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:50.224803 14198 consensus_queue.cc:1175] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d67d00ae45b444cbe343726df1760e8" responder_term: 16 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:50.222431 13979 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.301267 14151 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.225584 14298 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.340893  8067 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:50.309511  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:50.349198  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 123011us
I20260709 12:23:50.344450  8142 rpcz_store.cc:276] 0709 12:23:49.155909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.156053 (+   144us) service_pool.cc:224] Handling call
0709 12:23:50.324999 (+1168946us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b54000424d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:50.325133 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90428288}
I20260709 12:23:50.362988  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:50.363111  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.363900  8142 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:50.249663 14142 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.353041  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.370795  8066 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.353507  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.212776 14220 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
W20260709 12:23:50.357751  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50164.9us
I20260709 12:23:50.203789 14296 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.359210  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.360496  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.278041 14299 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.249758 14271 consensus_queue.cc:1059] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 12:23:50.334424 14208 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.376619 14142 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.366503  7965 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 8 to 9, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 9 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:50.364217 14253 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:50.373930  8217 raft_consensus.cc:2410] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:50.358273  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:50.356496 14241 consensus_meta.cc:287] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.004s
I20260709 12:23:50.354110 13791 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:50.376211  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.418227  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.355564 13786 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.355803 14217 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.379726  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:50.380944  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.380944  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.361853 14232 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.389271  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.328949 13963 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:50.413856  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 53466.2us
I20260709 12:23:50.414762  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.356077 14180 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.438911  7965 catalog_manager.cc:5697] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 4 to 8, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 8 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:50.421864  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.425200  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.399392 14220 consensus_queue.cc:1243] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:50.409387 14298 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:50.431540  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51949.5us
I20260709 12:23:50.472369  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:50.476444  8065 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:50.439263  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.432647  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.411944 14295 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:50.494906  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.500674  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.429993 14217 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:50.412108 14240 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.429126 14255 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.426424 14203 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:50.438678 13963 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.438496 14301 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:50.430456 14304 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:50.532806  7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 255) took 26542 ms (client timeout 15000 ms). Trace:
I20260709 12:23:50.534766  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.535099  7965 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 9 to 10, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 10 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:50.537736 14166 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:50.533305  7962 rpcz_store.cc:269] 0709 12:23:23.886638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.886973 (+   335us) service_pool.cc:224] Handling call
0709 12:23:50.418579 (+26531606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:41.236241 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:41.236981 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:41.237035 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:23:41.237052 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:41.425200 (+188148us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:41.425333 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:41.425377 (+    44us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:23:41.427930 (+  2553us) tablet.cc:701] Row locks acquired
0709 12:23:41.427996 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:23:41.428241 (+   245us) write_op.cc:270] Start()
0709 12:23:41.428452 (+   211us) write_op.cc:276] Timestamp: P: 1783599821428148 usec, L: 0
0709 12:23:41.428501 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:23:41.437709 (+  9208us) log.cc:844] Serialized 9010 byte log entry
0709 12:23:42.412300 (+974591us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:42.607382 (+195082us) op_driver.cc:464] REPLICATION: finished
0709 12:23:42.725024 (+117642us) write_op.cc:301] APPLY: starting
0709 12:23:42.725133 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:43.196511 (+471378us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:43.196557 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:43.425871 (+229314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:43.426525 (+   654us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 12:23:43.426588 (+    63us) write_op.cc:312] APPLY: finished
0709 12:23:43.427076 (+   488us) log.cc:844] Serialized 204 byte log entry
0709 12:23:43.432889 (+  5813us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:43.465727 (+ 32838us) write_op.cc:454] Released schema lock
0709 12:23:43.478153 (+ 12426us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:43.548306 (+ 70153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:43.560050 (+ 11744us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60991,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":117313,"apply.run_cpu_time_us":35820,"apply.run_wall_time_us":775160,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100359,"num_ops":23,"prepare.queue_time_us":259090,"prepare.run_cpu_time_us":67310,"prepare.run_wall_time_us":495670,"raft.queue_time_us":136496,"raft.run_cpu_time_us":13266,"raft.run_wall_time_us":79301,"replication_time_us":1178690,"spinlock_wait_cycles":10734080,"thread_start_us":554593,"threads_started":4,"wal-append.queue_time_us":317439,"wal-append.run_cpu_time_us":20825,"wal-append.run_wall_time_us":2681911}]]}
I20260709 12:23:50.513725 14217 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.426666 14241 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.477844 14287 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.514773  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.417630 14208 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.516993  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.524199 14315 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:50.525013  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.493312 14220 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.478129 14298 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:50.513695  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.554720  8145 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:50.535997  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.542857  8066 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:50.552019  8142 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:23:50.559240  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.564393  7965 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.569475  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.570331  8146 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:50.556061 14163 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:50.574944 14151 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.575469  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.575568 14151 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.558270 14287 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.577088  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.577860 14151 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.579003 14287 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:50.581249 14305 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:23:50.581430 14186 consensus_meta.cc:287] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:23:50.581990 14186 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.582798 14180 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.583469  8219 raft_consensus.cc:2393] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:50.583933 14291 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.585506 14186 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.594236 14208 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.595691 14183 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.637692  8214 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:50.600353  8215 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:23:50.601382 14306 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:23:50.608217 14320 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:50.611195  7965 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 3 to 7, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 7 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.575034  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:50.620404  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 187826us
I20260709 12:23:50.630698  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.642109  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1178) took 1347 ms. Trace:
I20260709 12:23:50.556376 14298 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.642545  8759 rpcz_store.cc:276] 0709 12:23:49.294794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.295409 (+   615us) service_pool.cc:224] Handling call
0709 12:23:50.630531 (+1335122us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800105998. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967a22 00007f49928808d9 00007f49919daee0 00007f4991aa40ab 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:23:50.642048 (+ 11517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5195136}
W20260709 12:23:50.654528  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 182218us
I20260709 12:23:50.657917  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.628798 14291 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.667608 14187 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:50.667181 14291 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.670958 14240 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.671073 14142 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.672926  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.673565  8064 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:50.658630  8215 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:50.680471  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:50.681313  8215 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.630404 14203 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.682441  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:50.631544 14156 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:50.654001 14283 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.968s	user 0.001s	sys 0.006s
I20260709 12:23:50.690213  8756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1176) took 1412 ms. Trace:
I20260709 12:23:50.704314  7965 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 6 to 7, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 7 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:50.691383  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:50.692021 14309 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:23:50.692339 14307 log.cc:927] Time spent T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:23:50.693281 14299 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.695084 14217 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.696415 14183 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:50.696882 14316 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:50.698271  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.699000 14232 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.700979 14296 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.701550 14142 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.668223 14187 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.703423 14203 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.710251  8214 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:50.711187  8215 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
W20260709 12:23:50.708681  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 368294us
I20260709 12:23:50.711896  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.717123  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.708236  8756 rpcz_store.cc:276] 0709 12:23:49.272690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.291755 (+ 19065us) service_pool.cc:224] Handling call
0709 12:23:49.393940 (+102185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.175730 (+781790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.684542 (+508812us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540064e954. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:50.684796 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645647232}
I20260709 12:23:50.720477  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.723935  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2349) took 1555 ms. Trace:
I20260709 12:23:50.745966  8066 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:50.723450  7965 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 8 to 9, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 9 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.747014  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.748301  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.748975  8066 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:50.734284  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.738659  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:50.756981  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.745883  8143 rpcz_store.cc:276] 0709 12:23:49.168610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.197240 (+ 28630us) service_pool.cc:224] Handling call
0709 12:23:49.258627 (+ 61387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.384183 (+125556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.384236 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.387853 (+  3617us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.569699 (+181846us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:49.569756 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.706907 (+1137151us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b54002f0654. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:50.706979 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.707050 (+    71us) raft_consensus.cc:1685] finished
0709 12:23:50.707072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.723846 (+ 16774us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79544,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5672,"spinlock_wait_cycles":106782464,"thread_start_us":112223,"threads_started":1,"wal-append.queue_time_us":223867}
W20260709 12:23:50.761574  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 105159us
I20260709 12:23:50.764246  8066 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:50.756981  8137 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:50.736013 14183 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.766454 14156 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:50.775938  8757 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:50.791800  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:50.791985 14156 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.792481 14156 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.792899  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.787276 14255 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.794392  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.795127  8145 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.775002  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.795990  8761 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:50.778609 14167 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:23:50.800186 14167 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:50.800601 14167 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.776965  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.802088 14241 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.777770 14085 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:50.804991 14192 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:50.805512 14192 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:50.805704  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2347) took 1637 ms. Trace:
I20260709 12:23:50.807271  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:50.788240  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:50.809253  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51926 (request call id 17) took 1393 ms. Trace:
I20260709 12:23:50.809688  8214 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:50.809759  8068 rpcz_store.cc:276] 0709 12:23:49.416000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.416174 (+   174us) service_pool.cc:224] Handling call
0709 12:23:50.809026 (+1392852us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400395dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca86853 00007f4991a5460a 00007f498afda7d4 00007f498afda762 00007f498afda691 00007f498afda60c 00007f498afd98c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:50.809154 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358377344}
I20260709 12:23:50.811079 14183 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.811220  8214 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:23:50.785890  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.813031  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.813706  8063 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.785507 14291 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.803953  8213 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:50.816130  8213 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:50.787776  7965 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 6 to 9, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 9 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:50.802127  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 1117) took 1640 ms. Trace:
I20260709 12:23:50.819182  8068 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:50.819710  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:50.806838  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.738947 14322 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:50.817548  8140 rpcz_store.cc:276] 0709 12:23:49.161309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.166815 (+  5506us) service_pool.cc:224] Handling call
0709 12:23:49.190999 (+ 24184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.028959 (+837960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.801859 (+772900us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b5400253854. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:50.802062 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902589184}
I20260709 12:23:50.835815  8063 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:50.838452  8145 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:50.828295  8756 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:50.844779  8143 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:50.806205  8138 rpcz_store.cc:276] 0709 12:23:49.168137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.217134 (+ 48997us) service_pool.cc:224] Handling call
0709 12:23:49.217452 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.217815 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.217842 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.281844 (+ 64002us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.537522 (+255678us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:49.537606 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.537709 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.612942 (+1075233us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:50.766822 (+153880us) raft_consensus.cc:1685] finished
0709 12:23:50.766872 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.805631 (+ 38759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3043,"raft.queue_time_us":1228,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":33696,"spinlock_wait_cycles":9724800,"thread_start_us":153054,"threads_started":1,"wal-append.queue_time_us":318413}
I20260709 12:23:50.849390  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:50.850126  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:50.851042  8138 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:50.800989 14187 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.854980  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:50.858232  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.860656  8140 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:50.793948 14217 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:50.770202 14294 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:50.861687 14220 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.863209  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:50.800993 14167 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.802690 13963 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:50.890841  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.878201 14156 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.880764 14294 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:50.899942 14294 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:50.900614 14296 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:50.905087 13791 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.905690 13791 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.906304 14217 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:50.907919 14216 raft_consensus.cc:3055] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:50.908430 14216 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:50.908900 14156 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:50.909508 14216 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.910557  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:50.911147 14216 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:50.913275 14270 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 1.384s	user 0.010s	sys 0.000s
I20260709 12:23:50.914494  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3456) took 1924 ms. Trace:
I20260709 12:23:50.914870  8212 rpcz_store.cc:276] 0709 12:23:48.990453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.051910 (+ 61457us) service_pool.cc:224] Handling call
0709 12:23:49.169508 (+117598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.205182 (+ 35674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.914277 (+1709095us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540017d4d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:50.914433 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269341568}
I20260709 12:23:50.858991 14142 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.862015 14190 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:50.864493 14301 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:50.883335 14220 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.897805  8213 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:23:50.940357  8213 pending_rounds.cc:85] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 11
I20260709 12:23:50.940763  8213 pending_rounds.cc:107] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:23:50.941136  8213 raft_consensus.cc:2889] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.951192  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.806605 14192 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.952021  8145 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:50.885887 14207 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:50.954789  8145 raft_consensus.cc:2368] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:50.957338  8068 raft_consensus.cc:1240] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:50.962574  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.964473  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 934) took 1976 ms. Trace:
I20260709 12:23:50.908418 14217 consensus_queue.cc:1059] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:50.974290  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:50.966821  8765 rpcz_store.cc:276] 0709 12:23:48.987573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.987795 (+   222us) service_pool.cc:224] Handling call
0709 12:23:48.995028 (+  7233us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:48.997786 (+  2758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.997820 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:49.010761 (+ 12941us) log.cc:844] Serialized 52 byte log entry
0709 12:23:49.354190 (+343429us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:49.398308 (+ 44118us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.398604 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.398709 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.216255 (+817546us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b1800496300. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f522 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:50.912930 (+696675us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b2400318908. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899de09d 00007f498c61010e 00007f498c62788c 00007f498c626bb6 00007f498c6267d8 00007f498c630221
0709 12:23:50.964156 (+ 51226us) raft_consensus.cc:1685] finished
0709 12:23:50.964190 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.964374 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2338,"prepare.queue_time_us":90963,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":22219,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":9967,"spinlock_wait_cycles":36889600,"thread_start_us":305066,"threads_started":1,"wal-append.queue_time_us":408969}
I20260709 12:23:50.975217  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:50.961588 14298 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:50.980798  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:50.986053  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:50.986740  8066 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.988969  8138 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:50.975514 14294 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:51.000095  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.000936  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:50.985311 14297 consensus_meta.cc:287] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
W20260709 12:23:51.004865  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.006059  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.996560  8066 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:23:50.984321 14192 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:51.006194  8036 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.010402  8218 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:51.007666  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:51.012400  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:50.986524 14262 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.017586  8138 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:51.059432  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.062479  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:51.028400  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 141486us
W20260709 12:23:51.031775  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.035694  8145 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:23:51.018366  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 157277us
I20260709 12:23:51.041390  8036 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:51.068328 14339 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:51.068974  8036 leader_election.cc:400] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:51.069443  8036 leader_election.cc:403] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:51.043321 13963 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.071573 13963 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:51.071717 14340 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:51.072068 13963 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:51.072594 13963 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.072491 14340 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.026954 13791 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.075212 14340 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.075284  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.076134 13791 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.043979 14322 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:51.046054  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:51.050065 14330 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:23:51.050993 14327 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:50.998572 14167 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.070806 14298 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.078781  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.011313 14334 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:51.039310 14297 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.093603  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.094892  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.076970 14294 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:51.085117 14240 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:51.103489  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.104290  8145 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.089962 14322 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:51.077944 14183 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.115118  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 912) took 2703 ms. Trace:
I20260709 12:23:51.085073 14262 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.121536  8145 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:51.122124  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2348) took 1953 ms. Trace:
I20260709 12:23:51.115921  8763 rpcz_store.cc:276] 0709 12:23:48.408380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.409023 (+   643us) service_pool.cc:224] Handling call
0709 12:23:48.409423 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.421790 (+ 12367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.421837 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.036590 (+614753us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c00012668. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:23:49.037026 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.377261 (+340235us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:49.616119 (+238858us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.616415 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.616531 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.098669 (+1482138us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b2400318908. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:23:51.111832 (+ 13163us) raft_consensus.cc:1685] finished
0709 12:23:51.111856 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.111999 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20823,"prepare.queue_time_us":401696,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":19440,"raft.queue_time_us":8109,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":13337,"spinlock_wait_cycles":39802624,"thread_start_us":467012,"threads_started":2,"wal-append.queue_time_us":423625}
I20260709 12:23:51.100935 14297 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.129184  8066 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:51.122848  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 55906.2us
I20260709 12:23:51.125689  8139 rpcz_store.cc:276] 0709 12:23:49.168393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.218749 (+ 50356us) service_pool.cc:224] Handling call
0709 12:23:49.279545 (+ 60796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.285555 (+  6010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.285587 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.294691 (+  9104us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.635599 (+1340908us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b1800303340. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:50.740407 (+104808us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:50.740480 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.740586 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:51.117651 (+377065us) raft_consensus.cc:1685] finished
0709 12:23:51.117673 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.122057 (+  4384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77146,"raft.queue_time_us":2827,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8816,"spinlock_wait_cycles":21824384,"thread_start_us":104543,"threads_started":1,"wal-append.queue_time_us":1584127}
I20260709 12:23:51.135908 14324 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:51.136514  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:51.141104  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.142764  8213 raft_consensus.cc:1275] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:51.143478 14220 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.144217 14322 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.146845 14246 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:51.147320 14246 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:51.148243 14246 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.148852 14167 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.149379 14246 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.149845 13862 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.152319 14297 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:51.148449  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.156985  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:51.157127  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.153510  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:51.157814  8211 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:51.158329  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:51.163647 14292 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 1.051s	user 0.004s	sys 0.015s
I20260709 12:23:51.163978 14259 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:51.164418 14259 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.164858 14259 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:51.165660  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.182689  8145 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:51.190042  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:51.168416  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 933) took 2212 ms (client timeout 1979 ms). Trace:
I20260709 12:23:51.173571  8214 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:51.201691  8070 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:51.180367  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.202795  8138 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:51.179957  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.193663  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:51.181866  8069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3432) took 1024 ms. Trace:
I20260709 12:23:51.204756  8069 rpcz_store.cc:276] 0709 12:23:50.157293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.157845 (+   552us) service_pool.cc:224] Handling call
0709 12:23:50.158154 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.343910 (+185756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.181624 (+837714us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001f7554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:51.181801 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338399616}
I20260709 12:23:51.207041  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.208225  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.189350  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:51.201813  8762 rpcz_store.cc:269] 0709 12:23:48.956213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.956374 (+   161us) service_pool.cc:224] Handling call
0709 12:23:51.168177 (+2211803us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54005eecd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:51.168320 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965581056}
I20260709 12:23:51.210868  8141 raft_consensus.cc:2368] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15.
I20260709 12:23:51.170269  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:51.187063  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49964 (request call id 1177) took 1911 ms. Trace:
I20260709 12:23:51.212962  8760 rpcz_store.cc:276] 0709 12:23:49.275681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.386662 (+110981us) service_pool.cc:224] Handling call
0709 12:23:49.450118 (+ 63456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.198391 (+748273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.186815 (+988424us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400477054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:51.187000 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576053504}
I20260709 12:23:51.217752  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.218688  8035 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:51.165019 14332 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:23:51.219367  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:51.169725 14343 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:51.217438  8731 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:51.221866  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.222342  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.222860  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.175937 14110 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.213677 14233 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:51.220383  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.171942 14349 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.224053  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.176352 14297 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.240041  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.168792 14294 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:51.240191  8214 raft_consensus.cc:3060] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:51.160357 13862 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:23:51.218892 14285 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:51.216964 14334 raft_consensus.cc:2764] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:23:51.253328 14177 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:51.253829 14177 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:51.254261 14177 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.242578 14110 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.256460 14110 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.223205 13963 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.258309 13979 raft_consensus.cc:3055] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:51.258777 13979 raft_consensus.cc:740] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:51.259861 13963 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.259644 13979 consensus_queue.cc:260] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.236604 14220 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.213461 14183 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.159739 14217 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 12:23:51.224138 14302 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:51.166042 14304 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:51.220736 14265 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:51.220326 13791 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:23:51.234790 13866 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:51.234403 14241 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:51.247684  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:51.266469  8070 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:23:51.260825 14271 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:51.242623 13917 raft_consensus.cc:2804] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:51.236953 14216 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:23:51.260891 14163 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:51.283020  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.284093  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.293195  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.242677 14295 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:51.272899 14232 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:51.274510  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3455) took 2273 ms (client timeout 2190 ms). Trace:
I20260709 12:23:51.282301 13979 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:51.286870  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66563.4us
W20260709 12:23:51.301002  8216 rpcz_store.cc:269] 0709 12:23:48.990157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.004471 (+ 14314us) service_pool.cc:224] Handling call
0709 12:23:51.262953 (+2258482us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540017cad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:51.263101 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432998144}
I20260709 12:23:51.286746 14241 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.304533  8036 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:51.288710  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55702.8us
I20260709 12:23:51.252979 14285 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.279578  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.284818 13866 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:51.244249 14206 consensus_queue.cc:1059] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:23:51.246407 14256 consensus_queue.cc:1048] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:23:51.273468 14302 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.244647 14297 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.295939 14163 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:51.284953  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66335.5us
I20260709 12:23:51.307915  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:51.243379 14349 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.261010 14220 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.327824  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.328820  8216 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:51.308254  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.329610  8762 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:23:51.331310  8070 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:51.332122  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.332679  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.309043 13866 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:51.309419 14302 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:51.314253  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:51.308339  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84013.5us
I20260709 12:23:51.290794 14085 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:23:51.294803 14262 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.306874 14285 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:51.323423  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:51.326239  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.300197 14271 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:51.345208  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.337917  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.339140  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:51.313227 14183 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:51.307228 14241 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.342082  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.342739  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.309763 14206 raft_consensus.cc:3055] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:51.308024  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:51.339602  8765 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:51.352993  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.346097  8139 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.346879  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.347594  8759 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:51.348466  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.348789  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:51.383812  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 75873.1us
I20260709 12:23:51.384657 14271 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.388607  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.388813 14262 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:51.389338 14262 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.389526  8070 raft_consensus.cc:2368] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:51.389765 14262 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:51.391387  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 49068.2us
I20260709 12:23:51.392513  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:51.357652  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.384979  8036 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:51.395058  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:51.383893  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.304917 14295 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.397090  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.401196  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.401255 14294 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:51.403090 14294 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:51.404072 14294 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.406889 14361 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:51.393467 14263 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:51.413677  8062 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:51.417575  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.420483  8220 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:51.407833 14240 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:51.424846  8062 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:51.354640 14246 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:23:51.426730  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.427539 13862 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:51.388948 14183 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:51.352352 14206 raft_consensus.cc:740] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:51.354112 13917 raft_consensus.cc:697] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:51.396891 14192 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:51.430634  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:51.436213  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:51.458525  8216 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:51.421838 14340 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:51.349982 14358 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:51.410544 14322 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:51.388828 14304 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:23:51.459041  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67613.7us
I20260709 12:23:51.461982  8220 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:51.316812 13776 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.470451  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.472110  8220 raft_consensus.cc:2376] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18. Re-sending same reply.
I20260709 12:23:51.470654  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:51.473332  8220 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:51.430200 14216 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:51.459398 14297 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.490509  8213 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:51.463409 14356 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.470299 14265 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:51.500819 13917 consensus_queue.cc:237] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.476292 14186 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:51.508276  8213 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:51.500083 14285 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:51.520704  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2266) took 1758 ms (client timeout 2112 ms). Trace:
W20260709 12:23:51.521214  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.521152  8219 rpcz_store.cc:269] 0709 12:23:49.762241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.018101 (+255860us) service_pool.cc:224] Handling call
0709 12:23:51.520508 (+1502407us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54001b9254. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:51.520610 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238005120}
I20260709 12:23:51.476804 14322 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:51.510848 13776 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:51.536310 14203 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.546262  8214 raft_consensus.cc:2468] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
W20260709 12:23:51.548807 14354 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 12:23:51.527421 14183 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.505967 14206 consensus_queue.cc:260] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.563076 14255 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:51.563537 14255 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:51.571204  8139 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:23:51.575491 14220 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.576586 14295 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.584161 14233 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:51.584923 14322 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.588579  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51464 (request call id 2447) took 1223 ms. Trace:
I20260709 12:23:51.609382  8211 raft_consensus.cc:1240] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:51.555922 13866 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:51.612063  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.614265  8144 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:51.591807  8137 rpcz_store.cc:276] 0709 12:23:50.365536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.535763 (+170227us) service_pool.cc:224] Handling call
0709 12:23:51.588395 (+1052632us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001c39d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:51.588519 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462578944}
I20260709 12:23:51.514515 14356 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.540072 14186 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:51.641422  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167162us
W20260709 12:23:51.640394  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 177844us
I20260709 12:23:51.647055  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:51.651906 14177 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.657521 13866 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:51.658263 14349 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.658202 13866 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.643854 14142 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:51.642164 14233 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.642405 14361 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.664422 14216 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:51.662489 14186 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.564436 14255 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.703987 14142 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:51.709607 14232 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:51.713946  8062 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
W20260709 12:23:51.727600  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.730780  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.731495  8765 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:51.732673  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 84115.6us
I20260709 12:23:51.741617  8759 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:51.749863  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:51.707032 13866 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.710495 14233 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.712306 14262 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.744357 14255 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:51.743151 13776 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:51.714956 14361 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.756798 14271 raft_consensus.cc:2764] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:51.782223  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.785796  8214 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
W20260709 12:23:51.799678 14374 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:23:51.799597 14163 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.802074  8065 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:51.802166 14163 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.794137 14241 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.804940  8212 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:51.799615 14259 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
I20260709 12:23:51.805800 14302 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.806010 14259 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.772755 14285 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.808027 14302 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.808879  8216 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:51.808136 14241 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:51.769469 14379 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:23:51.782227 14375 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:51.846395  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:51.762766 14142 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.769541 13776 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.832984 14356 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.835584 14302 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:51.872071  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.858036 14375 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:51.877647 14375 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.878377 14361 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.882931 14232 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:51.883484 14232 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:51.883680 14259 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.885456 14233 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:51.886349 14371 log.cc:927] Time spent T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:23:51.887084 13866 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:51.861234 14388 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.874342 14302 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:51.908190  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:51.909147  8140 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:51.909228 14378 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:23:51.901782 14142 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:51.887959 14388 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:51.925802 14388 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:51.902195 14302 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.936733 13776 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.937115 14296 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:51.937829 14296 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:51.938728 14296 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:51.940496  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.949512  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 207238us
W20260709 12:23:51.941841  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 201661us
I20260709 12:23:51.951005  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.953666  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:51.955808  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:51.958765  8062 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:51.960937  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.957396  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:51.965781  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:51.966493  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.967115  8068 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
W20260709 12:23:51.967983  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3463) took 1792 ms (client timeout 1561 ms). Trace:
I20260709 12:23:51.967974  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.970189  8068 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:51.968390  8218 rpcz_store.cc:269] 0709 12:23:50.175326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.281788 (+106462us) service_pool.cc:224] Handling call
0709 12:23:51.967825 (+1686037us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400316fd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:51.967914 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673784064}
I20260709 12:23:51.977581  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.978921  8068 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:51.983045  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.982506  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:51.981047  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:51.982209  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.990738  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.988138  8068 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:51.961905 14198 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:51.995514  8064 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:51.995678  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:51.996347  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:51.991760  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:51.965296 13776 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:51.962045 14379 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:51.962347 14390 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.964865 14262 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:51.973778 14296 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:51.979550 14382 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:23:52.008215 13776 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.021852 13776 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:52.025669 14232 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.006798  8765 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:51.984607 14255 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.029096 14255 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.030730  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:52.031189 14255 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:51.984898 14216 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:52.029806 14232 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.057296  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.058478  8212 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:23:52.061192  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:52.067284 14246 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.067926 14246 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.070307 14246 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.033038 14216 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:52.078282 14216 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:52.076669 13776 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.081125 14298 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.081761  8140 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:52.081647 14298 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.082674 13776 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.083660 14298 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.083527 14293 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:52.084359 14264 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:52.084831 14264 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.088757 14264 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:52.091774  8144 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:52.098555 14301 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.099197 14301 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.101437 14301 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.102747 14301 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.103427 14301 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.106187 14301 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:52.109181  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.016s	sys 0.028s
W20260709 12:23:52.109551  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.016s	sys 0.028s
W20260709 12:23:52.109799  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 716028us
I20260709 12:23:52.110428  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.122018 14187 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:52.122671 14187 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.133760 14216 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.137764 14293 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.140955  8137 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
W20260709 12:23:52.140859 14369 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
I20260709 12:23:52.141613 14324 consensus_queue.cc:1059] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:23:52.140933  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.147310 14299 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:52.147984  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:52.149062  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.149322  8063 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:52.149386 14339 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.149583 13862 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:52.173480  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:52.154417  8137 pending_rounds.cc:85] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 7
I20260709 12:23:52.174153  8137 pending_rounds.cc:107] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:23:52.174428  8137 raft_consensus.cc:2889] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.168329 14339 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.167762 14400 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:52.169751  8146 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:52.177809  8146 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:52.171756 14177 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:52.161661  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:52.155310 14187 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:52.186287 14240 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:52.187286 14370 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:23:52.191145 14339 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.200258  8139 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:52.178820  8146 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.201623  8146 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:52.200304  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.205390  8217 raft_consensus.cc:1275] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:52.205775  8066 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:52.207072  8063 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:52.208218  8062 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:52.154948 14293 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.218390  8146 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:23:52.218914  8146 pending_rounds.cc:85] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 14
I20260709 12:23:52.221962  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.223181  8146 pending_rounds.cc:107] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:23:52.223560  8146 raft_consensus.cc:2889] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:52.225500  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63943.8us
I20260709 12:23:52.227295  8186 leader_election.cc:400] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15.
I20260709 12:23:52.227837  8186 leader_election.cc:403] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.226542  8067 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:52.229511  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.187300 14240 consensus_queue.cc:1243] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:52.234465  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.237675  8139 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:52.200073 14339 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.238765  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.239957  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:52.209227 14333 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.248095  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:52.250514  8137 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:23:52.250880  8137 pending_rounds.cc:85] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 8
W20260709 12:23:52.238533 14217 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:23:52.251169  8137 pending_rounds.cc:107] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:23:52.238353 14299 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:52.247128  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:52.208254 14156 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:23:52.235565 14110 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:52.236116 14400 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15.
I20260709 12:23:52.219638 14085 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:23:52.244987 13979 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:52.253289  8137 raft_consensus.cc:2889] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.256861  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:52.266443  8141 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:52.257929  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.261582  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.273358  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.274103  8145 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:52.275195 13917 raft_consensus.cc:3055] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:52.275614 13917 raft_consensus.cc:740] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:52.238677 14324 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:23:52.238915 14187 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:23:52.240590 14208 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:23:52.297143 14208 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:52.297530 14208 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:52.298363 14208 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.299639 14208 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:52.254568 14368 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:23:52.282356 13979 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:52.247125 14232 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 12:23:52.279191 14321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.005s	sys 0.014s
I20260709 12:23:52.276466 13917 consensus_queue.cc:260] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.302482  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:52.302538  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:52.319523  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:52.322867  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.248129 14339 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.303926  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.302778  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:52.304450  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.280695 14264 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.309645  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.331470  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:52.310647 14355 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:52.311539  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.337297  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1171) took 1139 ms. Trace:
I20260709 12:23:52.305923 14299 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.261466 14110 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.290092 14216 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:52.359395  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.303031  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.249787 14333 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.328507  8213 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:52.310245  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:52.335914  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.375288  8217 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:23:52.315338 14321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.005s	sys 0.014s
I20260709 12:23:52.339785  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:52.312402  8211 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:52.342597  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:52.342988  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.337710  8215 rpcz_store.cc:276] 0709 12:23:51.198091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.198388 (+   297us) service_pool.cc:224] Handling call
0709 12:23:51.198779 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:51.310286 (+111507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.310322 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:51.310365 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:51.310395 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.337082 (+1026687us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540016add4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:52.337128 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.337244 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255941888}
I20260709 12:23:52.315593 14187 consensus_queue.cc:1243] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:23:52.341564 13917 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:52.391958  8762 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:52.316658 14380 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:23:52.393813  8109 leader_election.cc:400] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:52.400893  8109 leader_election.cc:403] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.359840 14110 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:52.401885  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:52.402985  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:52.404654  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:52.379483  8140 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:52.396548  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.396905  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.361974 14240 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:52.359755 14233 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:52.408054  8063 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:52.408169  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68468.9us
I20260709 12:23:52.392293  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.416641  8065 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 13: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:52.416483  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:52.338617 14379 consensus_queue.cc:1059] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:23:52.420060  8762 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:52.420258  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:52.422825  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.424232  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.426517  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:52.428097 14382 consensus_queue.cc:1059] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:52.445477  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.429394  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:52.429869  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.447240  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.447908  8070 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:52.433988  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:52.448669  8066 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:52.448721  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.438867  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:52.440990  8213 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:23:52.358170 14355 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:52.460726  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44282us
W20260709 12:23:52.463884  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.464200  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:52.463238  8213 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:52.411274 13776 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:52.408914 14192 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:52.481395  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52079.7us
I20260709 12:23:52.482204  8061 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:52.483397  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:52.383841 13979 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.691864  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:52.491990 14405 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:23:52.363547 14299 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.416224 14298 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:52.432761 14296 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:52.414831 14233 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:52.495139 14366 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:23:52.632995 14401 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 12:23:52.636870 14216 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.693301 14339 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.615170 14198 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:52.432441 14262 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:52.480790  8765 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.658063 14382 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.662129 14301 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.568495 14293 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.479929 14356 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.199s
I20260709 12:23:52.665766 14390 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:52.754259  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:52.668459 14264 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.668790 14232 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:52.669759 14333 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.670547  8220 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:52.671679 14355 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:52.657442 14349 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.411898 14316 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.190s
W20260709 12:23:52.772891 14414 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:23:52.685365  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 299795us
I20260709 12:23:52.663947 14110 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.775988 14110 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:52.700875  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 247939us
I20260709 12:23:52.739234 14262 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:52.702394  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 236161us
I20260709 12:23:52.782784  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:52.709168  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 225860us
I20260709 12:23:52.710405  8066 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:52.430624 14246 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.186s
I20260709 12:23:52.702455 14302 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:52.751755 14198 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:52.754794 14390 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.724682 14168 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.718971 14372 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:52.667621  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:52.695325 14375 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:23:52.740388 14192 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:52.700358  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 237397us
I20260709 12:23:52.843904  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.779479  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:52.781078  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:52.845950  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 64988.8us
I20260709 12:23:52.846983  8186 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.790354 14262 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:52.718721 14233 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:52.789669  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:52.877748  8062 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:52.755931 14301 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.797670  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.886570  8213 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 12.
I20260709 12:23:52.887740  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.889146  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.890419  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:52.798230  8214 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:52.799077  8211 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:52.800748  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.737075 14216 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.777834 14232 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.802836 14302 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.814460  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.784127 14349 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.833501  8212 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:23:52.834261  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.787649  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:52.809990 14390 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:52.751461 14382 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:52.750985  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59200.9us
I20260709 12:23:52.789642 14333 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.842155 14256 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:52.946151 14256 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:52.946728 14299 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:52.894906  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 51096.3us
I20260709 12:23:52.948853  8145 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:52.949216 14349 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:52.892305  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.951136  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:52.951715  8214 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:52.893364  8217 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:52.953866 14198 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:52.917213  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.927534  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:52.930716  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.930653 14421 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:52.934029  8065 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:52.848533  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:52.937129  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 79763us
I20260709 12:23:52.854445 13807 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:52.853410 14255 consensus_queue.cc:1048] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:23:52.944895 14375 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:52.945189  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:52.951005 14167 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:52.915544 14356 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.959415  8140 pending_rounds.cc:85] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 6
W20260709 12:23:52.985765  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 137335us
W20260709 12:23:52.915385 14321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.058s	sys 0.058s
W20260709 12:23:52.988870 14417 log.cc:927] Time spent T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:23:52.847579 14168 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.922082  8213 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:53.080585 14168 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.081132 14168 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.081615 14168 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.093312 14296 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:53.094300  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.094802  8065 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:53.094350 14296 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.043682  8140 pending_rounds.cc:107] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:23:52.989670  8214 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:53.044705  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:52.933748 13866 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:52.992134 14208 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.003s
I20260709 12:23:53.056330 14356 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.103627  8140 raft_consensus.cc:2889] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.957099 14333 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:52.959285 14216 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.044220 14240 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:52.956610 14421 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.113421 13776 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 13. Current term is 14.
I20260709 12:23:53.112071 14422 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.114754 14422 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.115363 14421 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.115722 14349 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:52.957829 14410 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:23:53.116288 14349 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.006003 14375 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:53.061123  8764 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:53.043453 14110 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:52.985368  8212 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:53.129271  8764 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:53.074340 14321 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:52.959065 14301 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.077925 14302 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.105436  8066 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:52.960937 14372 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.110831 13917 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.913928 14324 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:53.059864 14232 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.118569  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.118919  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.076458 14382 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.121872  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.123208  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.113408  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:53.138365  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93806.4us
I20260709 12:23:53.156965  8186 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:53.138605  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.158527  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.158802  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.158824  8065 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:53.130127  8764 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.110888 14295 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.144097 14349 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.112200 14246 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.166734 14246 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.120744 14192 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:53.168934 14192 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.140211 13776 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.171739 13776 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.138110 14321 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:53.179193  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.182709 14168 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.183740 14168 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:53.202054 14380 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:53.204833 14380 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.205431 13807 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:53.205381 14380 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.163503 14216 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:53.206516 14216 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:53.207463 14216 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.207932 14380 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.213155 14217 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.213755 14217 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.145062 14302 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:53.218358  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.207808 14293 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:53.153957 14110 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:53.233233  8760 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:53.181232 14246 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.216512 14217 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.179145 14422 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.153666 13917 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.260492  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.261499  8062 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:53.221311 14349 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.221660 14293 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:53.238993 14412 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.486s	user 0.003s	sys 0.001s
I20260709 12:23:53.150434 14372 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.275086 14246 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.280211 14233 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:53.277597 14415 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:23:53.280293 14419 log.cc:927] Time spent T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:53.177831 14295 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.234854 14302 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.276060 14356 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.315018  8218 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:23:53.315725  8062 raft_consensus.cc:1240] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:53.318300  8061 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:23:53.288467  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 620889us
I20260709 12:23:53.321489  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.322285  8138 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 11.
W20260709 12:23:53.335595  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.340309  8138 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:53.344345  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.346323 14372 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.347141  8138 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:53.346174 14233 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:53.288904 14208 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.237221 14375 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.354935  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.355875  8138 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:53.287905 14246 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.363417 14246 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.373131 14428 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.373931 14428 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.283779 14349 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.383656  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.385833  8138 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:53.393940  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.394992  8138 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:53.340654 14217 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.397642  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:53.398981  8142 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:53.274412 14321 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.342706 14293 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.405284 14333 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.482740 14240 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.499413 14240 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:53.460457 14246 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.500767 14246 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.503257 14246 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.503827 14246 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.488557  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49968 (request call id 954) took 1159 ms. Trace:
I20260709 12:23:53.506178  8760 rpcz_store.cc:276] 0709 12:23:52.329435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.329560 (+   125us) service_pool.cc:224] Handling call
0709 12:23:53.488335 (+1158775us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54005307d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:53.488474 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670202752}
I20260709 12:23:53.504355  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.519697  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.524789 14424 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:53.526713  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.381325 14208 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.529314  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.531306  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.461139 14375 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:53.494323 14321 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:53.478770 14426 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.533002  8110 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.504329 14246 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.496438 13917 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:53.473484 14428 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.486361 14349 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.494072 14302 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.497534 14295 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.402639 14217 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:53.538532  8217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.017s	sys 0.051s
W20260709 12:23:53.592767  8217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.017s	sys 0.051s
I20260709 12:23:53.593441  8730 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.460815 14422 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:53.527910 14339 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:53.525923 14424 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:23:53.540156  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:53.531708 14301 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:53.538733 13979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.023s	sys 0.046s
I20260709 12:23:53.531368 14142 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:53.591254  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 468279us
I20260709 12:23:53.537173 14293 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:53.538631 14382 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:53.541332 14421 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:53.663239  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.664837  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:53.665570  8758 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:53.675705  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.677506  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:53.649037 14110 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.678403  8062 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:53.677958  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:53.734488  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:53.734638  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 56781.8us
I20260709 12:23:53.735667  8760 raft_consensus.cc:2368] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 20. Current term is 21.
I20260709 12:23:53.592423 14156 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.722337  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.021s
W20260709 12:23:53.810472  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.011s	sys 0.021s
I20260709 12:23:53.721561 14428 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.724833  8064 raft_consensus.cc:1240] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:53.725241 14380 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:53.618294 14324 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:23:53.645190 13979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.023s	sys 0.047s
W20260709 12:23:53.811007  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 685009us
W20260709 12:23:53.857591  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.571741 14426 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:53.855865  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.721864 14271 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.733446 14198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.017s	sys 0.015s
W20260709 12:23:53.863596 14262 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.970s	user 0.010s	sys 0.002s
I20260709 12:23:53.721297 14424 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:53.598750 14339 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:53.618614 14422 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:53.865303 14390 consensus_meta.cc:287] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.000s
I20260709 12:23:53.859100 14110 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.648593 14382 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:53.926154  8061 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:53.728313 14240 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.909780  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:53.915747 14324 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:53.923857 14085 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.930335 14085 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.931437 14422 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.919101 14339 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:53.724835 14217 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:53.860445 14356 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:53.933187 14356 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.933775 14356 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:53.911862 14198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.018s	sys 0.015s
I20260709 12:23:53.915645 14424 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:53.915520 14262 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.927659 14390 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.930500 14324 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.898859 14431 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.950342 14390 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:53.951579 14085 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:53.952219 14262 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:53.900286 14380 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.884843 14428 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:53.954834 14240 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.959764 13979 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:53.945206 14361 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:53.962895 14208 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:53.915155 14271 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:53.965919 14437 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:53.928845 14382 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:53.989202  8070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.015s	sys 0.011s
W20260709 12:23:54.042372  8070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.016s	sys 0.012s
I20260709 12:23:53.961246 14339 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:53.929378  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:54.043675  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 114383us
W20260709 12:23:53.898731  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 165502us
W20260709 12:23:54.044595  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.018s	sys 0.035s
W20260709 12:23:54.045179  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.018s	sys 0.035s
W20260709 12:23:53.997624  8139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.020s	sys 0.050s
W20260709 12:23:54.048251  8139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.021s	sys 0.050s
I20260709 12:23:54.049207  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2392) took 1793 ms. Trace:
I20260709 12:23:54.051487  8034 leader_election.cc:400] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 20. Current term is 21.
I20260709 12:23:54.051872  8034 leader_election.cc:403] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:53.999066  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.025s	sys 0.044s
W20260709 12:23:54.052922  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.026s	sys 0.044s
W20260709 12:23:54.053539  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 896596us
I20260709 12:23:54.061587  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:54.007977  8033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.012s	sys 0.023s
W20260709 12:23:54.064697  8033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.023s
W20260709 12:23:54.008044  8036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.009s	sys 0.020s
W20260709 12:23:54.066319  8036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.020s
I20260709 12:23:54.049607  8139 rpcz_store.cc:276] 0709 12:23:52.255367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.263356 (+  7989us) service_pool.cc:224] Handling call
0709 12:23:52.263639 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.263824 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:52.301057 (+ 37233us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.194744 (+893687us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18003d73e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:54.048815 (+854071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:54.048879 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:54.048927 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.049013 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.049145 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5564,"prepare.queue_time_us":35407,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":7397120,"thread_start_us":853773,"threads_started":1}
I20260709 12:23:54.068526  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.070747  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.062533  8212 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:54.069345  8759 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:53.966457 14156 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.014359 14361 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:54.074271  8036 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:54.021952  8765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.000s	sys 0.033s
W20260709 12:23:54.102260  8765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.043s
I20260709 12:23:54.058166 14142 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:54.081656 14240 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:23:53.983892 14431 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:54.081048 14216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.006s	sys 0.031s
I20260709 12:23:54.071830 14379 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:54.093071 14302 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.097141 14361 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:54.100682 14321 consensus_meta.cc:287] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 12:23:54.017751 13979 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.105849 14446 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.127712 14216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.007s	sys 0.031s
W20260709 12:23:54.118727 14437 log.cc:927] Time spent T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:23:54.163240  8110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.025s	sys 0.035s
I20260709 12:23:54.122396 14246 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:54.158185  8217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.027s	sys 0.036s
I20260709 12:23:54.126878 14379 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.116847 14444 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.174094  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:54.154457 13862 raft_consensus.cc:3055] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:23:54.179510  8110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.025s	sys 0.035s
W20260709 12:23:54.196926  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 656840us
I20260709 12:23:54.116911 14434 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.187729  8217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.027s	sys 0.036s
W20260709 12:23:54.166646  8108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.018s	sys 0.047s
W20260709 12:23:54.202062  8108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.018s	sys 0.047s
W20260709 12:23:54.190573  8109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.021s	sys 0.056s
I20260709 12:23:54.020527 14424 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.211571 14424 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.211753 14380 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.206653 14216 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.212817 14216 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.214043 13979 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.215102 14216 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.206856 14246 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.216455 13776 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.216763  8219 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:54.217056  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.217362  8219 raft_consensus.cc:2368] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:54.161702 14302 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.218207  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.210103 14428 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.210310 14217 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:54.216140 14246 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.220144  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.198772  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.195595 14379 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.222640  8139 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:54.204665 13862 raft_consensus.cc:740] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:54.206959 14167 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:23:54.208685  8109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.021s	sys 0.056s
W20260709 12:23:54.242044  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 591278us
W20260709 12:23:54.242707  8109 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.579s (SENT) [suppressed 11 similar messages]
I20260709 12:23:54.221254 14110 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.179977 14446 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.264891 13776 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:54.278612 14445 log.cc:927] Time spent T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:23:54.278991  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.279762  8144 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:54.280144 14302 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:54.280593 14440 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:23:54.280817 14302 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.281359 14302 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:54.282063 14435 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:23:54.218780 14434 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.280838  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.283556 14302 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.284039  8144 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:54.223203 14217 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.286304  8144 raft_consensus.cc:1240] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:54.286634 14217 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.287173 14217 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:54.287631 14217 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.244019 14167 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.288818 14167 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.289770  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.291239 13917 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.291668 13917 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.292033 13917 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.293109 13862 consensus_queue.cc:260] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.293883  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49968 (request call id 956) took 1447 ms. Trace:
I20260709 12:23:54.294351 13862 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.294945 14246 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.268909 14452 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.296787  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1053) took 1517 ms. Trace:
I20260709 12:23:54.297358 14156 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.297096 14452 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.297268  8070 rpcz_store.cc:276] 0709 12:23:52.778949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.779682 (+   733us) service_pool.cc:224] Handling call
0709 12:23:52.802163 (+ 22481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.961893 (+159730us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:23:52.962210 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.341275 (+379065us) log.cc:844] Serialized 14 byte log entry
0709 12:23:53.502376 (+161101us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b1800036580. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49919b5328 00007f49919ac901 00007f49919ac8a7 00007f4991aa4288 00007f4991aa3f37 00007f4991ab855c 00007f4991ab8508
0709 12:23:54.042824 (+540448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:54.042889 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:54.042946 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.296521 (+253575us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540011cbd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:54.296570 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.296724 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84387,"prepare.queue_time_us":24572,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":172494,"raft.run_cpu_time_us":2531,"raft.run_wall_time_us":188759,"spinlock_wait_cycles":376206336,"thread_start_us":1046124,"threads_started":2,"wal-append.queue_time_us":697390}
I20260709 12:23:54.299612 14452 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.207484 14444 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.302253 14444 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.303747 14206 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.304360 13917 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:54.305421 14447 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:54.225394 13979 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:54.309815 13979 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.312247 13979 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.314122  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.314898  8220 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
W20260709 12:23:54.262737 14430 log.cc:927] Time spent T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 12:23:54.316143 14427 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.583s	user 0.000s	sys 0.001s
I20260709 12:23:54.316820  8137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2401) took 2006 ms. Trace:
W20260709 12:23:54.317879 14438 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.443s	user 0.001s	sys 0.000s
I20260709 12:23:54.320118  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2285) took 2017 ms. Trace:
I20260709 12:23:54.236752 14421 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:54.320888 14421 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.320670  8219 rpcz_store.cc:276] 0709 12:23:52.302162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.302272 (+   110us) service_pool.cc:224] Handling call
0709 12:23:54.319835 (+2017563us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003a7d54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:54.320039 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4343342336}
I20260709 12:23:54.321561 14421 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.278191 13776 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.324491  8145 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:54.326012 13776 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.317903  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:54.294380  8765 rpcz_store.cc:276] 0709 12:23:52.846097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.846259 (+   162us) service_pool.cc:224] Handling call
0709 12:23:52.914921 (+ 68662us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:53.315976 (+401055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.316008 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:53.316600 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 12:23:54.102735 (+786135us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:54.217799 (+115064us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.218070 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.218162 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.293629 (+ 75467us) raft_consensus.cc:1685] finished
0709 12:23:54.293651 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.293808 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23523,"prepare.queue_time_us":105640,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":35445,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":1150,"thread_start_us":1099847,"threads_started":2,"wal-append.queue_time_us":867409}
I20260709 12:23:54.239180 14216 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.265295 14428 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:54.317324  8137 rpcz_store.cc:276] 0709 12:23:52.309926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.402822 (+ 92896us) service_pool.cc:224] Handling call
0709 12:23:52.403196 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.403516 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.403552 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.404110 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.839839 (+435729us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18001618c0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:23:53.283183 (+443344us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:53.283223 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.283288 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.316479 (+1033191us) raft_consensus.cc:1685] finished
0709 12:23:54.316500 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.316757 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5852,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3890,"spinlock_wait_cycles":45463296,"thread_start_us":443146,"threads_started":1,"wal-append.queue_time_us":1430202}
I20260709 12:23:54.341094  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.341928  8137 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.263865 14426 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.259159  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.346199  8139 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:23:54.347512  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.348166  8139 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:54.236141 14422 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:23:54.366712  8139 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:54.353091  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.339371 14323 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:54.333736 13917 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.343008 14428 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.378221  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 314137us
W20260709 12:23:54.379426 14256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.074s
I20260709 12:23:54.370918 14271 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:54.390872  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 316714us
I20260709 12:23:54.392583  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.339335 14382 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.375648 14323 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:54.379232 14428 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:54.379269 14156 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:54.384476 14339 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.401571  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.340728 14216 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.430953  8211 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:54.431540  8214 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:54.431824  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.432717  8220 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 12.
I20260709 12:23:54.432745  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:54.433784  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45064.8us
I20260709 12:23:54.435534  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:54.390452 14390 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:23:54.390630 14256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.015s	sys 0.074s
I20260709 12:23:54.447305  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:23:54.419572 14293 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.771s	user 0.003s	sys 0.010s
W20260709 12:23:54.397926 14375 consensus_meta.cc:287] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.000s
I20260709 12:23:54.461897  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.464090  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.437151  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.469182  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.426514 14323 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.472095  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.472409  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:54.475683  8138 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:23:54.480278  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.426350 14156 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.428730 14431 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.484040  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:54.436890 14443 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.484932  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 47912.7us
I20260709 12:23:54.437343 14271 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:54.484809  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.489063  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.489420  8036 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.490146  8761 raft_consensus.cc:2368] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:54.489297  8759 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
W20260709 12:23:54.474932 14356 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.002s
I20260709 12:23:54.497574  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.474615 14452 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.492723  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.470530 14442 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:54.492162  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.463063 14426 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:54.458000 14400 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:54.473827 14444 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.481196 14156 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:54.481902 14451 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.494915 14302 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:54.490947 14271 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.485800 14453 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.463351 14390 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.501155  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.513455  8036 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.534121  8036 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:54.537950  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 295238us
I20260709 12:23:54.547149  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:54.647809  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 294779us
I20260709 12:23:54.498461  8139 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:54.664228  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 130200us
W20260709 12:23:54.669677  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 122661us
W20260709 12:23:54.539245  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 77423.2us
I20260709 12:23:54.499987 14217 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.501204 14462 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:54.512118 14431 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:54.520251 14442 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:54.527439 14271 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:54.502172 14375 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:54.527355 14302 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.616941 14446 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.543216 14465 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:54.707909  8139 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:54.699848  8137 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:54.667052 14293 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:54.630090 13917 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.630337 14321 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.632042 14110 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.709935  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.720561  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.721138  8137 raft_consensus.cc:2368] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:54.721393  8139 raft_consensus.cc:2410] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:23:54.722158  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.525802 14444 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.727039  8036 leader_election.cc:400] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:54.727523  8036 leader_election.cc:403] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:54.722548  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.502451 14356 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.708048  8109 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.515297 14452 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.722751  8137 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:54.495110 14443 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.736454  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.725104  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.737668  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.738359  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.696956 14463 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.539135 14453 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.697239 14431 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.718572  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:54.747570  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.717161 14293 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:54.725549 14455 log.cc:927] Time spent T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:23:54.717736 14296 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.748553  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.753664  8142 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.716611 14302 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.716804 14465 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.527307 14451 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.755514  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
W20260709 12:23:54.739341  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51312.3us
I20260709 12:23:54.710383 14375 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.740882 14461 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:54.744253 14217 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:54.761464 14468 consensus_queue.cc:1059] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:23:54.764933  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.753602 14293 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.792026 14480 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:54.767951 14452 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:54.793458 14240 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 12:23:54.793787 14452 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.793898 14240 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 20. Current term is 21.
I20260709 12:23:54.794281 14452 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.787801 14217 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.795955 14217 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:54.767145 14451 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.773185 14464 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:23:54.773307 14470 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:23:54.774174 14460 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:23:54.795392 14156 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:54.777691 14471 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:54.796437 14452 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.801326 14232 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:54.755488 14216 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.778105 14434 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.755146 14324 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:54.802671 14324 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:54.803587 14324 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.805342 14156 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:23:54.806834 14322 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.807377 14322 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.778395 14443 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.699990 14462 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:54.809993 14473 log.cc:927] Time spent T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:54.775847 14167 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.779060 14426 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:54.786747  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.811770 14426 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.811862  8756 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:23:54.811942  8141 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:54.813087  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.813234  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:54.800823 14361 consensus_meta.cc:287] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.002s
I20260709 12:23:54.813768 14322 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.813875 14361 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.814388  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.814590  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1191) took 2435 ms. Trace:
I20260709 12:23:54.789685  8139 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:23:54.766369 14356 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.816119  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.816640  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.733284 13917 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.749454 14463 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:54.788349 14379 consensus_meta.cc:287] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.006s
I20260709 12:23:54.801759 14232 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:54.814201  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.815541  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.785401  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.750211 14431 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.834980  8146 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:54.816296  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.814924  8215 rpcz_store.cc:276] 0709 12:23:52.379479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.380050 (+   571us) service_pool.cc:224] Handling call
0709 12:23:54.322884 (+1942834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.323302 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.323329 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.323869 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.501092 (+177223us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:54.501133 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.501214 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.810965 (+309751us) raft_consensus.cc:1685] finished
0709 12:23:54.810989 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.814321 (+  3332us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54003a7d50. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8b8ad 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:54.814505 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10153,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6185,"spinlock_wait_cycles":4467369344,"thread_start_us":176830,"threads_started":1,"wal-append.queue_time_us":384254}
I20260709 12:23:54.800971  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:54.836927  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.837316  8765 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:54.733687 14110 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.755556 14382 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.828106  8142 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:54.808249 14302 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.757766 14296 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.755321 14465 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.781742 14375 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.826406 14322 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.837740  8146 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
W20260709 12:23:54.837864  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 99627.9us
I20260709 12:23:54.733472 14321 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.833268 14156 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:54.826848 14426 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:54.840016 14443 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:54.848814  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.850368  8141 raft_consensus.cc:2393] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:54.841413  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.851809  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.837545 14379 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.852882  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.860996  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.848246  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.840227 13862 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.862066  8139 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.835484 14480 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:54.860172 14461 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.865098  8140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2483) took 2173 ms. Trace:
I20260709 12:23:54.871802  8765 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:54.847111 14167 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:54.875097  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 193713us
I20260709 12:23:54.854137 14156 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.853682 14356 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:54.879912  8139 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:54.873001  8140 rpcz_store.cc:276] 0709 12:23:52.691904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.752164 (+ 60260us) service_pool.cc:224] Handling call
0709 12:23:52.752545 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:53.141477 (+388932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.141526 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:53.145783 (+  4257us) log.cc:844] Serialized 52 byte log entry
0709 12:23:53.597680 (+451897us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:53.597726 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.856898 (+1259172us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400311354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:54.856948 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.856993 (+    45us) raft_consensus.cc:1685] finished
0709 12:23:54.857005 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.864988 (+  7983us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38853,"raft.queue_time_us":37850,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7018,"spinlock_wait_cycles":462761856,"thread_start_us":451452,"threads_started":1,"wal-append.queue_time_us":896561}
I20260709 12:23:54.884764  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.857795 14380 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.881055 14461 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.888892  8143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2398) took 2615 ms. Trace:
I20260709 12:23:54.889302  8143 rpcz_store.cc:276] 0709 12:23:52.281065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.341101 (+ 60036us) service_pool.cc:224] Handling call
0709 12:23:52.375369 (+ 34268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.375721 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:52.386763 (+ 11042us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.338141 (+1951378us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b1800311ce0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a 00007f498ca96a2a
0709 12:23:54.530780 (+192639us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.629665 (+ 98885us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.629846 (+   181us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:54.629903 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.629984 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:54.888584 (+258600us) raft_consensus.cc:1685] finished
0709 12:23:54.888699 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.888831 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173061,"prepare.queue_time_us":11239,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2106,"raft.queue_time_us":1489,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":13881,"spinlock_wait_cycles":7932288,"thread_start_us":192369,"threads_started":1,"wal-append.queue_time_us":2407250}
I20260709 12:23:54.891522  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.868253 14452 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:54.892795 14452 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.893204 14452 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:54.893905 14379 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.875478 14480 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.900946 14356 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.903206 14356 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.904731 14456 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.904850 14302 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.905298 14456 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.907434 14456 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.908275 14361 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.822759 14442 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.872697 14451 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:54.873149 14390 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.847419 14232 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.873247 13862 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.877614  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.886514 14380 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.885984  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.873075 14443 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:54.927867  8142 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:23:54.929997  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.930490  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.932206  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.942761  8138 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:23:54.933168  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.943818  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.930518  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.930828  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.931370  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.944444  8138 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:54.936726  8731 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.937151  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.937645  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.952617  8069 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:54.953505  8760 raft_consensus.cc:2368] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22.
I20260709 12:23:54.931200  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.954280  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:54.934657  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48418.7us
I20260709 12:23:54.933709  8065 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:54.952430  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.937942  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.956169  8143 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.956506  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.958117  8762 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:54.935139  8140 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:54.959873  8138 raft_consensus.cc:2368] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18.
I20260709 12:23:54.972611  8763 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:54.972308  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.972695  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.974014  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:54.962512  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.973453  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:54.961268  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.975663  8186 leader_election.cc:400] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18.
I20260709 12:23:54.976114  8186 leader_election.cc:403] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:23:54.976073  8065 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:23:54.952972  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.960902  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.859037 14322 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:54.912559 14421 consensus_meta.cc:287] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:23:54.980973  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.982440  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.931543 14232 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.982909  8757 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:55.002149  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.923332 14192 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.984916 14425 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:55.006552 14425 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:55.006976 14425 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.982820 14302 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:55.009050 14302 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:55.009418 14472 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.009929 14472 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:54.921640 14110 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.919808 14390 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.927462 14156 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:54.993666  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:54.982637 14361 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:54.921407 14444 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.930932 13862 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:54.914160 13917 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.972446 14177 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:54.914523 14323 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.022356 14472 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.927276 14217 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.023124 14271 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.009446 14302 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.024150 14443 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.025372 14462 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:54.942024 14451 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:55.027096 14322 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:54.925571 14293 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:54.923988 14479 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:23:55.031401 14428 consensus_meta.cc:287] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.002s
I20260709 12:23:54.994227  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.067528  8069 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:55.068538  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.069305  8069 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:55.033324  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:54.986250 14487 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.043200 14375 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.048856 14323 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.036887 14361 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:55.050657 14217 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.072007  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.042165 14177 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:55.015339 14421 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.079669 14421 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.051643  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.072113 14361 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.081014  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.082093  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.052191  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.083863  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.083968 14271 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.052856  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.076323 14380 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.056274  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.042138 14452 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.093410  8062 raft_consensus.cc:2368] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:23:55.094041 14217 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:55.094467 14217 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.094559 14452 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.094856 14217 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.094050 14453 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.036099 14390 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.098649 14296 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.100322 14390 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.085059 14461 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.100747 14458 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:55.066646 14431 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.101297 14458 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:55.103946  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.063194  8143 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:55.070179  8065 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:55.050561  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.073722  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.105650  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.046802 14465 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.075542 14293 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.076759 14463 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.077304 14177 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.053469  8146 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:55.087632 14451 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.070993 14428 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.066143 14479 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.115513 14479 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:55.115850  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.116184 14428 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.116528  8143 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:55.117573  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.118680  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.109727  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.119406  8143 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:55.098685 14464 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:55.102259 14458 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.104521 14217 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.114166 14465 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.113009 14431 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.108899 14296 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:55.124454 14458 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:55.122813 14296 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.107831 14421 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:23:55.126751 14421 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:55.127156 14421 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:55.122442 14461 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:55.129105 14461 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:55.129976 14461 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.125147 14296 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:55.133385 14426 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.135607 14426 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.127985 14421 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.139859 14421 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.141369 14425 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.150974 14361 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.154011 14361 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.085209  8063 raft_consensus.cc:2368] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:55.106153  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.204764  8064 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:55.205986  8067 raft_consensus.cc:2368] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16.
I20260709 12:23:55.207329  8069 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:55.207765  8066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3460) took 2113 ms (client timeout 2441 ms). Trace:
I20260709 12:23:55.211735  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.214267  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.120682  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.107052  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.217859  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:55.229498  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.230221  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:55.230261  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:55.242591 14156 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.244884 14177 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.247011 14217 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.259294  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.303619  8139 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.263357  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:55.265522  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.267081  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.272323 14425 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.305974 14177 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.306587  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.306984  8065 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:55.307670  8137 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:55.153951 14479 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:55.273743  8061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3468) took 1600 ms (client timeout 2034 ms). Trace:
I20260709 12:23:55.275499 14465 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:55.325906  8061 rpcz_store.cc:269] 0709 12:23:53.674575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.675360 (+   785us) service_pool.cc:224] Handling call
0709 12:23:55.273252 (+1597892us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400346554. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:55.273462 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573941504}
I20260709 12:23:55.326854 14465 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.158689 14487 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18.
I20260709 12:23:55.282212  8764 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:55.286101 14390 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.331482 14390 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.334625 14390 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.287659 14426 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:55.301764  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 195531us
I20260709 12:23:55.302117 14468 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:55.310266  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.313833 14448 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:55.338721 14448 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.339111 14448 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.314980 14461 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.340140 14461 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.342751 14461 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:55.308992  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 95135.1us
I20260709 12:23:55.343850  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:55.345891  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.315366  8143 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:55.302922  8066 rpcz_store.cc:269] 0709 12:23:53.093890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.094043 (+   153us) service_pool.cc:224] Handling call
0709 12:23:55.207203 (+2113160us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54001f6b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:55.207515 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23666560}
I20260709 12:23:55.318946  8759 raft_consensus.cc:2368] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:23:55.323161  8137 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:55.324119  8146 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 16: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:55.324735  8138 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:23:55.309266  8065 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:55.275693 14443 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.335589 14426 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.354912  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.355648 14479 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.358263 14443 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.356132  8062 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.363520 14168 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:55.363863  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 54025.3us
I20260709 12:23:55.336874 14468 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:55.373628 14382 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.385630  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.387939 14217 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:55.398358 14465 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.400236  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.400710 14177 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.401903  8061 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:55.412642  8109 leader_election.cc:400] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:55.413451  8109 leader_election.cc:403] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.372712 14468 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.413965 14217 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.424463 14217 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.425498  8764 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:55.426455  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 936) took 3005 ms. Trace:
I20260709 12:23:55.428748  8764 rpcz_store.cc:276] 0709 12:23:52.420493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.420649 (+   156us) service_pool.cc:224] Handling call
0709 12:23:52.420903 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.061019 (+640116us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54006804a0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca03dc0 00007f498ca8e1c0 00007f498ca8f231 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c
0709 12:23:55.281484 (+2220465us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b58008705d0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498c9e80aa 00007f498ca6a447 00007f498ca82fe7 00007f498ca847de 00007f498ca8eb49 00007f498ca8f416 00007f498ca8bd8f 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4
0709 12:23:55.426020 (+144536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.426362 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5096640256}
I20260709 12:23:55.435714 14246 raft_consensus.cc:3055] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:55.427488 14443 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.428136 14434 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.436350 14246 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:55.456344  8143 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
I20260709 12:23:55.458828 14426 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:55.460564  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.460701 14434 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.462284  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1205) took 1863 ms. Trace:
I20260709 12:23:55.462713  8217 rpcz_store.cc:276] 0709 12:23:53.598517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.611631 (+ 13114us) service_pool.cc:224] Handling call
0709 12:23:53.612125 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.612419 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:23:54.201599 (+589180us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.411990 (+1210391us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800308200. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c23a
0709 12:23:55.461613 (+ 49623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.461692 (+    79us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:55.461790 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.461903 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.462093 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27217,"prepare.queue_time_us":864930,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2924,"raft.queue_time_us":43748,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":113,"spinlock_wait_cycles":5395712,"thread_start_us":885929,"threads_started":2,"wal-append.queue_time_us":488839}
I20260709 12:23:55.465721  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:55.466123 14290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:23:55.466306  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2293) took 1036 ms. Trace:
I20260709 12:23:55.466843  8218 rpcz_store.cc:276] 0709 12:23:54.429710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.429837 (+   127us) service_pool.cc:224] Handling call
0709 12:23:55.465910 (+1036073us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001699d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:55.466105 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633769856}
I20260709 12:23:55.469395 14434 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.469668  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.473203  8065 raft_consensus.cc:1240] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:55.474691  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.474865  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.475150  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.475907 14468 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.475941  8064 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
W20260709 12:23:55.477944  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.478529 14468 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.480831 14380 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.481604 14380 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:55.484736  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.487732 14246 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.489887 14246 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.494446  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.495839 14189 consensus_queue.cc:1059] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:55.498003 14434 raft_consensus.cc:3055] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:55.498471 14434 raft_consensus.cc:740] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:55.498842  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.499018  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.499240  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.500149  8219 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:55.501253  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.501397 14321 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.502034  8214 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:23:55.503310  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.504051  8220 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:55.505780  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.505873 14302 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.508306 14302 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.516721  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:55.462761 14439 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 1.364s	user 0.004s	sys 0.000s
I20260709 12:23:55.509150  8070 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:55.499687 14434 consensus_queue.cc:260] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:55.513818  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 101635us
I20260709 12:23:55.520146  8212 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:55.528992 14434 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.530836  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1202) took 2477 ms. Trace:
I20260709 12:23:55.533227 14424 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:55.531411  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.531388  8216 rpcz_store.cc:276] 0709 12:23:53.053379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.091734 (+ 38355us) service_pool.cc:224] Handling call
0709 12:23:53.092102 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.092470 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.092497 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.092939 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:23:53.529977 (+437038us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:53.530024 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.530102 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.461802 (+1931700us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:55.530213 (+ 68411us) raft_consensus.cc:1685] finished
0709 12:23:55.530244 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.530593 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6057,"spinlock_wait_cycles":8426240,"thread_start_us":436763,"threads_started":1,"wal-append.queue_time_us":920228}
I20260709 12:23:55.539031  8144 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:55.540740  8756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49958 (request call id 935) took 3120 ms (client timeout 2196 ms). Trace:
I20260709 12:23:55.539155  8758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 942) took 1871 ms. Trace:
I20260709 12:23:55.560938  8062 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:55.543411  8758 rpcz_store.cc:276] 0709 12:23:53.667512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.679106 (+ 11594us) service_pool.cc:224] Handling call
0709 12:23:53.679533 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.113799 (+434266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.113871 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:54.113944 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:54.114003 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.538508 (+1424505us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54005f0354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:55.538598 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.538898 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10174,"spinlock_wait_cycles":997612288}
I20260709 12:23:55.565867 14462 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.566586 14462 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.571416 14382 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.571265  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.572423  8138 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
W20260709 12:23:55.571305 14450 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 1.348s	user 0.002s	sys 0.001s
I20260709 12:23:55.575829  8067 raft_consensus.cc:1240] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:55.576918  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3464) took 2457 ms. Trace:
I20260709 12:23:55.577416  8068 rpcz_store.cc:276] 0709 12:23:53.119504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.122168 (+  2664us) service_pool.cc:224] Handling call
0709 12:23:53.122476 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.122779 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.122807 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.123313 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.045638 (+922325us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:54.045696 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.045802 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.570293 (+1524491us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:23:55.576072 (+  5779us) raft_consensus.cc:1685] finished
0709 12:23:55.576106 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.576653 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60657,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"spinlock_wait_cycles":13735168,"thread_start_us":882497,"threads_started":1,"wal-append.queue_time_us":1051723}
W20260709 12:23:55.541322  8756 rpcz_store.cc:269] 0709 12:23:52.420211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.420341 (+   130us) service_pool.cc:224] Handling call
0709 12:23:55.540270 (+3119929us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b5400609354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:55.540483 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5359959424}
I20260709 12:23:55.573736 14448 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.536613 14156 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.596719  8139 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:55.597963  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66729.2us
I20260709 12:23:55.592167 14424 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.608886  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.619557  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.621464  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.617010  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:55.620013  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.623450  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:55.624280  8139 raft_consensus.cc:2393] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:55.625994  8067 raft_consensus.cc:2393] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:55.623164 14462 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:55.595124 14177 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:23:55.624415  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.630942  8138 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.628753  8034 leader_election.cc:400] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19.
I20260709 12:23:55.623679 14382 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:55.642987 14380 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.644186  8036 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:54.101311  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.646664 14375 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.650446  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.657091  8145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 1159) took 1424 ms. Trace:
I20260709 12:23:55.659260  8065 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:55.661347  8219 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:55.636569  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.665709  8145 rpcz_store.cc:276] 0709 12:23:54.233021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.238660 (+  5639us) service_pool.cc:224] Handling call
0709 12:23:54.239014 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.324951 (+ 85937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.656649 (+1331698us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54002f0b54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:23:55.656884 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196128128}
I20260709 12:23:55.671298  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.673167  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:55.674307  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67170.9us
I20260709 12:23:55.676995 14475 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:55.677488 14475 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.677867 14475 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:55.687322 14296 consensus_meta.cc:287] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.020s
W20260709 12:23:55.689244  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 60715us
I20260709 12:23:55.693531  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.694832  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.694963  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.695638  8214 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:55.696131  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.696306  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:55.696502  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.696856  8211 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 14.
I20260709 12:23:55.697197  8220 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:55.697846  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.698004  8070 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:23:55.698450  8215 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:23:55.661837 14382 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.705554  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.707371  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.708273  8211 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:55.709411  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92989.6us
I20260709 12:23:55.692317  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.717479  8218 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:55.727865  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.727840  8220 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:23:55.688079 14296 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.634272 14424 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.710179 14382 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:55.735483 13979 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:55.740957  8217 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:55.736025  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 117975us
I20260709 12:23:55.742185  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.744709  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.746541  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.748190  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.749835  8109 leader_election.cc:400] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:23:55.750149  8109 leader_election.cc:403] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:55.751497 14301 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:55.751933 14301 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.752334 14301 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:55.752861 14480 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.754554  8066 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:55.755537 14486 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:55.760277  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.767621  8138 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:55.771989  8211 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 13.
W20260709 12:23:55.747778 14240 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.032s
I20260709 12:23:55.778277  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.778393  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.779381  8066 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:55.781751 13979 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.782459 13979 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:55.779536 14421 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.639s	user 0.017s	sys 0.000s
I20260709 12:23:55.785946  8036 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:55.793522  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.794147  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59358.2us
W20260709 12:23:55.775342 14240 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.033s
I20260709 12:23:55.797873  8036 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:55.771957 14486 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:55.788044 14448 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:55.796790  8035 connection.cc:256] RPC call timeout handler was delayed by -2.088840443999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 12:23:55.795686 14246 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:23:55.808926  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.811067  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.797142 13979 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.814445  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.812242  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.819648  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.820838  8218 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.821072  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.821590  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.822248  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:55.822379  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.821048  8066 raft_consensus.cc:2393] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:55.820984  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.816370  8063 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
W20260709 12:23:55.828737  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 136531us
I20260709 12:23:55.813683 14177 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:55.830371  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:55.831235  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 72781.5us
W20260709 12:23:55.823885 14492 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.776s	user 0.002s	sys 0.000s
W20260709 12:23:55.834697  8035 connection.cc:256] RPC call timeout handler was delayed by -1.5673329569995076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:23:55.836395  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:55.837936  8035 connection.cc:256] RPC call timeout handler was delayed by -1.538532956999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:23:55.838443  8035 connection.cc:256] RPC call timeout handler was delayed by -1.48543295699983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 12:23:55.838924  8035 connection.cc:256] RPC call timeout handler was delayed by -1.4566329569997833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 12:23:55.839268  8035 connection.cc:256] RPC call timeout handler was delayed by -1.2836209519996373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 12:23:55.825256 14168 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:55.832310 14464 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:55.843237  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.844164  8062 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:55.847232  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.845314  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.877149  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:55.865569 14168 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:55.879892 14168 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.880930  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.881187 14486 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.882272  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.882918  8216 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:55.883894  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.888882 14296 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.896916  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.897089  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.898128 14426 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:55.898677  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.898804 14426 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:55.899451  8217 raft_consensus.cc:2368] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:55.900149 14426 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:55.902218  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88935.9us
I20260709 12:23:55.900346  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:55.909734  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67094.3us
I20260709 12:23:55.917073  8756 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:55.917454  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.832775 14217 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.920470  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:55.960992  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.921195  8217 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:55.922679 14301 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:55.961783  8216 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:55.962033 14217 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.962503  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.962692  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:55.962970  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 116975us
I20260709 12:23:55.963299  8217 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:55.963487 14301 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:55.923702  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.963847  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.917918  8068 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 11.
W20260709 12:23:55.964737  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.965040  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.926061  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.929600  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.933640  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.964310  8211 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:55.935079  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:55.955541 14424 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:55.957050  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.843180 14177 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:55.968614  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:55.959281 14475 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:55.966557  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.964172  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:55.982101 14301 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:55.994076  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.000042  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:56.011703  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:56.017509  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73179.4us
I20260709 12:23:56.017236 14301 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.019011  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:56.020814  8218 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:23:56.021332 14480 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:56.022877  8138 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:56.023267  8218 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:55.997458 14465 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:56.024508  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.017545  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.011339  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:56.035904  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:55.991358 14464 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:56.020462  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.037638  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.044349  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:56.040940  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.046851  8756 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:56.047883  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:56.043747  8142 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:56.048763  8211 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:56.049072  8219 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:56.045769  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:56.033473 14301 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:56.054930  8141 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:56.042620 14380 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:56.047587 13979 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:55.996212 14382 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:56.055449  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 212163us
I20260709 12:23:56.061884  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.062331  8146 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:56.062690  8144 raft_consensus.cc:2410] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:56.062443  8036 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.059695  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.058777  8759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49964 (request call id 1202) took 1125 ms. Trace:
I20260709 12:23:56.064862 14464 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.063316  8759 rpcz_store.cc:276] 0709 12:23:54.929301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.931912 (+  2611us) service_pool.cc:224] Handling call
0709 12:23:56.051821 (+1119909us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54005f1c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:56.054955 (+  3134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863581440}
I20260709 12:23:56.045342 14434 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 12:23:56.072752  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.076030  8219 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:56.067183 14375 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:56.079581  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59221us
I20260709 12:23:56.086323  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:56.087183  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 220087us
I20260709 12:23:56.089828  8217 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:23:56.075201 13979 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:56.097244 14168 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:56.155602  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.168789 14177 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:56.173133  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 71416.3us
I20260709 12:23:56.174104  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.174317 14376 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:56.175094 14376 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.176322  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.191063 14426 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:56.191156  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:56.192013  8146 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:56.196827 14302 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:56.198580 14168 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:56.199561 14168 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.199993  8146 raft_consensus.cc:2468] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:23:56.203130  8035 leader_election.cc:400] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 14. Current term is 15.
I20260709 12:23:56.205087 14426 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:56.205731 14426 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:56.178346 14475 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:56.207398 14382 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:56.208925 14510 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:23:56.210458 14376 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:56.216854 14302 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:56.218590 14302 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:56.219408 14302 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:56.220646 14302 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.222353 14302 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:56.206964 14426 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.227025  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.238220 14486 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:56.256390  8146 raft_consensus.cc:1240] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:56.261113  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 243673us
W20260709 12:23:56.262542  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 184881us
W20260709 12:23:56.260035  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 203335us
I20260709 12:23:56.274601  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.278153  8109 leader_election.cc:400] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22.
I20260709 12:23:56.296407  8144 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:56.288306  8146 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
W20260709 12:23:56.303349  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 205235us
I20260709 12:23:56.305711  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.306411  8139 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:56.282547 14448 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:56.317735  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44397.7us
I20260709 12:23:56.314723  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:23:56.322983  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51637.3us
I20260709 12:23:56.323894  8137 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:56.328096  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.336292  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.310840 14486 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:56.337320 14475 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:56.342077 14475 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:23:56.342257  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 93355.8us
I20260709 12:23:56.342429 14475 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:56.344779 14520 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:56.345834 14524 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.346414 14524 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:56.346628  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 261674us
W20260709 12:23:56.351646  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 124790us
I20260709 12:23:56.351594 14475 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.354310 14475 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:56.354379  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.357275  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.329582 14465 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:56.364848  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.348567 14524 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:56.377652  8146 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:56.381599  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:56.331769 14448 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.366366 14486 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.365727 14462 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:56.390311  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.394510  8137 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
W20260709 12:23:56.403766  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 77581us
W20260709 12:23:56.410498  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56307.1us
I20260709 12:23:56.416929  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:56.417790  8139 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:56.423379  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 119085us
I20260709 12:23:56.426360 14462 consensus_queue.cc:1059] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:56.427338 14527 raft_consensus.cc:3055] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:56.427198 14316 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:56.427893 14527 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:56.434662  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.435467  8062 raft_consensus.cc:2393] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:56.427872  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.438776  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.438930  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.439469  8063 raft_consensus.cc:3060] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:56.442543  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.443094  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.445223 14511 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.004s
I20260709 12:23:56.446933  8186 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:56.448342 14514 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:23:56.448544 14525 raft_consensus.cc:2804] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:56.449400 14525 raft_consensus.cc:697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:56.449607 14462 consensus_queue.cc:1059] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:56.450695 14462 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:56.451140 14462 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:56.448241  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.453742  8139 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:23:56.459735 14518 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:23:56.470535  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50616.7us
I20260709 12:23:56.471940  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.476766  8138 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:23:56.480357 14422 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.480913 14422 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.482008  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.483083 14422 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:56.483299 14487 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:56.483695 14380 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:56.483949 14448 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:56.484143 14380 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.484872 14380 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:56.488947 14233 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:56.450778 14525 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.492901 14527 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.498579 14527 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:56.501085  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 75777us
W20260709 12:23:56.505414 14513 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260709 12:23:56.507536 14517 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:23:56.508121  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:56.508685  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:56.510058  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 91233.2us
W20260709 12:23:56.512177  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 99898.9us
I20260709 12:23:56.512264  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.459792  8063 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:56.514151  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:56.484762 14487 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:56.516928  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.519398 14487 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.519906 14487 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.520311 14462 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.521999 14462 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.525033 14422 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:56.525843  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.526609  8062 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:56.511427  8069 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:56.528746 14233 consensus_queue.cc:1059] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:56.531203 14233 raft_consensus.cc:3055] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:56.531641 14233 raft_consensus.cc:740] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:23:56.533201  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61358.7us
I20260709 12:23:56.534057  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.534966 14520 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:56.535586 14520 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:56.536140 14520 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:56.536849 13979 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:56.541566  8062 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:56.544970 14156 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:56.545199  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 117411us
I20260709 12:23:56.547232  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.548609 14156 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:56.553395 14156 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:56.561872  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.562229  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:56.562827  8069 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:56.562978  8065 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:56.576459 14376 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.577064 14376 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.581759 14376 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:56.587203  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:56.588234 14375 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:56.588752 14375 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:56.589182 14375 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.592782  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:56.593894  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.594125  8220 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:56.594779 14448 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:56.595029  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.595274 14448 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:56.596050 14448 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.597654  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:56.598675  8220 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:56.600262  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 88573.8us
I20260709 12:23:56.601377  8731 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:56.602180  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.606693 14367 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:56.607307 14520 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.618960  8063 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:23:56.624785  8069 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:56.625298  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.635511  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:56.628361  8756 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:23:56.630733  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.608901 14367 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:56.623741 14480 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:56.641160  8144 raft_consensus.cc:2410] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 12:23:56.651139  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56258.6us
I20260709 12:23:56.648181  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:56.653568  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:56.653507  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:56.654542  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45232us
I20260709 12:23:56.659011 14367 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.662003  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.662787  8761 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:56.663787  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.662321 14301 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:56.665311  8763 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:56.665570 14301 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.666967  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.671253  8063 raft_consensus.cc:3060] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:56.675616  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.676574 14533 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:56.676982 14302 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.677183 14301 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:56.677177 14533 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.679177  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.680022 14302 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.681357  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.684417  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:56.687227  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.587209 14487 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.674748 14426 raft_consensus.cc:2764] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:23:56.701617  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:56.680047 14533 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:56.708360  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.745368  8763 raft_consensus.cc:2368] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22.
I20260709 12:23:56.745976  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:56.623929 14233 consensus_queue.cc:260] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:56.746603  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65361us
I20260709 12:23:56.747566  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.745561  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:56.750299  8764 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 21: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
W20260709 12:23:56.766484  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60912.5us
I20260709 12:23:56.675189 14422 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:23:56.770495  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 86196us
W20260709 12:23:56.774446  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.702908 14301 raft_consensus.cc:2764] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:23:56.794886 14520 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:56.797689  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:56.799597 14532 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:23:56.801380  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 97370.2us
I20260709 12:23:56.802470  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.804090  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.745626 14168 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:23:56.805958  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:23:56.807201  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59751.1us
I20260709 12:23:56.825052  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:56.818022  8765 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:23:56.705359 14240 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:23:56.854202  8109 leader_election.cc:400] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16.
I20260709 12:23:56.854856  8109 leader_election.cc:403] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:23:56.859686 14512 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:56.860213 14512 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.860572 14512 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:56.865381  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61369.8us
I20260709 12:23:56.866578  8138 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:56.867581 14480 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:56.868321 14480 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:56.868086 14524 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:56.868892  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.868995  8144 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:56.869829  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:56.871280  8140 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:56.872170 14301 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.872746 14233 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:56.753558 14380 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:56.890038  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44853.8us
I20260709 12:23:56.823185 14426 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:56.893481  8138 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:23:56.889231 14301 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:56.896235  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.899878 14301 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:56.893873  8138 pending_rounds.cc:85] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 12
I20260709 12:23:56.899914  8035 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:56.900833  8138 pending_rounds.cc:107] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:23:56.900023 14168 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:56.910327  8138 raft_consensus.cc:2889] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.821179 14375 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:56.918422  8063 raft_consensus.cc:2468] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:23:56.900364 14465 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:23:56.920001  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 278144us
I20260709 12:23:56.902794 14464 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:56.927299  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:56.915795 14168 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.919628 14302 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:56.915696 14382 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16.
I20260709 12:23:56.902566 14524 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:23:56.957283  8064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.090s	sys 0.106s
I20260709 12:23:56.964843 14446 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:56.970031  8064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.090s	sys 0.107s
I20260709 12:23:56.964182 14168 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.977991 14302 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:56.987355 14520 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:57.004710  8109 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.005965  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:57.006541  8139 raft_consensus.cc:3060] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.977608 14240 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:23:57.011101  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:56.973860 14512 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.014806 14422 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:57.017827 14535 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:23:57.027432 14302 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.033572 14512 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:57.038527 14375 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:57.041373 14301 raft_consensus.cc:2804] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:57.042079 14301 raft_consensus.cc:697] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.043087 14301 consensus_queue.cc:237] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.044785  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:57.045257 14380 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:56.993845 14487 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:57.049794  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.055946 14531 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:57.056517 14531 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:57.050011  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:57.065246  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 246256us
I20260709 12:23:57.066241  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:57.073009  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 58663us
I20260709 12:23:57.073889  8757 raft_consensus.cc:2468] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 15.
I20260709 12:23:57.077071  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:57.075491  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.057480 14531 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.109537 14382 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:57.110061 14382 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:57.110452 14382 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:57.110626  8143 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:23:57.112339 14542 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:57.094596 14487 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:57.093694 13979 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:57.119670  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.140208  8139 raft_consensus.cc:2468] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:57.145305  8186 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:57.158787  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231573us
I20260709 12:23:57.092077 14422 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:57.169227  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 93886.6us
I20260709 12:23:57.122265 14487 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:57.171303 14487 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:57.177588  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.170289  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.136186 14553 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:23:57.198347  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 78769.4us
W20260709 12:23:57.199268  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54065.3us
W20260709 12:23:57.204488  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.202807 14486 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:57.212862 14543 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.213476 14543 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.214401 14422 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.215696 14543 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:57.218044 14487 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.146621 14527 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:23:57.222868  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.223224  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.232053  8062 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:57.235908  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:57.239800  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62398.2us
I20260709 12:23:57.200915 14542 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:57.258538  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.170073 13979 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:57.262064  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 112278us
I20260709 12:23:57.268668  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:57.270548  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.273931  8063 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:23:57.271896  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.274504  8064 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:57.241117 14547 raft_consensus.cc:2804] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:23:57.278587  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 118804us
I20260709 12:23:57.179889  7960 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 18, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 18 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.281497  8062 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:23:57.282261 14448 consensus_meta.cc:287] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.000s
I20260709 12:23:57.288873 14448 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.289600 14557 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:57.292557  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:57.276257 14554 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:23:57.295060  8109 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.302937  8068 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:57.303361  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.273216 14233 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:57.304903  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.307756  8220 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:57.309260  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:57.310472  8070 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.312435  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.313114  8063 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:57.314376  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:57.314606 14301 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:57.314666 14448 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:57.315227 14533 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:57.315340 14301 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.317813 14233 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.314896  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:57.321300  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.327325  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:57.335016  8212 raft_consensus.cc:1240] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:57.336238  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:57.340168  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:57.342425  8729 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.801s (SENT)
W20260709 12:23:57.345027  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49426.2us
I20260709 12:23:57.351066  8068 raft_consensus.cc:3055] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:57.351496  8068 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:57.330758 14557 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.357934  8763 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:57.330508 14380 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:57.357214  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.363759  8061 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:57.365124  8109 leader_election.cc:400] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:23:57.372191  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.373768  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.376772  8109 leader_election.cc:400] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22.
I20260709 12:23:57.349176 14548 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:57.326419 14168 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.352252  8068 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.378922  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:57.393141  8035 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.397886  8068 raft_consensus.cc:3060] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:57.341507 14521 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:23:57.399793  8063 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:23:57.382263 14524 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:57.404407  8069 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:57.357950 14382 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.341670 14301 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.411795  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:57.368108 14380 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.407042  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:57.408245  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.391476 14520 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:57.408882 14533 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:57.416087  8061 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:57.401638 14565 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:57.404884 14547 raft_consensus.cc:697] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:57.429883  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.428225 14553 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.444095 14486 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:57.428272 14565 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:57.455770  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:57.464504 14558 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:23:57.465227  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 72214.1us
I20260709 12:23:57.431031 14533 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:57.471060  8070 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:23:57.451136 14560 raft_consensus.cc:2804] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:57.441759 14557 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.542263 14569 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:57.543349 14567 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:23:57.461122 14565 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:57.544445 14525 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:57.545492 14566 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:23:57.548234 14546 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.398s	user 0.002s	sys 0.000s
W20260709 12:23:57.553134 14550 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.350s	user 0.003s	sys 0.000s
I20260709 12:23:57.552891 14547 consensus_queue.cc:237] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.554680 14206 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:57.450815 14577 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.588804  8070 raft_consensus.cc:1240] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:57.598827 14533 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:57.604423  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 197469us
I20260709 12:23:57.581557 13979 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:57.595340 14525 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.594329 14560 raft_consensus.cc:697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.628940  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:57.632494  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 202679us
I20260709 12:23:57.631831 14168 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:57.635305 14525 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:57.637436  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.638134  8063 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:57.604313 14206 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.643265  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.653199  8063 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:57.645828  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.607491 14577 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.633687 14422 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:57.716362 14576 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:57.643500 14382 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:57.701249  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.686745 14560 consensus_queue.cc:237] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.592381 14553 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.712936  8067 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 21.
I20260709 12:23:57.767813  8063 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:57.645529 14206 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:57.684949  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61746.3us
W20260709 12:23:57.773659  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 130513us
I20260709 12:23:57.762902  8140 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
W20260709 12:23:57.765903  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 89707.5us
I20260709 12:23:57.718129 14380 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:57.714025 14448 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:57.777002  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:57.780105  8068 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:23:57.781036  8068 pending_rounds.cc:85] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 11
I20260709 12:23:57.781529  8068 pending_rounds.cc:107] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:23:57.714807 14422 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.782049  8068 raft_consensus.cc:2889] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:57.782636 14380 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 12:23:57.791224 14571 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:23:57.801884 14380 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:57.802325 14380 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:57.803205 14380 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:57.806841  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.809405  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.810519 14577 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:57.811533  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.812291  8069 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:57.779434 14578 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:57.813159 14578 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.814060 14578 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:57.815289  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.800493  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.820266  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:23:57.820596  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.821261  8063 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:57.822029  8067 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:57.821273  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.824079  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.833444  8065 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:57.823937  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.822160  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.835098  8063 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:57.839110  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.839694  8069 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:57.843987  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.846563  8217 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:57.846679 14577 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:57.847154 14577 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:57.847211  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:57.848172 14577 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:57.849088  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:57.849346 14577 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:57.853091  8218 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:23:57.855908  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.857642  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.808071 14565 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:57.859318  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.874469  8764 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:57.791285 14233 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:57.823202 14581 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:57.876044  8140 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:57.836421 14422 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:57.901859  8142 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:57.880163  8070 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:57.884080  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:57.858605 14569 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:57.904074  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:57.841944 14525 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:57.898666  8036 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:57.904780  8065 raft_consensus.cc:1275] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:57.896888  8061 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:57.914779  8139 raft_consensus.cc:2393] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:57.926991  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 89617.6us
I20260709 12:23:57.933825  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:57.939518  8110 leader_election.cc:336] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.509s (SENT)
I20260709 12:23:57.940284  8110 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:57.943436  8146 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:57.932559  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:57.945106  8067 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:23:57.946045  8068 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:57.946341  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.907720 14562 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:57.890141 14301 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:23:57.927953 14486 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:57.961259  8069 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
W20260709 12:23:57.969201  8110 leader_election.cc:336] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.518s (SENT)
I20260709 12:23:57.973663 14563 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:57.976904 14290 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:57.979723  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:57.983736  8063 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:57.997241  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 64789.2us
I20260709 12:23:57.998806  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.009362  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.012059  8069 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:58.012820  8110 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.008383  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:58.012244  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 130890us
I20260709 12:23:58.009966  8070 raft_consensus.cc:2376] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22. Re-sending same reply.
I20260709 12:23:58.028105  8212 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:57.968818 14557 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:58.021673 14537 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:23:58.031270  8062 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:58.090685  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 73667.8us
I20260709 12:23:58.096144  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.009884 14486 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:58.009310 14563 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.023466 14573 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:58.102941  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 139914us
I20260709 12:23:57.960959 14581 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.106705  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.063262 14301 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.119516  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:58.120797  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 181980us
I20260709 12:23:58.107003 14486 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:58.130308  8139 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:58.136395  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.115559 14563 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:58.118683 14542 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.122124 14533 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:58.147423  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51368.5us
I20260709 12:23:58.157013  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:58.165745  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.138083 14597 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.187052  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.189154  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.205740  8218 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:58.208420  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.210026  8220 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:23:58.210282  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 241105us
I20260709 12:23:58.212944  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.213142 14464 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:58.214282  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.216054  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:58.216604  8110 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.528s (SENT)
W20260709 12:23:58.216084  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.220039  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.169314 14233 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:58.230381  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.231251  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.232203  8220 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:58.233652  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.216923  8213 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:58.234381  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.236431  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:58.240160  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45924.1us
I20260709 12:23:58.240429  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.243062  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.247231  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.243795  8212 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:23:58.152902 14533 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.225698 14316 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:58.256686  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.257233  8065 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:23:58.257714  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.258591  8220 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:58.259709  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.262297  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:23:58.266163 14590 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:23:58.267366 14592 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:23:58.268545 14585 log.cc:927] Time spent T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:23:58.269474  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.270407  8212 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:23:58.272070 14594 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:58.191943 14597 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.277631 14581 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.278467 14533 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.261688 14548 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.189613 14446 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:23:58.284168 14548 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.284560  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.286087  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.286433  8211 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:58.246560 14578 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:58.261042  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.288100  8220 raft_consensus.cc:2368] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 12. Current term is 13.
I20260709 12:23:58.286809 14548 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.287788  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.293813  8061 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:58.293922  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:58.281493 14587 log.cc:927] Time spent T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:23:58.291257  8218 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:58.240761 14542 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.292093  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.315384  8065 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
W20260709 12:23:58.300148  8729 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.850s (SENT)
I20260709 12:23:58.301820  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.316222  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.316737  8068 raft_consensus.cc:2376] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22. Re-sending same reply.
I20260709 12:23:58.318508  8220 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:58.319334  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.255154 14316 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:58.322487  8140 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:23:58.323534  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.328523  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:58.324582  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.325299  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:58.331247  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114692us
W20260709 12:23:58.332191  8110 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.585s (SENT)
I20260709 12:23:58.332743  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.337328  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.338241  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.340739  8218 raft_consensus.cc:2368] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 20.
I20260709 12:23:58.339708  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.341717  8220 raft_consensus.cc:2393] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:58.344945  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.346302  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.347424  8068 raft_consensus.cc:2393] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:23:58.348748 14568 log.cc:927] Time spent T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:58.348816 14599 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:58.349923 14598 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:23:58.349749 14599 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.350581 14578 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:58.365911  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65816.3us
I20260709 12:23:58.368081  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.370136  8216 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:23:58.366130  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 132945us
W20260709 12:23:58.372910  8110 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.605s (SENT)
I20260709 12:23:58.373456  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.379935 14599 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.381349  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.382262  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.318169 14542 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.385514 14578 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:58.383050 14316 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.414146 14316 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:58.415151  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.416579  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.417098 14531 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.417620  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.418264  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:58.419755  8217 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:23:58.420174  8217 pending_rounds.cc:85] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:23:58.420414  8217 pending_rounds.cc:107] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:23:58.420295  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.420786  8217 raft_consensus.cc:2889] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.422199  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.436880  8758 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:58.438205 14543 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:58.438479 14522 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:58.438760 14543 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:58.439131 14522 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.439780 14543 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.443696  8144 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:23:58.444746  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:58.440768 14380 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.441221  8140 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:58.442579  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.447316  8218 raft_consensus.cc:1240] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:58.449460  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:58.452824  8069 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:58.342337 14563 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.453096  8068 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:23:58.452517  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 79645.5us
I20260709 12:23:58.447950  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.456156  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:58.457126  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.463861  8217 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:58.464572  8759 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 18: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:23:58.458621  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.459065  8063 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:58.465229  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.459311  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.453784 14301 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:23:58.455881  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.467411  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:58.443363 14422 consensus_meta.cc:287] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.002s
I20260709 12:23:58.469636  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.469846  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:58.463801  8110 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.625s (SENT)
W20260709 12:23:58.473048  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60899.1us
I20260709 12:23:58.478286  8220 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:58.479751  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.485438  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:58.490021  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.490985  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.494549  8217 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:23:58.495898  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:58.496147  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.498828  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:58.500098  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 124573us
I20260709 12:23:58.500334  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.501274  8220 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:58.501101  8063 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:58.501893  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.504832  8218 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:58.507062  8070 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:58.507781  8212 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:58.515763  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.523540 14487 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.504686 14527 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.530115  8070 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:58.533283  8220 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:58.524892 14525 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.490423 14422 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.536677  8215 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:58.538259  8217 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:23:58.506594 14522 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.504945 14465 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:23:58.542675  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:58.544978  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 81229us
I20260709 12:23:58.542366 14462 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:58.526561 14560 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:58.508258 14600 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:23:58.531500 14569 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:23:58.559732  8110 leader_election.cc:336] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.641s (SENT)
I20260709 12:23:58.567103  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.570758  8217 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:58.539153 14557 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:58.573318  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:58.565232  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:58.537658 14487 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:23:58.585350  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.590916  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.593122 14579 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:58.593662 14579 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:58.600733 14375 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:58.601397 14375 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.601999 14375 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:58.549816 14617 consensus_queue.cc:1059] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:23:58.609221 14617 raft_consensus.cc:3055] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:58.609405 14573 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:58.609786 14617 raft_consensus.cc:740] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:58.568531 14522 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:23:58.610140 14573 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:58.610913 14522 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:58.594530 14579 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.584097 14557 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.611296 14522 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:58.576660 14577 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:23:58.612396 14579 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:58.624972  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.573241 14301 consensus_queue.cc:1048] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:23:58.632239 14557 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.605993 14233 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:58.633070 14233 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:58.633163 14547 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:58.634297 14233 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:58.636417 14619 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:58.574057 14569 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.638053 14542 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:58.638688 14581 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:23:58.639258 14569 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.639528 14581 consensus_queue.cc:1243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:58.640098 14527 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.623780 14462 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:23:58.640735 14522 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:23:58.642992 14486 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 12:23:58.643386 14604 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:58.650254 14605 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:58.631764 14563 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.734688  7960 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 15 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:58.729491 14578 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:58.611104 14617 consensus_queue.cc:260] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.657333  8143 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:58.660491 14512 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:58.629665  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:58.744732  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 115165us
I20260709 12:23:58.669073  8064 raft_consensus.cc:2410] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:23:58.669574  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:58.746227  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76736.2us
I20260709 12:23:58.747395  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.672205  8216 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:58.748356  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.687217 14422 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.693773 14565 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.695315 14375 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:58.705524  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 74932.4us
I20260709 12:23:58.716946 14480 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:58.692380 14543 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:58.718343 14522 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:58.722467  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 157220us
W20260709 12:23:58.785370  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 217332us
I20260709 12:23:58.785619  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:58.662496 14597 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:58.751312  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:58.758077  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.765103  8070 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:23:58.773718 14602 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:58.774628 13979 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:58.776207  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:58.779558  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.611132 14573 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.802556 14480 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.838794  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34594 (request call id 1071) took 1038 ms. Trace:
I20260709 12:23:58.785104 14448 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.839273  8064 rpcz_store.cc:276] 0709 12:23:57.800281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.809106 (+  8825us) service_pool.cc:224] Handling call
0709 12:23:58.833420 (+1024314us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400348354. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:23:58.838670 (+  5250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974928640}
I20260709 12:23:58.806226 14375 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:58.791671 14525 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:58.810550  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:58.810963  8141 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:58.813266 14562 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.792122 14380 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:23:58.813721  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:58.814440  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 260731us
W20260709 12:23:58.815454  7965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 268) took 53959 ms (client timeout 15000 ms). Trace:
W20260709 12:23:58.871932  8110 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.712s (SENT)
I20260709 12:23:58.783823 14605 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.749893 14512 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:23:58.822157  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.834292 14533 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:58.832585  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74647.4us
I20260709 12:23:58.882997  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:58.836957  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 43708.2us
I20260709 12:23:58.834453  8139 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
W20260709 12:23:58.838297  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52270.6us
I20260709 12:23:58.766940 14520 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:58.788982 14316 consensus_queue.cc:1175] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d67d00ae45b444cbe343726df1760e8" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 11 } }
I20260709 12:23:58.761386 14531 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.762195 14527 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.845906  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:58.729790 14486 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.872550  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:58.870456  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.830513 14602 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:58.831032 14578 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:58.828915  8062 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:23:58.897154  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:23:58.897735  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.839543 14617 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:58.899422 14376 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.891074 14380 consensus_queue.cc:1243] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 92362bf8983f4a71a3511e987a2c6578 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:58.910822 14629 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:58.917191 14548 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:58.918360 14480 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:58.900198 14531 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:58.873588 14206 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:23:58.743553  7960 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 18 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:58.923465 14486 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:58.925941 14290 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:58.926113  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:58.927075 14627 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.928026  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:59.029206  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 101286us
I20260709 12:23:58.928125  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.893229 14465 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:58.928828 14433 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:58.936470  8184 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:23:59.034935  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98587.8us
W20260709 12:23:58.940928  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 55668.2us
W20260709 12:23:58.872249  7965 rpcz_store.cc:269] 0709 12:23:04.913320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.923120 (+  9800us) service_pool.cc:224] Handling call
0709 12:23:58.815169 (+53892049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:51.168641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:51.169513 (+   872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:51.169575 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:23:51.169591 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:51.170847 (+  1256us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:51.170963 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:51.171003 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:23:51.172269 (+  1266us) tablet.cc:701] Row locks acquired
0709 12:23:51.172341 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:23:51.172567 (+   226us) write_op.cc:270] Start()
0709 12:23:51.185268 (+ 12701us) write_op.cc:276] Timestamp: P: 1783599831172476 usec, L: 0
0709 12:23:51.185344 (+    76us) op_driver.cc:348] REPLICATION: starting
0709 12:23:51.186382 (+  1038us) log.cc:844] Serialized 4397 byte log entry
0709 12:23:51.908482 (+722100us) op_driver.cc:464] REPLICATION: finished
0709 12:23:52.107159 (+198677us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b1800031000. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:23:52.107577 (+   418us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b1800031000. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:23:52.107744 (+   167us) write_op.cc:301] APPLY: starting
0709 12:23:52.107844 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:52.186907 (+ 79063us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:52.186960 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:52.663383 (+476423us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:52.664245 (+   862us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:23:52.664399 (+   154us) write_op.cc:312] APPLY: finished
0709 12:23:52.696759 (+ 32360us) log.cc:844] Serialized 105 byte log entry
0709 12:23:52.726552 (+ 29793us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:52.739248 (+ 12696us) write_op.cc:454] Released schema lock
0709 12:23:52.754092 (+ 14844us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:52.878820 (+124728us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:52.882192 (+  3372us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1388646,"reported_tablets":50,"spinlock_wait_cycles":29312,"child_traces":[["op",{"apply.queue_time_us":53555,"apply.run_cpu_time_us":19533,"apply.run_wall_time_us":695076,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":100072,"prepare.run_cpu_time_us":21201,"prepare.run_wall_time_us":65723,"raft.queue_time_us":243619,"raft.run_cpu_time_us":18201,"raft.run_wall_time_us":58805,"replication_time_us":722944,"spinlock_wait_cycles":10066560,"thread_start_us":278879,"threads_started":4,"wal-append.queue_time_us":101831,"wal-append.run_cpu_time_us":45095,"wal-append.run_wall_time_us":2562906}]]}
I20260709 12:23:58.955462 14301 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:23:58.844043 14565 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:23:58.959220  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:58.849175 14448 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.960973  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.047657  8062 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:58.900738 14602 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:59.032282 14376 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:58.876359 14525 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.980394 14206 consensus_queue.cc:1243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:58.934162 14578 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:58.981501  7960 catalog_manager.cc:5697] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:59.027282  8141 raft_consensus.cc:2368] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:23:59.049543 14380 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:58.969522 14533 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.956907 14446 consensus_queue.cc:1059] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:23:58.944197  8064 raft_consensus.cc:1275] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 12:23:59.039319  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 111274us
I20260709 12:23:59.039872 14480 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:59.040052 14599 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:59.041715  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 131489us
I20260709 12:23:59.044014  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:59.073498  8069 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:59.073551  8110 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.769s (SENT)
I20260709 12:23:59.045120  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.046108  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.075210  8068 raft_consensus.cc:2393] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:23:59.047724  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 148724us
I20260709 12:23:59.047894  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:23:59.076289  8067 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:59.048528  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89435.7us
W20260709 12:23:58.971827  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.842317 14569 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:23:59.071444  8064 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:59.068238  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.078002  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.078522  8061 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:23:59.079337  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:23:59.079591  8110 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.775s (SENT)
I20260709 12:23:59.083237  8110 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.084314 14613 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:23:59.091531 14562 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:59.092299 14560 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:59.069262 14480 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.092727 14562 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.093029 14480 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:59.093324 14562 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.094199 14525 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.097685 14578 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.104609 14642 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:59.105465  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.104773  7960 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 14, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 14 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:59.106154 14548 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:59.106504 14643 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:59.106863  7960 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 15 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:59.108130 14574 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:59.108496 14512 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.109346 14574 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:59.110067 14512 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.110946 14574 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:59.070314 14533 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:59.084514  8110 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.839s (SENT)
I20260709 12:23:59.112841  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.113020 14520 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:59.113417 14520 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:23:59.113907 14533 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:23:59.114013  8110 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.864s (SENT)
I20260709 12:23:59.114559 14533 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.114280 14520 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.115105 14533 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.112867 14600 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:23:59.115814 14520 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.117682 14600 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.118039  8036 leader_election.cc:400] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:23:59.118408  8036 leader_election.cc:403] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.118561 14565 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:59.119017 14448 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.120049 14486 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.120609 14486 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.124960  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:59.125427  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:59.126103  8211 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:59.127099 14486 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:59.127692  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.121582  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:59.129055  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.129417  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.122740 14624 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:59.130089  8068 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:23:59.123099  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:59.132992  8219 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:59.123350  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:23:59.122437  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54293.7us
I20260709 12:23:59.129067  8137 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:23:59.134578  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:59.134714  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:59.135346  8215 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 14.
I20260709 12:23:59.136096  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.123231  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:59.137271  8216 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:59.138351 14540 consensus_queue.cc:1048] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:59.140726 14624 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:59.141229 14624 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:59.141660 14624 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:59.138370 14562 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.146010  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:23:59.148056  8110 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 1.583s (SENT)
I20260709 12:23:59.149115  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.149837 14578 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:59.144168  8069 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:59.118211 14600 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.145751  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:59.152036  8219 raft_consensus.cc:2376] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20. Re-sending same reply.
I20260709 12:23:59.142211 14533 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:59.153537 14600 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.155150  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:23:59.155593  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.155844  8069 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:23:59.156657 14486 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:23:59.149881  8067 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:59.160049  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:23:59.162922  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 128055us
I20260709 12:23:59.157357  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:23:59.157423  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.176777  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:59.177692  8109 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:59.184705  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.190562  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:59.194562  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:23:59.198329  8184 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:23:59.219475  8214 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:59.175868 14522 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:59.175838 14613 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:59.284785  8730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.144325 14602 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.184265 14578 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:59.188700 14301 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:59.191432 14605 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:59.293782  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 175892us
I20260709 12:23:59.200845 14557 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:59.196547 14617 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:59.294605  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 96359.6us
I20260709 12:23:59.294219  8211 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:23:59.309810  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:23:59.310611  8219 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 12: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:23:59.311153  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.306134  8140 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:23:59.316287  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 168257us
I20260709 12:23:59.190100 14565 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:23:59.317123  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:59.312620  8036 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:23:59.291731 14613 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.319123  8064 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:59.317818  8139 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:23:59.293655 14433 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:59.320482  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:23:59.326525  8110 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.034s (SENT)
W20260709 12:23:59.327812  8110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.131:41179 timed out after 2.201s (SENT) [suppressed 37 similar messages]
W20260709 12:23:59.331095 14648 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:23:59.296294 14578 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:59.361971  8110 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.303038 14522 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:59.368273  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:59.314174 14301 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:23:59.394834  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83794.2us
I20260709 12:23:59.205536  8061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:59.404937  8061 raft_consensus.cc:606] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:23:59.405320  8061 raft_consensus.cc:614] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:59.313875 14543 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:59.359807 14613 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:59.367761 14578 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:59.364913 14533 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.360795 14642 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:59.321877 14557 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:23:59.370735 14382 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:23:59.447409  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 85516.8us
I20260709 12:23:59.416221 14597 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:59.415282 14543 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.315722 14480 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.370514 14577 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:23:59.136675  7960 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.441371 14650 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.447180 14605 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.420879 14563 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:59.457816  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53927.3us
I20260709 12:23:59.460697  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.447710 14642 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.448437 14376 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:59.447395 14542 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.473076 14522 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.478613  8061 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:23:59.478184  8063 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:23:59.481087 14650 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.503273 14233 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:59.522135 14376 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:59.506920 14642 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:59.501143  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.457976 14382 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.461357 14543 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:59.488795 14605 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.452035 14533 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.499517  7960 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 17, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.498728  8110 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.501910 14557 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:59.493342 14645 log.cc:927] Time spent T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:23:59.500727 14301 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.487397 14572 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:59.566903 14613 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.567588 14572 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.568064 14572 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:59.567972  7960 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:59.518079  8140 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:59.523530  8213 raft_consensus.cc:2368] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:23:59.497669 14577 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:59.477996 14600 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.570145  7960 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 17, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 17 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:59.571429 14600 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.545420  8216 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:23:59.573243 14577 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:59.574723 14605 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:59.575538 14600 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:23:59.573082  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74450.9us
I20260709 12:23:59.524375 14233 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:23:59.586094  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.593982  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a31800511c940e48a418a30b32976fd"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:23:59.594666  8066 raft_consensus.cc:606] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.595089  8066 raft_consensus.cc:614] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:59.530612 14599 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:23:59.526527 14542 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.578213 14602 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.684499  8764 raft_consensus.cc:1240] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:59.685118  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99121.4us
I20260709 12:23:59.686219  8110 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.586489 13979 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.572036  7960 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 13 to 17, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:23:59.699156  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:23:59.699865  8763 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.701575  8757 raft_consensus.cc:1275] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:59.698271  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:23:59.737905  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51789us
I20260709 12:23:59.681273 14599 consensus_queue.cc:1243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:59.739153  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.678737 14527 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.680935 14565 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:59.700539 14637 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:23:59.697697 14577 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:59.684345 14653 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:23:59.681164 14605 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.672057 14624 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.743448 14633 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:59.747344 14233 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.753334  7960 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 16, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:23:59.760038 14382 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:59.761827 14650 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.762686 14577 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:59.763442  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:23:59.766084 14542 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.769673  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
W20260709 12:23:59.744995 14512 consensus_meta.cc:287] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.002s
I20260709 12:23:59.710950 14487 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.738909 14540 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:23:59.768136 14642 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:23:59.813751  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50435.3us
I20260709 12:23:59.821667  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.814469  8066 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:59.829118  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:59.833817  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.835108  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.789877 14613 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:59.840219  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.017s	sys 0.035s
W20260709 12:23:59.845506  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.017s	sys 0.035s
I20260709 12:23:59.849591  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.738195 13979 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.853010  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.853634  8764 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:59.855016  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.856846  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.858880 14533 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.805035 14653 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.806444 14605 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.862803 14653 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.863175 14605 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:23:59.817500 14233 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.865661 14543 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.867838 14543 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:23:59.869652  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:23:59.870836  8765 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
W20260709 12:23:59.872795 14657 log.cc:927] Time spent T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:59.875365 14624 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:23:59.884915  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:23:59.885710  8140 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:23:59.748412 14527 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.897954  8067 raft_consensus.cc:1240] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:59.818360 14382 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:59.823582 14480 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:23:59.897593 14637 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:59.909657  8216 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:59.907364  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:23:59.920616  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:23:59.917618  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:23:59.837006 14487 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.904829 14653 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.903604 14382 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:23:59.932832 14599 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:23:59.951046 14626 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:59.844981 14540 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.930970 14548 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:59.934654 14543 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:59.956421 14382 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:59.929101 14643 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:23:59.961570 14626 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:23:59.961742 14380 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:23:59.994990  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:23:59.937819 14572 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.007722  8763 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:24:00.011473  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.963153 14653 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:23:59.988770 14543 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:00.018914 14668 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:00.021857  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.022178 14642 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.027365 13979 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.005254 14380 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:23:59.933051  7960 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.034178  8761 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:00.033775  7960 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 16, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.041451 14487 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.038089  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:00.045423  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.048872  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.013141 14565 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:00.050061  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.051249  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:00.057322  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:00.061071  8066 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:00.062280 14579 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.062558 14527 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.062853 14579 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.044520 14626 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.065251 14579 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.066140 14376 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.067338 14376 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.035661  7960 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 8 to 16, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.055645 14487 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.069855  7960 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 18, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 18 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.069864 14487 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.075626 14487 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:00.075814  8757 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:00.078004  8145 raft_consensus.cc:1217] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Deduplicated request from leader. Original: 15.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:24:00.078657  8145 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:24:00.058454 14663 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:00.111557 14578 consensus_meta.cc:287] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.002s
I20260709 12:24:00.112088 14578 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.119926 14572 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.120867 14465 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.121505 14465 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.122959 14653 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.123816 14465 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.127097  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.127758  8215 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:00.103585 14673 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:00.138705  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.128258 14382 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.155607  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.156423  8763 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:00.147423  8215 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:24:00.146901 14579 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.159248  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:00.072124  7960 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.145328 14578 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:00.171938  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 88936.6us
I20260709 12:24:00.174144  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.162495 14376 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:00.176961  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:00.178504  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:00.178565  8141 raft_consensus.cc:3060] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.183079  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.186388  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.190079  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.191011  8140 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:24:00.191500  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:00.192122  8137 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:00.196880  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.197633  8763 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.183758 14487 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.224814 14487 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.227898 14487 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:00.230078 14678 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:00.180199 14574 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:00.196126  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.205348 14486 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.216292  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:00.216996  7960 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.188117 14531 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.170511 14579 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.194703 14520 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:00.195160 14376 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:00.247188  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.247557  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.248170  8211 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 21: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.248406  8216 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.249503  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.232952 14574 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.252328  8217 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.254249  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.237579 14448 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:00.255481  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.255929  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.239080 14465 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:00.256440  8211 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:00.256857  8217 raft_consensus.cc:2410] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:24:00.255029  8139 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
W20260709 12:24:00.257647  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69707.2us
I20260709 12:24:00.259800  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:00.258773  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.262535  8216 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.263039  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.264081 14682 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:00.264458 14376 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.266852 14382 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.268931 14638 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:00.240185 14486 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.269486 14638 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.269918 14638 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.271386 14486 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.272228  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:00.272866  8139 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:00.274003 14644 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.776s	user 0.001s	sys 0.005s
I20260709 12:24:00.275388  8142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2491) took 1466 ms. Trace:
I20260709 12:24:00.275754  8142 rpcz_store.cc:276] 0709 12:23:58.809294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.820809 (+ 11515us) service_pool.cc:224] Handling call
0709 12:23:58.821276 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.878391 (+ 57115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.878446 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.945869 (+ 67423us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.158563 (+212694us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:59.158621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.158713 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.273366 (+1114653us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:24:00.275065 (+  1699us) raft_consensus.cc:1685] finished
0709 12:24:00.275096 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.275322 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67699,"raft.queue_time_us":69511,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3758,"spinlock_wait_cycles":38119168,"thread_start_us":184575,"threads_started":1,"wal-append.queue_time_us":455264}
I20260709 12:24:00.280468  7960 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.282337  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.283247 14565 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:00.283732 14565 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.285519  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.285382  7960 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 20. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.283259  8069 raft_consensus.cc:2410] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:24:00.287370  7960 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 19, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 19 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:00.294531  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.294982  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.294870  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.300199 14579 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.297114  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.297224  8760 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:00.297426  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.298106  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:00.298246  8762 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:00.302320  8142 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:24:00.302500  8069 raft_consensus.cc:3060] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:00.298280  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.255542 14574 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.244664 14562 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:24:00.302722  8142 pending_rounds.cc:85] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 14
I20260709 12:24:00.308071  8142 pending_rounds.cc:107] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:24:00.308468  8142 raft_consensus.cc:2889] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.258562 14465 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.307267  8139 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:24:00.313759  8216 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:24:00.313783  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.314725  8211 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.314742  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.315594  8216 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:00.315766  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.316464  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.317236  8216 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.318308  8216 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:24:00.320614  8217 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:24:00.321177  8216 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:00.321995  8141 raft_consensus.cc:2468] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:00.311199 14465 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.330552  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:00.333484  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.338631  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.337524  8186 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:00.345976 14577 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.349058  8069 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:00.350966  8143 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:00.353543 14577 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.361043  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.347777 14560 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.361842  8143 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.362424  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.362792 14547 raft_consensus.cc:2804] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:00.373023  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.346932 14578 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.331840 14433 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:24:00.387687  8216 raft_consensus.cc:2368] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:24:00.369263  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.376808  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:00.388526  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:00.388792  8065 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:00.389523  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:00.390244  8061 raft_consensus.cc:2368] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:24:00.390596  8065 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:00.300277  7960 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.372589 14382 consensus_queue.cc:1048] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
W20260709 12:24:00.381857  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44492.7us
I20260709 12:24:00.382236  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.405301  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.368305  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.407197  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.407932  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.408593  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.409511  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:00.401175  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:00.372973  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:00.371774 14629 consensus_queue.cc:1059] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:00.387966  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:00.405139  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.418001  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.431288  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.437340  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:00.445029  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:00.445924  8065 raft_consensus.cc:606] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:00.446431  8065 raft_consensus.cc:614] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:00.404838 13979 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:00.465835  8144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 2490) took 1680 ms. Trace:
I20260709 12:24:00.398617 14579 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.474462  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49240 (request call id 3567) took 1335 ms. Trace:
I20260709 12:24:00.466478  8144 rpcz_store.cc:276] 0709 12:23:58.785473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.800815 (+ 15342us) service_pool.cc:224] Handling call
0709 12:23:58.801149 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.068584 (+267435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.068619 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:59.068682 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:59.068717 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.465506 (+1396789us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000442d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:00.465573 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.465755 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614570752}
I20260709 12:24:00.475055  8213 rpcz_store.cc:276] 0709 12:23:59.122818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.123126 (+   308us) service_pool.cc:224] Handling call
0709 12:24:00.458243 (+1335117us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540017c0d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:24:00.458448 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855745920}
I20260709 12:24:00.377497 14577 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.427543 14547 raft_consensus.cc:697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:00.447978 14426 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.451821 14557 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:00.443526 14682 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:00.468128 14629 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:00.398975 14560 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.477387 14233 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:00.495934  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:00.411693 14578 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.459709 14677 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:00.453545 14602 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:00.481685 14643 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:00.494131 14557 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:00.542347 14557 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.543628 14557 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:00.545236  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.547120  8036 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.548969  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.519968 14565 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.516598  8137 raft_consensus.cc:2468] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
W20260709 12:24:00.517230 14684 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:24:00.556816  8186 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:00.519289 14543 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:00.525115 14685 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:24:00.509456 14602 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.526113 14638 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.502657 14233 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.483381 14525 consensus_queue.cc:1059] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:24:00.533280 14626 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:00.535972 14560 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.536495 14643 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.612318 14597 raft_consensus.cc:2804] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:00.538668  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.507314  7960 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 14, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:00.540472 14547 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.544314  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.515437 14574 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.552373  8036 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.600664  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2337) took 2178 ms. Trace:
I20260709 12:24:00.482950 14579 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.501588 14426 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:00.670668  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 118366us
I20260709 12:24:00.671525  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.671993 14579 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.507826 14629 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:00.672012 14426 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.674104 14426 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:00.674316 14642 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:00.674825 14426 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:00.674232 14629 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.675366 14697 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:00.675400 14426 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.676227 14697 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.678071 14426 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.678558 14697 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.627722 14650 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:00.628494 14524 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.629125  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3528) took 1478 ms. Trace:
I20260709 12:24:00.584290 14649 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.535972 14380 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:00.621297 14602 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.655272 14560 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:00.657722  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 174300us
I20260709 12:24:00.630180 14233 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.624619  8140 raft_consensus.cc:1240] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 14. Current term is 15. Ops: []
W20260709 12:24:00.703719 14684 log.cc:927] Time spent T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:00.682062  8036 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.670233  8214 rpcz_store.cc:276] 0709 12:23:58.422334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.423114 (+   780us) service_pool.cc:224] Handling call
0709 12:23:58.423411 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.220011 (+796600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.556836 (+1336825us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54002251d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:00.600557 (+ 43721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776026880}
I20260709 12:24:00.601161 14465 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.659312 14543 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:00.702822  8064 rpcz_store.cc:276] 0709 12:23:59.151074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.151288 (+   214us) service_pool.cc:224] Handling call
0709 12:23:59.151625 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.319574 (+167949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.628847 (+1309273us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003237d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:00.629028 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381230848}
I20260709 12:24:00.713680  8061 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 18: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:00.668357 14597 raft_consensus.cc:697] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:00.717526  7960 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:00.715056  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 342186us
I20260709 12:24:00.735685  8109 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:00.737355  8109 leader_election.cc:400] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:24:00.737735  8109 leader_election.cc:403] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.688488 14426 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:00.741186 14382 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:00.742309 14465 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.742784 14382 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:24:00.745134 14565 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.714376 14524 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.749135 14597 consensus_queue.cc:237] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.751224 14524 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.712711 14650 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.755070 14650 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.760185  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2351) took 1607 ms. Trace:
I20260709 12:24:00.762219 14578 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.760848  8212 rpcz_store.cc:276] 0709 12:23:59.152381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.152497 (+   116us) service_pool.cc:224] Handling call
0709 12:23:59.152825 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.153167 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.153196 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.168846 (+1015650us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:24:00.169294 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.258683 (+ 89389us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:00.284913 (+ 26230us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.285148 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.285228 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.759670 (+474442us) raft_consensus.cc:1685] finished
0709 12:24:00.759847 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.760095 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11012,"prepare.queue_time_us":27751,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":19990,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":49061248,"thread_start_us":89009,"threads_started":1,"wal-append.queue_time_us":188616}
I20260709 12:24:00.763629 14638 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:00.730969 14543 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:24:00.771409  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 89428.4us
I20260709 12:24:00.720886  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.721062  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49244 (request call id 2349) took 1574 ms. Trace:
W20260709 12:24:00.776609 14690 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:24:00.775138  8220 rpcz_store.cc:276] 0709 12:23:59.146310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.149006 (+  2696us) service_pool.cc:224] Handling call
0709 12:23:59.149394 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.149814 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.149847 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.509506 (+1359659us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b2c00032118. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:24:00.516407 (+  6901us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.630709 (+114302us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:00.645313 (+ 14604us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.706905 (+ 61592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.706987 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.707041 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:00.720853 (+ 13812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.720999 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13689,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":6222,"raft.queue_time_us":12491,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":60368896,"thread_start_us":175197,"threads_started":2,"wal-append.queue_time_us":136400}
I20260709 12:24:00.722258  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.777417  7960 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 3 to 19. New cstate: current_term: 19 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.778277  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.778716  8762 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:00.779181  8145 raft_consensus.cc:2393] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 21: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:00.779974  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.780686  8758 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.722566  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.726547  8067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:00.782485  8067 raft_consensus.cc:606] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.779448  7960 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:00.783664  7960 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:00.786703  7960 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.784736  8067 raft_consensus.cc:614] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:00.723477 14560 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.790792 14560 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.792098  8067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:00.792606  8036 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.792860  8067 raft_consensus.cc:606] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.793493  8067 raft_consensus.cc:614] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:00.793977 14426 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:00.794265 14486 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.794838 14486 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.795349 14426 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:00.797891 14574 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.797737 14543 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.772898 14577 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:00.799734 14577 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.800153  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:00.800679 14699 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:00.802500  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:00.785043  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:00.790652  7960 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 16, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.805245  8761 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.806102  7960 catalog_manager.cc:5697] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 17, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 17 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.808432  7960 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 13 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 15 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:00.800163 14577 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.811983  7960 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 7 to 14, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 14 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.818025  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:00.818394 14548 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.818764  8765 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.818964 14548 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.820103  7960 catalog_manager.cc:5697] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 6 to 11, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 11 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:00.821820 14540 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.823173  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.824955  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:00.825366 14548 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.826323  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:00.827669  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 106871us
I20260709 12:24:00.829774  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.831311  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.821985 13979 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:00.833406  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:00.833673 14465 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:00.834263 14643 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.835427 14638 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:00.836035 14524 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:00.836462 14548 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:00.836689 14486 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:00.838258  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.947198  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.844590  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.846240  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.949630  8140 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:00.950171 14602 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.848745  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:00.850309  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.850231  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.934638 14527 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:00.961732 14527 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.967669  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:00.851931  8761 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:00.857692  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:00.858956  8757 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:24:00.865054 14649 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.869000 14701 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:00.870016  8068 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:00.872961 14605 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.873548 14380 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:00.986249 14380 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.986405 14701 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.873987 14540 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.875547  8765 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:00.988796 14605 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.991338 14605 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:00.904083  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71445.7us
I20260709 12:24:00.964274 14527 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:00.988940 14540 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:00.994674  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:00.984362  8145 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:24:01.008746  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.021517  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.024679  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.028474  8218 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:24:01.030516  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.034865  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.982695 14643 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:01.034148  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:00.992229 14233 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:00.993824 14557 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:01.038125  8034 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:01.025954 14701 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:01.033344  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 296121us
I20260709 12:24:01.044979  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:01.026150 14380 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.029249 14465 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.965157 14548 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.034113 14487 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:01.039582 14697 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:01.038506 14643 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:01.044226 14531 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:01.037150 14599 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.047950 14642 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:24:01.054821  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 387995us
I20260709 12:24:01.063066 14520 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:01.067312 14597 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:01.079540 14697 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.083110 14643 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:01.047641 14557 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.066413 14547 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.066143 14577 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.072854 14316 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:24:01.071241 14465 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.110255 14520 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:01.126235  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.130324  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.132974  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.132861 14382 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:01.133775  8064 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:01.134876  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.136447  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:01.110780 14562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.011s	sys 0.007s
I20260709 12:24:01.105371 14697 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.138782  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.139628  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.140653  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:01.147087  8142 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:01.112870 14642 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:01.098402 14599 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.152397  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.156030  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:01.143205 14562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.011s	sys 0.007s
I20260709 12:24:01.156737  8137 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
W20260709 12:24:01.150048  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 115990us
I20260709 12:24:01.151556  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.159934  8063 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:01.160009  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.161531 14711 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.142684 14206 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.159188  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:01.142557 14382 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:01.158010  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:01.176331  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.178718  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.165251 14706 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:01.195798  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.197679  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.199960  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.200615  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.200958  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.202919  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.173434 14382 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:01.176364 14649 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:24:01.210831  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51711us
I20260709 12:24:01.211591  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.180117 14487 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:01.214154  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.175155 14711 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:24:01.219430  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.220914  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:01.221220 14705 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:01.224260 14643 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.202097 14527 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:01.217432 14577 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.194528 14701 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:01.225013  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.230612  8064 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:01.174717 14206 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.232185  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.176190 14597 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:24:01.212847 14649 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.240878  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.213318 14233 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.243438 14548 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:01.245568 14708 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:24:01.245827 14206 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.246438  8761 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:01.243510 14382 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.231503 14527 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:01.267052  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.235352 14701 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:01.269500 14701 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:01.214095 14642 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.229904 14540 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.259084  8757 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:24:01.260479  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.268960 14527 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.262862  8218 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:01.264930  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:01.266080  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.278967  8220 raft_consensus.cc:2368] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19.
I20260709 12:24:01.266610  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.268993 14578 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:01.251287  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:01.241257 14649 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.266827  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.284286  8214 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:01.206476 14520 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.269119  8216 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.287835  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:24:01.265193 14712 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:01.280691  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.291555  8757 raft_consensus.cc:2393] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:01.295604 14560 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:01.296111 14560 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:01.296653 14560 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:01.297762 14578 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:01.298995 14602 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.301501 14599 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.275490 14557 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.283236 14565 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.284825 14316 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.315917 14316 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.325757 14316 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:01.326526 14680 log.cc:927] Time spent T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.952s	user 0.001s	sys 0.005s
I20260709 12:24:01.328867  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3522) took 2286 ms. Trace:
I20260709 12:24:01.332835  8216 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:01.329303  8062 rpcz_store.cc:276] 0709 12:23:59.042889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.059254 (+ 16365us) service_pool.cc:224] Handling call
0709 12:23:59.069644 (+ 10390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.070096 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.070143 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.076287 (+  6144us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.074768 (+998481us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b1800407860. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:24:00.160397 (+ 85629us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:24:00.190305 (+ 29908us) log.cc:844] Serialized 14 byte log entry
0709 12:24:00.190723 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.190841 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.218883 (+ 28042us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800407860. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:24:00.374193 (+155310us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800407860. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:24:01.325881 (+951688us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:24:01.328596 (+  2715us) raft_consensus.cc:1685] finished
0709 12:24:01.328641 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.328797 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2551,"prepare.queue_time_us":37133,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":3594,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":5027,"spinlock_wait_cycles":83058432,"thread_start_us":85444,"threads_started":1,"wal-append.queue_time_us":1116233}
I20260709 12:24:01.338400 14543 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:01.343030 14465 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.333578 14704 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.355608 14704 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.363809 14649 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:01.348512  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 97840.9us
I20260709 12:24:01.370210  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.374423  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.390908  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:01.377838  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 148608us
I20260709 12:24:01.394912 14704 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.411123  8065 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:01.417503  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.418918 14562 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:01.419361 14562 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:01.421075  8216 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:24:01.368587 14697 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:01.415017  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45722.4us
I20260709 12:24:01.399298 14605 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:01.397904  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.454540 14706 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:01.429126  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:01.455775  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 57944.5us
I20260709 12:24:01.415050  8220 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:01.456370  8070 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:01.451737  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.427448  8065 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:24:01.428807  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.458539  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:01.458985  8066 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:01.430034  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.460006  8062 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 12.
I20260709 12:24:01.431264  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.460595  8757 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:01.375247 14527 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.463347  8064 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:01.463538  8068 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:01.466603  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:01.467020  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.471323  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:01.475135 14578 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:01.476927 14578 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:01.468989 14572 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:01.478523 14572 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.478870 14572 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:01.480149 14565 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:01.469175 14316 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:01.481418 14206 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:01.481851 14206 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.464732 14701 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.482273 14206 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.484748 14448 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:01.485230 14448 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.485620 14448 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.487807 14643 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.488961  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.490972 14382 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.491986  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.420395 14562 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.502247 14697 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.500543 14599 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:24:01.502951  8063 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:01.506160  8061 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:24:01.463201 14547 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:24:01.507581 14547 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:01.507929 14547 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:01.508769 14547 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.509976 14547 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:01.513746  8142 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:01.520541  8036 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:01.527822  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:01.530225  8757 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.483843 14701 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.545157  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.522809 14670 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 12:24:01.556753 14720 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.281s	user 0.004s	sys 0.000s
I20260709 12:24:01.528811 14602 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:01.522823 14525 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:01.567134 14650 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.567417 14527 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.567803 14650 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.568456  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:01.573184 14602 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:01.573899  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.574712  8068 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:01.574236 14602 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.577540 14650 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.580684 14433 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.581252 14433 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.582073  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.500798 14560 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.585649 14649 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.586287 14560 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.535001 14655 consensus_queue.cc:1059] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:24:01.588544 14655 raft_consensus.cc:3055] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:01.588928 14655 raft_consensus.cc:740] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:01.589772 14655 consensus_queue.cc:260] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.591205 14655 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.584133 14433 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.593837 14525 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.594489 14562 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.596150 14525 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.597307  8215 raft_consensus.cc:2410] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:24:01.598469  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.599045  8137 raft_consensus.cc:1813] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Handling vote request from an unknown peer 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.599558  8137 raft_consensus.cc:2410] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:24:01.599905  8141 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.573055  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:01.604065  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.605391  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.606150  8137 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
W20260709 12:24:01.604190  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 323583us
I20260709 12:24:01.607954  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.613443  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.615471  8140 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:01.615655  8761 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
W20260709 12:24:01.613564  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62547.9us
I20260709 12:24:01.618322  8757 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:01.618343  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:01.619150  8062 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:01.624266  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:01.625619  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.625974  8141 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:01.630714  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.637459  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.638103  8214 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.638589  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.638855  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.639703  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.639954  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.641219  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.642110  8211 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:01.644479  8143 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:01.647508  8218 raft_consensus.cc:2410] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:24:01.648412  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.589520 14448 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.553519 14599 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:24:01.651443  8211 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:24:01.652374  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 181947us
I20260709 12:24:01.660048  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.656296  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2361) took 1405 ms. Trace:
I20260709 12:24:01.658077  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:01.662844  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.660939  8215 rpcz_store.cc:276] 0709 12:24:00.250917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.253573 (+  2656us) service_pool.cc:224] Handling call
0709 12:24:00.802349 (+548776us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800192398. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f4989967eee 000000000036eb39 00007f49919db1e0 00007f4991aa40c4 00007f4991aa4131 00007f4991a520a0 00007f4991a51984 00007f498afcc6d4 00007f498afcc662
0709 12:24:01.656126 (+853777us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54002a5dd4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:24:01.656243 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829099776}
I20260709 12:24:01.664494  8110 leader_election.cc:400] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21.
I20260709 12:24:01.665925  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.666528  8145 raft_consensus.cc:1275] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:24:01.668919  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:01.669786  8765 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: [17.13-18.14]
I20260709 12:24:01.671361  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.672358  8215 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:01.631004 14699 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:01.681079  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.613302 14302 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:24:01.682014  8211 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:01.685876  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.689934  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.691955  8219 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:01.696336  8110 leader_election.cc:400] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:24:01.696877  8110 leader_election.cc:403] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:01.698666  8186 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.669296 14480 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.673295 14650 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:01.699440  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.630853 14572 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.701560  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.691546 14649 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.710844  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.701838 14723 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:01.681536 14560 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:24:01.681420 14565 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:24:01.726019  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.680419 14725 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:24:01.703395 14543 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.722769 14649 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.722445 14670 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.749004 14719 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:01.694346 14699 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.737679  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:01.727361 14557 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:01.746196 14448 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.723206 14704 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:01.755828  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:01.727100 14629 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 14. Current term is 15.
I20260709 12:24:01.753100  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:01.778215  8066 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.709573 14480 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:01.776149  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50234.4us
I20260709 12:24:01.783659  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:01.785694  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.791519  8066 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:24:01.771840 14719 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:01.775377 14605 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:01.793540  8110 leader_election.cc:400] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19.
I20260709 12:24:01.777853 14382 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.794430  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:01.798182  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.795847  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.801005  8214 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:01.805158  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.802820  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.779042 14557 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.794788 14579 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:01.795136 14605 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:01.808945 14233 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:01.786867 14704 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:24:01.812111 14704 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:01.812466 14704 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:01.813485 14704 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.815258 14704 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.816717 14565 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:01.817006 14572 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.819345 14233 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:01.820065 14233 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.822741  8216 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:24:01.806025 14670 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:01.824000 14233 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.805539 14725 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:24:01.804395 14527 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:01.825593 14527 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:01.806828 14543 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:24:01.826612 14527 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.829667 14206 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.832103 14206 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.800532 14448 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:01.807776 14719 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.832552 14480 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.832952  8765 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:01.842156 14725 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:01.833393 14649 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.837270 14605 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:01.835132 14629 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:01.843614 14629 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:01.843981 14629 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.837186 14699 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:01.838697 14557 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.842669 14725 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.840533 14719 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.849339 14725 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.856560 14605 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:01.859736 14605 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:01.835937  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.860919 14725 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:01.861696 14725 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:01.862855 14725 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.869877  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.871151 14542 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:01.871923 14542 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:01.874342  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.874584  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.875171  8141 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:01.879927  8216 raft_consensus.cc:1240] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:01.880055  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.880838  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.881575  8214 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:01.883356  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.886597  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.887728  8214 raft_consensus.cc:2368] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19.
I20260709 12:24:01.891125  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.891960  8211 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:01.893232  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:01.894238  8110 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:01.902505  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.902870  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:01.899525  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.903789  8220 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:01.910104  8730 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:01.928943  8211 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:24:01.929234  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.934777  8110 leader_election.cc:400] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19.
I20260709 12:24:01.935534  8110 leader_election.cc:403] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:24:01.936201  8137 raft_consensus.cc:2410] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:24:01.937655  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 134922us
I20260709 12:24:01.898674 14701 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:24:01.938714  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:01.941548  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:01.922746 14626 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:01.911680 14577 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:01.913600 14565 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:01.937718 14522 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:01.965559  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.971277  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:24:01.981454  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 70116.8us
I20260709 12:24:01.935339 14695 consensus_queue.cc:1059] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:24:01.946681 14579 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19.
I20260709 12:24:01.953527 14382 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:01.951262 14547 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:01.983440  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.943228 14629 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:01.954403 14233 consensus_queue.cc:1048] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:24:01.986445  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.984894  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:01.993826  8145 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:01.975437 14522 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.975122 14577 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.099014 14577 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:01.993274 14382 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:02.099728 14382 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:02.001124 14522 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.111007  8186 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.122450  8142 raft_consensus.cc:1240] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 22. Current term is 23. Ops: []
W20260709 12:24:02.093830 14733 log.cc:927] Time spent T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 12:24:01.982851 14542 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.127314  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.125619 14699 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:02.142493 14744 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:02.137125 14656 consensus_queue.cc:1059] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:24:02.135807 14629 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.156643  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:02.157830  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231648us
I20260709 12:24:02.232738  8220 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:24:02.238783  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.207808 14695 raft_consensus.cc:3055] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:02.235953 14520 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.254695 14520 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.243417 14629 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:02.269026  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81404.4us
W20260709 12:24:02.274555  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 100610us
I20260709 12:24:02.275931  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:02.276248  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:02.278767 14697 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:24:02.279280 14729 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.503s	user 0.000s	sys 0.003s
I20260709 12:24:02.279458 14697 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.281844 14697 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:02.245098 14695 raft_consensus.cc:740] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:02.285705 14626 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:02.286270 14626 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:02.279331 14753 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:24:02.297501 14695 consensus_queue.cc:260] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.311255  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:02.337386  8184 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.338405  8730 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:02.298794 14695 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:02.272809 14629 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:02.385098  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45420.3us
I20260709 12:24:02.386691  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.363304 14725 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:02.373183 14654 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:02.380537 14650 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:24:02.404922  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67685.7us
I20260709 12:24:02.406659 14480 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:02.419963  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.420161  8216 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:24:02.399873  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49453.6us
I20260709 12:24:02.425335  8034 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.402436 14548 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:02.447834  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:02.397858 14725 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.450254 14629 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:02.448565 14548 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.458248 14725 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:02.461822  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:02.465886  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:02.466359 14762 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.466926 14762 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.468918 14520 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.424229 14486 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.471364  8760 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:02.471261 14650 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.457623 14548 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:02.445725  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:02.475685  8757 raft_consensus.cc:2393] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 19: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:02.473335  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.423028 14654 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
W20260709 12:24:02.483129  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63259.9us
I20260709 12:24:02.483858  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.485283  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:02.480540  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.482187 14629 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.478956 14448 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:24:02.482390 14316 raft_consensus.cc:3055] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:02.473114 14626 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:02.487255  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62009.2us
I20260709 12:24:02.509719  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.512104  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.526696  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.527712  8219 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:24:02.486950 14548 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:02.529274  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:02.487308 14760 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:02.482934 14706 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:24:02.514398 14524 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.502408 14316 raft_consensus.cc:740] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:02.540812  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.550361  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.543812  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.522058 14602 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.524981 14762 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.551579  8035 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.505959 14382 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.553797 14512 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:02.570108 14382 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.571331  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:02.561725  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.555634  8062 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:02.511346 14629 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.563783  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:02.538563 14755 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:02.559428 14654 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.543412 14642 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:02.557583 14697 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:02.594437 14731 log.cc:927] Time spent T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.809s	user 0.013s	sys 0.018s
I20260709 12:24:02.526432 14522 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.580569 14643 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:02.573036 14316 consensus_queue.cc:260] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.597966 14512 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:02.580433 14755 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.601652  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:02.603749 14629 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.609140  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.611143  8757 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:02.611958  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.609169  8765 raft_consensus.cc:2393] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:02.619935  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.645758 14316 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:02.614120  8219 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:02.615542  8758 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:02.652935  8110 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:02.654107 14382 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:02.654757 14382 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:02.655002 14642 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:02.540042 14760 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:02.619027  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:02.660055  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 48169.6us
I20260709 12:24:02.660499  8216 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:02.662063  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:02.662734  8068 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:02.655884 14382 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.667408  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:02.668355  8069 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:24:02.673332  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 53537.8us
I20260709 12:24:02.674664  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:02.656023 14642 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.670938 14760 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:02.669415 14520 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.660131 14755 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:02.617614 14512 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:02.672086 14765 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.673400 14602 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:02.696112  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.697599  8219 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:02.698563  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:24:02.698836  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 301131us
I20260709 12:24:02.699651  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.708771  8216 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.708899  8211 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:02.700740  8218 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 12:24:02.709897  8218 pending_rounds.cc:85] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 14
I20260709 12:24:02.710175  8218 pending_rounds.cc:107] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:24:02.710445  8218 raft_consensus.cc:2889] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:02.703141  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.706218  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:02.711961  8142 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.711874  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:02.712862  8061 raft_consensus.cc:3060] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.717870  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:02.683555 14629 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:02.726683  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.683123 14522 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.616611 14697 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:24:02.742959 14465 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:02.743492 14465 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:02.732031  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.744663 14465 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.745745  8069 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:02.746345 14465 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:02.751158  8143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.033s	sys 0.055s
W20260709 12:24:02.754421  8143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.035s	sys 0.056s
I20260709 12:24:02.705370 14512 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:02.734470  8070 raft_consensus.cc:2393] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:02.729782  8068 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:24:02.728922 14629 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.773286 14629 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:02.774400  8109 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:02.681071 14548 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:24:02.786991  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:02.790551  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:02.788825  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72890.5us
I20260709 12:24:02.793757  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:02.795651  8142 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:24:02.711416 14524 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:02.686228 14486 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:24:02.705070 14520 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.802773  8216 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
W20260709 12:24:02.814244  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99768.3us
I20260709 12:24:02.820832  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:02.804348 14531 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:02.821671  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:02.822678  8765 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:02.789300 14725 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:02.827606  8062 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:02.834259  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:02.849647 14735 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:02.850452 14770 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:02.858819  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.860944  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.865586  8069 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:02.866991  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:02.875154 14542 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.875902 14542 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:02.876916  8068 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:02.879045  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.881078 14448 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:02.880398  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:02.883581 14233 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.884030  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:02.822918 14654 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:02.825320 14650 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:02.812573 13979 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:24:02.884856 14448 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:24:02.838793 14725 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:02.890146 14774 log.cc:927] Time spent T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:02.804181 14524 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.824256 14531 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:02.900810 14520 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.848170 14704 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:24:02.822727 14533 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:24:02.907956 14525 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.908406 14725 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:02.912669  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 136807us
I20260709 12:24:02.909109 14626 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:02.938323  8145 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:02.909684 14542 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:02.941469  8139 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:02.915822 14531 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:02.939728  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:02.947165  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:02.931376 14577 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.948783 14577 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:02.951207 14577 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.953356 14512 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:02.959789  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 125665us
I20260709 12:24:02.961205  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:02.961870  8216 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:03.068127  8064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33996 (request call id 3557) took 1383 ms. Trace:
I20260709 12:24:03.068681  8064 rpcz_store.cc:276] 0709 12:24:01.685364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.685580 (+   216us) service_pool.cc:224] Handling call
0709 12:24:03.067913 (+1382333us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003219d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:24:03.068061 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495310208}
I20260709 12:24:03.071223  8061 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:24:02.964264 14524 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:02.947093 14525 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.123s
I20260709 12:24:03.148873  8061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
W20260709 12:24:03.150484  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 303919us
I20260709 12:24:03.149748  8061 raft_consensus.cc:606] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:03.160437 14605 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:03.170333 14605 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.173367 14605 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:03.180244 14704 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.180843 14704 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.182008  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:03.182673  8216 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:03.185047 14704 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.191962 14792 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:03.192723 14557 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.192260 14725 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:03.194617 14725 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.196905 14725 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:03.192075  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 252450us
I20260709 12:24:03.198338  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:03.199491  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:03.203369  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.208348  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.209120  8138 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:03.210253  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:03.214365  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:03.211308  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:24:03.212055 14755 consensus_meta.cc:287] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 12:24:03.193269 14557 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.215065 14743 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.220419  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:03.219658 14548 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:03.217160 14701 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:03.220461 14792 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:03.223161 14531 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.231034 14579 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:03.226348 14755 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.234894 14755 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.235525 14755 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.237134 14755 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.237993  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:03.238664  8765 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:03.239270 14755 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.239607  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.239874  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:03.241014 14793 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:24:03.241520  8218 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:03.233781  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.243578  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:03.244853  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:03.229358 14743 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.213876 14629 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.249786 14743 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:03.229230 14548 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.251674 14548 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:03.256327  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:03.257138  8765 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:03.260244  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.239658 14557 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.251761  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:03.264775  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:03.265689  8212 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:24:03.267810 14579 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:03.268260 14579 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.268601 14579 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:03.270150 14629 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:03.258824 14760 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:24:03.271251 14760 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.273455  8145 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:03.273615 14760 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.261637 14642 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:03.274674 14642 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.277685  8061 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:03.286314  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:03.286401  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:03.289662 14547 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:03.287025 14791 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:24:03.291666 14512 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.289667 14746 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:03.292431 14746 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.292855 14746 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:03.293309  8729 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:03.290313 14547 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.294649 14547 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:03.297101 14777 raft_consensus.cc:2804] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:03.297775 14777 raft_consensus.cc:697] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:03.298696  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:03.300458  8137 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:03.302603  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.303354  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.303917  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.304457  8061 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:24:03.304924  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.297008  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:03.308089  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.311455  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:03.304829  8070 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:03.313627  8063 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:24:03.316756  8070 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:03.278030 14699 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:03.323101  8109 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:03.324474  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:03.328742 14764 consensus_queue.cc:1059] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:03.333914  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:03.372195  8218 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:03.380020  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:03.359900  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:24:03.444581  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 113925us
W20260709 12:24:03.444664  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 111809us
I20260709 12:24:03.329841 14697 raft_consensus.cc:3055] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:03.298719 14777 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.372210 14792 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:03.462883 14770 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.503460 14770 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.321062 14642 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.372120 14701 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:03.479451 14737 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:03.479948 14787 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:24:03.517971 14737 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.480690 14785 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:03.520252 14785 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.522557 14785 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.524235  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.342535  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:03.526454  8213 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:03.469246 14605 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.469029 14542 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.465334 14697 raft_consensus.cc:740] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:24:03.332672  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46339.5us
W20260709 12:24:03.469264  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 106668us
I20260709 12:24:03.328447 14302 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 12:24:03.513221  8758 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:03.516824 14531 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.508843 14525 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.512604 14704 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.545444  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.456561 14789 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.446630 14577 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:24:03.520342 14737 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:03.562482  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:03.567387  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:03.571990  8760 raft_consensus.cc:2368] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:24:03.576443  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:03.577137  8217 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:03.586228  8034 leader_election.cc:400] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:24:03.586615  8034 leader_election.cc:403] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.588930  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:03.559005 14701 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.566385 14704 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.596132 14531 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:24:03.597885  8062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:03.598181 14704 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.598591  8062 raft_consensus.cc:606] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:03.598973  8062 raft_consensus.cc:614] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:03.580673 14524 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:24:03.605115  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.556313 14605 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.615375  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.618957  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:03.566679 14525 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.580847 14760 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:24:03.561028 14542 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.572404 14789 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.572091 14579 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.593364 14533 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:03.609655 14560 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:03.619979 14480 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:03.623889  8068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:03.651633  8068 raft_consensus.cc:606] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:03.657271 14746 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.659706 14746 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.608944 14701 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.681138  8217 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:24:03.682212  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:03.682928  8217 raft_consensus.cc:2368] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:24:03.683265  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:03.691414  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:03.650821 14577 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.651398 14480 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:03.694496 14719 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.668587 14560 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.718746 14480 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:03.724609 14646 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:24:03.758452 14802 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:24:03.718534 14577 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.732486 14777 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.776793 14777 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.782209  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:03.783022  8066 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:24:03.783110  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.735594 14548 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.811061 14542 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.737373 14719 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.816144  8213 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:03.823190  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49240 (request call id 3596) took 1924 ms. Trace:
I20260709 12:24:03.826390  8066 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:03.823665  8214 rpcz_store.cc:276] 0709 12:24:01.898305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.900640 (+  2335us) service_pool.cc:224] Handling call
0709 12:24:01.900988 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.901251 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:24:01.952433 (+ 51182us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.496434 (+1544001us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b1800124240. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498c6344bc 00007f498998248b 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904843c7 00007f498ca969a7 00007f498caa60bf
0709 12:24:03.496583 (+   149us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.822790 (+326207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:03.822844 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:03.822890 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.823010 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.823133 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6368,"prepare.queue_time_us":232209,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":14563,"raft.queue_time_us":89,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1528,"spinlock_wait_cycles":9250176,"thread_start_us":765428,"threads_started":5,"wal-append.queue_time_us":473317,"wal-append.run_cpu_time_us":1338,"wal-append.run_wall_time_us":1019576}
I20260709 12:24:03.780015 14646 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:03.857579  8063 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:24:03.863133  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 235474us
I20260709 12:24:03.866726  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:03.869061 14548 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.833078 14807 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:03.875411 14701 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.888929 14560 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.866595 14605 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.873551 14525 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.874557 14777 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:24:03.873817 14579 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.892961 14577 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.898958 14789 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.898995 14701 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.920989 14701 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.921950 14719 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.923233 14701 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.911417 14646 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.884290 14807 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.926671 14480 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.928361  8217 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:03.929092 14480 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:03.936739 14547 consensus_meta.cc:287] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
I20260709 12:24:03.953444 14547 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.954274 14701 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:03.954882 14701 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.955997 14547 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:03.941776 14697 consensus_queue.cc:260] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:03.957144 14697 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:03.957751 14701 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:03.962764  8217 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
W20260709 12:24:03.988550 14801 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:24:03.991566 14629 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:03.992265 14629 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:03.999761  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.004263  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:04.005231  8137 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:04.005945  8139 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:24:04.006516  8139 pending_rounds.cc:85] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 13
I20260709 12:24:04.006863  8139 pending_rounds.cc:107] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:24:04.007210  8139 raft_consensus.cc:2889] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:04.005975  8142 raft_consensus.cc:1240] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:04.008453  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:03.996428 14629 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:04.012367  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.022118 14807 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:04.023064  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.025195 14656 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.025799 14656 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.028124 14656 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:04.031905 14814 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
I20260709 12:24:04.036988 14788 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:24:04.038913  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66814.8us
I20260709 12:24:04.040499  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.045990 14533 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:04.047750  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.052963  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.055889  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:03.952869 14800 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.378s	user 0.006s	sys 0.000s
I20260709 12:24:04.073051  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.084764  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.117726  8757 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:04.062861  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.078748 14725 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:04.120003 14725 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.122627 14725 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:04.065651  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.092671  8035 leader_election.cc:400] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20.
I20260709 12:24:04.063458  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:04.128126  8761 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 23.
I20260709 12:24:04.128332  8144 raft_consensus.cc:3060] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:04.085446 14812 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.071086 14770 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:04.066798 14803 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.390s	user 0.003s	sys 0.000s
I20260709 12:24:04.133061 14812 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.085193  8109 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:04.105095  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.134184  8143 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
I20260709 12:24:04.106940  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.135106  8145 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
I20260709 12:24:04.135573 14812 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:04.134184  8211 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:24:04.107599  8137 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.063748  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.060519  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.138573  8063 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:24:04.139984  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54865.7us
I20260709 12:24:04.140045  8144 raft_consensus.cc:2468] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:24:04.140161  8035 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.144565  8063 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:04.144695  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:04.145538  8066 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.145632  8065 raft_consensus.cc:606] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:04.146128  8065 raft_consensus.cc:614] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:04.146575  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:04.149626  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 101989us
I20260709 12:24:04.166083  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:04.151006  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 247443us
I20260709 12:24:04.179670  8211 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:24:04.182919  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.183871  8139 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:24:04.191047  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.192876  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:04.199944  8141 raft_consensus.cc:2368] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:24:04.206419  8065 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:04.207816  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:04.167302 14756 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:04.154954 14770 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:04.158882 14548 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:04.207545  8730 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:04.218182  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.219774  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:04.220376  8215 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:04.220573  8211 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:04.223567  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.224397  8217 raft_consensus.cc:2393] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 16: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:04.208693 14701 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:04.228991  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.212996 14560 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:04.183328 14791 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:24:04.211696 14719 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:04.186185 14784 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:24:04.242586  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:04.276436  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.230979 14656 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:04.284821  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.205895 14650 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:24:04.225281 14770 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:04.229403 14577 consensus_queue.cc:1059] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:24:04.309226  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.280934 14719 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.234937 14746 raft_consensus.cc:2804] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:04.230916 14701 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:04.264842 14642 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:04.310735  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:04.316316  8220 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:04.314770  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.319032  8217 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:04.321784 14770 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.318778 14746 raft_consensus.cc:697] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:04.325903 14746 consensus_queue.cc:237] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.329664  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.330442  8213 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:04.317509 14701 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:04.328248  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.321382 14642 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.342087 14642 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:04.358897  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.248564  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:04.359894  8110 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:04.359997  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.360721 14605 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:04.361141 14605 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.361195 14789 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:04.361593 14605 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:04.364221  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:04.369233  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:04.375469  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:04.362126  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 113741us
I20260709 12:24:04.382193  8186 leader_election.cc:400] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:24:04.382654  8186 leader_election.cc:403] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:24:04.383385 14822 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16.
I20260709 12:24:04.360003  8217 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:04.285537  8215 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:04.372112  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.376714 14701 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.373765 14789 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:04.418691 14557 raft_consensus.cc:3055] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:24:04.421239  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43807.4us
I20260709 12:24:04.359005 14578 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:24:04.397377 14805 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:04.430954  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 58970.3us
I20260709 12:24:04.423144 14557 raft_consensus.cc:740] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:04.426631 14719 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:04.435137 14817 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:04.425890 14725 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:24:04.450990 14642 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:24:04.474838  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 293172us
I20260709 12:24:04.430372 14805 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:04.463172  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 255699us
W20260709 12:24:04.483301  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 292366us
I20260709 12:24:04.485029  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.489833  8220 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:04.490399  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:04.478852  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.465658 14719 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.499607  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:04.473567 14792 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:04.494902  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.506579  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.507895  8144 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 23: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:04.514555  8061 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:24:04.511723  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 336253us
I20260709 12:24:04.492801 14756 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:04.533003  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:04.531672  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:04.510665 14772 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:04.556941  8064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:04.561225  8064 raft_consensus.cc:606] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.561728  8064 raft_consensus.cc:614] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:04.575583  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:04.483798 14642 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:04.591172  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88232.8us
W20260709 12:24:04.595306  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44181.3us
I20260709 12:24:04.546262 14656 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:24:04.603856 14656 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.603960  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 60953.3us
I20260709 12:24:04.608331  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.567438 14206 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:04.612016 14656 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:04.518734 14719 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.583099 14791 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 12:24:04.649711  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 55803.9us
I20260709 12:24:04.618072 14206 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.653458  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:04.668313  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:04.641942 14579 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:04.653456 14206 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:04.689579  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93204.8us
I20260709 12:24:04.661180 14701 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:04.689952  8062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3581) took 1054 ms. Trace:
I20260709 12:24:04.749899  8062 rpcz_store.cc:276] 0709 12:24:03.635866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.636079 (+   213us) service_pool.cc:224] Handling call
0709 12:24:03.636527 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.637070 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:03.827761 (+190691us) log.cc:844] Serialized 14 byte log entry
0709 12:24:04.547360 (+719599us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.547928 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.548124 (+   196us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:04.548169 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.548242 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.689703 (+141461us) raft_consensus.cc:1685] finished
0709 12:24:04.689725 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.689888 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14199,"prepare.queue_time_us":223167,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":53206,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":23960,"thread_start_us":867411,"threads_started":3,"wal-append.queue_time_us":490767}
I20260709 12:24:04.688059 14785 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:04.658560 14770 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:04.650743 14697 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:04.766364  8069 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:04.647665 14837 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
W20260709 12:24:04.790423  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 198097us
W20260709 12:24:04.802172  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 193948us
I20260709 12:24:04.783313 14316 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:04.820007  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.814803 14837 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:04.836165 14825 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 12:24:04.836539 14841 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:24:04.838333 14824 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 12:24:04.840159  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49958 (request call id 1003) took 1532 ms. Trace:
I20260709 12:24:04.841715 14829 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:04.840639  8762 rpcz_store.cc:276] 0709 12:24:03.308224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.316007 (+  7783us) service_pool.cc:224] Handling call
0709 12:24:03.333440 (+ 17433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:03.456179 (+122739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.456229 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:03.468749 (+ 12520us) log.cc:844] Serialized 52 byte log entry
0709 12:24:03.963734 (+494985us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b1800317d40. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989981e07 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999ec02 00007f498c62620b 00007f498c62bd23 00007f498c62c0d1 00007f498ca47a0f
0709 12:24:04.309915 (+346181us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:04.309966 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.310026 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.839797 (+529771us) raft_consensus.cc:1685] finished
0709 12:24:04.839825 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.840091 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12082,"raft.queue_time_us":123298,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11787,"spinlock_wait_cycles":8619264,"thread_start_us":345989,"threads_started":1,"wal-append.queue_time_us":973564}
W20260709 12:24:04.842896 14823 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 12:24:04.852089  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 105787us
I20260709 12:24:04.865051  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:04.822613 14316 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:04.883733  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 84980.3us
I20260709 12:24:04.884610  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:04.885502  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.864449 14642 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:04.888875 14772 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:04.889771 14772 consensus_queue.cc:1243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer 3d67d00ae45b444cbe343726df1760e8 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:24:04.892807 14838 log.cc:927] Time spent T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:24:04.896819 14833 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:04.901055 14854 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:04.903051  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 93919us
W20260709 12:24:04.903916 14832 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:24:04.905299 14844 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:24:04.905901 14842 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:04.908102  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:04.654320 14756 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.823374 14837 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.901786 14854 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.913674  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:04.837396 14841 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:04.897578 14833 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.842299 14829 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:04.901597 14828 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 12:24:04.949395  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.958045  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.961611  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:04.963922  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:04.944591 14533 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:04.963274  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:04.972281  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:04.988492  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.003393 14557 consensus_queue.cc:260] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.008742 14855 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.009445 14855 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.011759 14855 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:05.012817 14849 log.cc:927] Time spent T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:24:04.998245 14316 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:04.965977 14852 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:04.979259 14533 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.016325 14841 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:04.962325 14719 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.018177  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.052692 14206 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.021687 14859 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:05.023489 14656 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.025730 14854 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.026796 14833 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.030114 14785 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:05.033139 14837 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.033517  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.035609  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.039214  8061 pending_rounds.cc:85] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Aborting all ops after (but not including) 9
I20260709 12:24:05.039912  8109 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:05.092955  8061 pending_rounds.cc:107] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:24:05.041949  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.093417  8061 raft_consensus.cc:2889] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.046650 14533 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.049378  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.051146  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.054368  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:05.019385 14605 consensus_meta.cc:287] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.000s
I20260709 12:24:05.107522  8759 raft_consensus.cc:2368] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 23. Current term is 24.
I20260709 12:24:05.108103  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.109696  8140 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:05.088232  8213 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:05.088883  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.090675  8212 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:24:05.093353  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53526.3us
I20260709 12:24:05.102839  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.103955 14206 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.078145  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.112546  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:05.107582  8762 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:05.120409  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:05.116878  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:05.137537  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45346.2us
I20260709 12:24:05.141222  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.114038 14719 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:05.151803  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:05.122817 14605 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.126860 14725 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:24:05.104020 14656 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:24:05.090306 14859 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.146098 14854 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.175824  8068 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:05.114264 14785 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.149343 14533 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:05.205264 14533 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:05.206346  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 54226.4us
I20260709 12:24:05.207100  8212 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:05.209720  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.170203 14725 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.171069 14858 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:05.234715  8036 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:05.225109  8217 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:05.226583 13979 raft_consensus.cc:993] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:05.214807 14725 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:05.208250 14792 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:05.240487  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:05.250406  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:05.233239 14871 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:24:05.297488  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.260581  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:05.266429  8217 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 18: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:24:05.348330  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 12:24:05.350124  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:05.214241 14868 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.352340 14820 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:05.355116  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:05.357203  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 81872.7us
W20260709 12:24:05.365319  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 104842us
I20260709 12:24:05.372442  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:05.376888  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 225180us
I20260709 12:24:05.376967  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:05.210438 14854 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.378108  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:05.251111 14862 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:05.274478 14548 raft_consensus.cc:1081] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:05.352391 14868 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.385215  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:05.386085 14881 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:05.388381 14820 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:05.401943  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.402794  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.415877  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.405161  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.406096  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.417404  8218 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:05.383524 14756 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:05.371263 14719 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:05.377708 14860 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:05.386132 14874 log.cc:927] Time spent T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:24:05.353832 14316 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:24:05.432127 14560 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:05.431988 14756 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.252341 14858 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:05.463274  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 94957.1us
W20260709 12:24:05.458148  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 70759.7us
W20260709 12:24:05.456717  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 201382us
I20260709 12:24:05.459693 14756 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:05.457849 14560 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:05.462258 14787 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:05.506044 14880 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:05.507831 14889 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.508697 14889 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.485082 14206 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:24:05.515713 14206 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:05.516461 14206 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.512419 14878 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:05.525216 14785 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.537776 14859 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.539098 14854 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.518517 14719 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.544173 14829 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.547735 14805 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.548066 14756 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.550765 14858 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.551131 14756 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.552002 14725 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.554666 14889 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:05.555811 14864 log.cc:927] Time spent T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260709 12:24:05.555747 14725 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.558015 14757 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:05.558307 14880 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:05.558532 14757 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:05.559473 14757 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.560570 14757 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:05.561947 14846 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.755s	user 0.003s	sys 0.000s
W20260709 12:24:05.564610 14887 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:24:05.569916 14868 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.610102  7963 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 9 to 13, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 13 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:05.619865  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 234555us
W20260709 12:24:05.623548  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.625413  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.465726  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:05.630110  8070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1145) took 1073 ms. Trace:
W20260709 12:24:05.632014  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 167745us
I20260709 12:24:05.648717 14560 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.651540 14560 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:05.653573  8068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3594) took 1447 ms. Trace:
I20260709 12:24:05.663688 14480 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.654132  8068 rpcz_store.cc:276] 0709 12:24:04.205543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.207059 (+  1516us) service_pool.cc:224] Handling call
0709 12:24:04.218461 (+ 11402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.207025 (+988564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.652697 (+445672us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54001f7054. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:05.653309 (+   612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194597120}
I20260709 12:24:05.668287 14629 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.669582 14578 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.670367 14629 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.670943 14578 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.683516 14646 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:24:05.640161  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 147419us
I20260709 12:24:05.636600  8218 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:24:05.692451 14557 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:05.713389 14772 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.636386  8143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:05.684741 14206 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.686677 14706 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:05.689311  8108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.689965 14480 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.691226 14565 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:05.694594  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.735304  8214 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:05.697433  8220 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:24:05.697722 14875 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.631016  8070 rpcz_store.cc:276] 0709 12:24:04.555962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.556717 (+   755us) service_pool.cc:224] Handling call
0709 12:24:04.557086 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:04.810318 (+253232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.810357 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:04.811541 (+  1184us) log.cc:844] Serialized 26 byte log entry
0709 12:24:04.943884 (+132343us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:04.943932 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.945005 (+  1073us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.555192 (+610187us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:24:05.628962 (+ 73770us) raft_consensus.cc:1685] finished
0709 12:24:05.629085 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.629754 (+   669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106170,"raft.queue_time_us":138510,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":34607,"spinlock_wait_cycles":160275840,"thread_start_us":276765,"threads_started":2,"wal-append.queue_time_us":228297}
I20260709 12:24:05.702293  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:05.742137 14706 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.750537 14857 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:05.751701 14857 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.756263 14857 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.757751 14646 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.758992 14878 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.759850 14878 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.762302  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.762898  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.764230  8067 raft_consensus.cc:2410] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:24:05.766215 14772 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.697575  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:05.770408  8216 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:24:05.772907 14565 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:05.774888 14565 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.777060 14875 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.752957 14656 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:05.779565 14656 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.781810 14605 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:05.783159  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 137015us
I20260709 12:24:05.784987  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:05.787613 14629 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.717067 14522 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:05.789204 14522 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.738927  8143 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.793076  8143 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:05.794874  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.798385  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.758281 14880 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.810178 14880 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.812304  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.813184 14540 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:05.750801 14480 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.814640  8138 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:05.817199 14772 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.818657 14578 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.792549 14522 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.827687 14486 raft_consensus.cc:993] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:05.828855 14486 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:05.819893 14646 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.831430 14855 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.831588 14862 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.832583 14855 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.834631 14841 raft_consensus.cc:1081] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:05.838336  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:05.842152 14533 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.788472 14629 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:05.850744 14772 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:05.851562 14856 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:05.848743 14862 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.852880 14856 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.862824 14855 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.864746  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.869704 14540 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.829903 14486 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.872568 14540 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:05.873021 14629 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:05.874704 14486 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.875852 14656 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.879096  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.881479  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:05.882792  8065 raft_consensus.cc:1240] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:05.863091 14880 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:05.896643  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 58698.5us
I20260709 12:24:05.851854 14772 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.902132  8063 raft_consensus.cc:3060] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:24:05.902325  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:05.903308  8140 raft_consensus.cc:3060] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:05.909132 14856 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.910074  8144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:05.911005  8144 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.911609  8144 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:05.913144  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.914603 14875 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:05.917069  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 128916us
I20260709 12:24:05.918859  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.919937  8067 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:05.923801 14891 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.924516 14891 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:05.926626  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.928650 14862 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.935053  8215 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:05.934355  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:05.881443 14706 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:05.957165  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.941269  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:05.966513 14629 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:05.967224  8218 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:24:05.974148  8216 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:05.977075  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:05.981230  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:05.981776 14891 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:05.982848  7963 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 9 to 14, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 14 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:05.988848  8063 raft_consensus.cc:2468] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 24.
I20260709 12:24:05.991407 13979 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:05.991333  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:05.999701  8216 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:06.005973  8145 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 24: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:06.012838  8035 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:06.014781  8138 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:06.015841  8143 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.026831  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.027573  8140 raft_consensus.cc:2468] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:06.014317  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.032807 14629 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.033197  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:06.034073  8061 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.010s
W20260709 12:24:06.034488  8061 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.010s
I20260709 12:24:06.034646  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.036118  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:06.039788  8141 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 15: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:06.041446  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.041894  8186 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.043303 14821 raft_consensus.cc:2804] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:06.044085 14821 raft_consensus.cc:697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:06.036166  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:06.037546  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.044902  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.049434  8145 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:24:06.050451 14862 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:06.050187 14821 consensus_queue.cc:237] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.044106  8034 leader_election.cc:400] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 23. Current term is 24.
I20260709 12:24:06.052984  8034 leader_election.cc:403] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.058138  8061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34012 (request call id 2548) took 1129 ms. Trace:
I20260709 12:24:06.059135  8061 rpcz_store.cc:276] 0709 12:24:04.928577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.928735 (+   158us) service_pool.cc:224] Handling call
0709 12:24:04.937768 (+  9033us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:05.113781 (+176013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.113838 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:05.114669 (+   831us) log.cc:844] Serialized 52 byte log entry
0709 12:24:05.441016 (+326347us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:06.034867 (+593851us) log.cc:844] Serialized 14 byte log entry
0709 12:24:06.035424 (+   557us) log.cc:844] Serialized 14 byte log entry
0709 12:24:06.035735 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.054491 (+ 18756us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003228d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:06.054626 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.057570 (+  2944us) raft_consensus.cc:1685] finished
0709 12:24:06.057614 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.058006 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16635,"prepare.queue_time_us":55333,"prepare.run_cpu_time_us":170,"prepare.run_wall_time_us":173,"raft.queue_time_us":8116,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":13735,"spinlock_wait_cycles":232727936,"thread_start_us":858831,"threads_started":2,"wal-append.queue_time_us":305159}
W20260709 12:24:06.063421  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.065200  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.045966 13979 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:06.082472 14772 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.082911  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.074597  8764 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:06.085765  8143 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.086705  8140 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:24:06.088929  8757 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 24: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:06.089290  7963 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 10 to 12, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 12 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:06.102273  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.102797  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.104250  8145 raft_consensus.cc:1275] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:06.075304 14856 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761) with higher term. Message: Invalid argument: T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for earlier term 23. Current term is 24.
I20260709 12:24:06.109822  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.119561  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:06.121007  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.082278 14560 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:06.122680  8144 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.126127  8069 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:24:06.126255 14812 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.126492  8067 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:06.126932  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.128096  8186 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:06.128736  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 138826us
I20260709 12:24:06.131402 14890 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:06.141331 13979 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:06.142499 13979 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.144794 14857 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:06.144937 14560 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.145627 14857 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.147265 14890 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.147842 14560 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.148068 14857 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.133523  8067 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:06.097266 14878 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.139478  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.153178  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.149704  8067 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.151948  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.120343  7963 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:06.160135  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.163511  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.160549  8061 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:06.168192  8144 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.166443  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.176061  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.183519  8067 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.187994  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.188589  8070 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:06.164739 14878 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:06.187822  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.195868  8138 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:06.190177  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.197499  8109 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.195283 14540 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.210906  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:06.220120 14901 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:06.220772 14527 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:06.221485 14527 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:06.222065 14527 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.222355  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.223462 14757 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:06.226948  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51621.3us
I20260709 12:24:06.228541  8109 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.230815  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.231426 14891 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:06.231340 14565 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:06.232084 14891 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.232569 14891 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:06.234023  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:06.234874  8757 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.230865 14629 raft_consensus.cc:2804] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:24:06.237136  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.237282 14629 raft_consensus.cc:697] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:06.239809 14629 consensus_queue.cc:237] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.240089  7963 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 9 to 10, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 10 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:06.208890 14890 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.242345  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.185159 14772 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:06.199421 14878 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:06.247108  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:06.203688 14486 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:06.156607 14812 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.264513  8070 raft_consensus.cc:3055] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:06.274248  8070 raft_consensus.cc:740] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:06.224112 14757 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.304644  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:06.290442  8731 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.321992  8139 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:06.270593 14878 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.330585  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.264082 14540 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.338354  8186 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.288519 14805 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:24:06.357677  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56451.5us
I20260709 12:24:06.295403 14772 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.367357 14772 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.317219 14486 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:06.369242  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 175346us
I20260709 12:24:06.352342 13979 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.373260  8036 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:06.375771  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 196425us
I20260709 12:24:06.345072  8070 consensus_queue.cc:260] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.376283 14540 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.405009  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.376717  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.411013  8146 raft_consensus.cc:1240] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:06.411433 14736 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:24:06.428396  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 138176us
I20260709 12:24:06.429318  8070 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:06.434705 14736 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:06.413412  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.454628 14862 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:06.455273 14736 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.458369 14812 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:06.459728 14822 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:06.460223 14822 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:06.460649 14822 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:06.464847 13979 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:24:06.467079  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 90492.3us
I20260709 12:24:06.468104  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:06.495719  8064 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:06.497931 14757 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.498119 14812 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:06.503957 14706 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:06.385388 14805 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:06.499529 14646 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:06.541539  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 140694us
I20260709 12:24:06.552477  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.554061  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.535604  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.573695  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:06.574571  8143 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
W20260709 12:24:06.576284  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 44442.5us
W20260709 12:24:06.590147  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 230053us
W20260709 12:24:06.622474  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.603720 14533 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:06.641476  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 173458us
W20260709 12:24:06.655572  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 101596us
I20260709 12:24:06.625705 14890 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:06.683777  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.698428  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 258428us
I20260709 12:24:06.718521  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:06.732558  8067 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.006s
I20260709 12:24:06.733144  8067 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:06.703051 14533 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:06.750313 14533 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.754518  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:06.754966 14646 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:06.755769 14646 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.758188 14646 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:06.763922  8757 consensus_meta.cc:287] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:24:06.764559  8757 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:06.769012  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:06.754572  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:06.766537  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 121707us
W20260709 12:24:06.771168 14903 log.cc:927] Time spent T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:24:06.771468 14900 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:24:06.759204 14540 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:06.794924  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:06.801941  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 125046us
I20260709 12:24:06.802382  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:06.795091 14527 consensus_meta.cc:287] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.003s
I20260709 12:24:06.793550 14579 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:24:06.833806 14900 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:24:06.803956 14904 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:24:06.807787 14862 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:06.838264 14862 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.838912 14862 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:06.844172  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.845211  8068 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:06.846607  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:06.847702  8064 raft_consensus.cc:2393] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 24: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
W20260709 12:24:06.852108  7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 256) took 17077 ms (client timeout 15000 ms). Trace:
W20260709 12:24:06.852674  7960 rpcz_store.cc:269] 0709 12:23:49.774201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.774478 (+   277us) service_pool.cc:224] Handling call
0709 12:24:06.851757 (+17077279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:01.748426 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:01.749121 (+   695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:01.749173 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:01.749190 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:01.813534 (+ 64344us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:01.813633 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:01.813664 (+    31us) tablet.cc:685] Acquiring locks for 33 operations
0709 12:24:01.816084 (+  2420us) tablet.cc:701] Row locks acquired
0709 12:24:01.816141 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:24:01.816358 (+   217us) write_op.cc:270] Start()
0709 12:24:01.816527 (+   169us) write_op.cc:276] Timestamp: P: 1783599841816279 usec, L: 0
0709 12:24:01.816568 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:24:01.825467 (+  8899us) log.cc:844] Serialized 13001 byte log entry
0709 12:24:02.199277 (+373810us) op_driver.cc:464] REPLICATION: finished
0709 12:24:02.524536 (+325259us) write_op.cc:301] APPLY: starting
0709 12:24:02.539059 (+ 14523us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:03.072526 (+533467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:03.072688 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:03.518655 (+445967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:03.519116 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 12:24:03.519185 (+    69us) write_op.cc:312] APPLY: finished
0709 12:24:03.524565 (+  5380us) log.cc:844] Serialized 284 byte log entry
0709 12:24:03.723958 (+199393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.749296 (+ 25338us) write_op.cc:454] Released schema lock
0709 12:24:03.749403 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:03.771989 (+ 22586us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.772031 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1861749,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":277854,"apply.run_cpu_time_us":109240,"apply.run_wall_time_us":1284607,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142199,"num_ops":33,"prepare.queue_time_us":154889,"prepare.run_cpu_time_us":98020,"prepare.run_wall_time_us":226849,"raft.queue_time_us":102306,"raft.run_cpu_time_us":27417,"raft.run_wall_time_us":181606,"replication_time_us":382532,"thread_start_us":649219,"threads_started":5,"wal-append.queue_time_us":578523,"wal-append.run_cpu_time_us":16544,"wal-append.run_wall_time_us":2159404}]]}
I20260709 12:24:06.875590 14533 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.879981  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:06.813304 14527 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.883767 14527 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.809724 14856 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:24:06.886413 14812 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:06.887499 14890 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:06.889492 14557 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.890278 14557 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:06.891371  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.904405  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51784 (request call id 1361) took 1093 ms. Trace:
I20260709 12:24:06.904860  8214 rpcz_store.cc:276] 0709 12:24:05.810910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.815761 (+  4851us) service_pool.cc:224] Handling call
0709 12:24:05.816328 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.905121 (+ 88793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.905162 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.905914 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 12:24:06.046290 (+140376us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:06.046341 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.046411 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.904133 (+857722us) raft_consensus.cc:1685] finished
0709 12:24:06.904163 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.904317 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14554,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":23651,"thread_start_us":120137,"threads_started":1,"wal-append.queue_time_us":509351}
I20260709 12:24:06.922647 14821 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:06.923285 14821 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.923761 14821 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:06.931268  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.939603 14557 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:06.942656  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:06.952423 14821 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:07.014225  8070 consensus_meta.cc:287] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.004s
I20260709 12:24:07.025516  8070 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:07.031854  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.033102  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:06.974689 14822 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.001s
I20260709 12:24:07.036715  8061 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
W20260709 12:24:07.037545 14891 consensus_meta.cc:287] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.804s	user 0.014s	sys 0.001s
I20260709 12:24:07.074597  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.031670 14890 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:07.084931  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.113663  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.115104  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.115895  8216 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:07.111191  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.114528  8218 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:24:07.111527 14891 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.126858  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.113374 14890 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.129573 14879 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.130245 14879 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.130507  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.131516 14890 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.132094  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.132295 14879 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.149739  8070 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:07.132453  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.132944  8211 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
W20260709 12:24:07.167229  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 396069us
I20260709 12:24:07.166352  8218 raft_consensus.cc:2468] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:24:07.110096 14822 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.141705 14891 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.291615  8216 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:07.258961  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.258564  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.258371  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.133327 14918 raft_consensus.cc:2804] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:07.240877  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.254627  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:07.303624  8731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.045s
I20260709 12:24:07.222390  8764 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:07.224555  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.231289  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.152776 14560 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.213456  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:07.309087  8731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.018s	sys 0.045s
W20260709 12:24:07.192941  8034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:07.310601  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 508281us
I20260709 12:24:07.309530  8218 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 15.
I20260709 12:24:07.226436  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.156365 14486 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.146478 14706 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:07.310436  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 554332us
I20260709 12:24:07.280916  8219 raft_consensus.cc:1240] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:24:07.311976  8215 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:07.227036  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:07.239996 14878 consensus_meta.cc:287] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.890s	user 0.005s	sys 0.005s
I20260709 12:24:07.234416  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.132998 14917 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:07.221920 14837 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.224133  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.138962 14805 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.173162 14856 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.283499 14855 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.229611 14821 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.242600 14890 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.190639 14736 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.323024 14565 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.330375  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.330852 14565 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:07.323735  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.020s
W20260709 12:24:07.334131  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.013s	sys 0.021s
I20260709 12:24:07.333966  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.334954  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.258785 14911 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.254561 14879 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.319212 14918 raft_consensus.cc:697] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:07.328483 14855 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.315826 14880 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.329732 14856 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.333762 14565 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.357614  8143 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:24:07.345908  8731 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.311656 14862 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.325811 14917 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:07.321732 14486 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.317087 14706 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.340365 14821 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.315351 14560 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.320489 14878 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.374504  8067 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:07.380920  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:07.376111  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 244183us
I20260709 12:24:07.359721 14540 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.343607 14837 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.373843 14918 consensus_queue.cc:237] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.340433 14890 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.348920 14879 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.373427 14527 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.373728 14821 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.417963 14821 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.418206 14560 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.375463 14486 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.401829 14540 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.421671 14862 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.422245 14917 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.422761 14719 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:24:07.383926 14900 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:07.424618 14900 consensus_queue.cc:1048] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:07.430624 14890 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.431615 14706 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.433713 14878 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.360033 14911 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.433873 14527 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.362999 14880 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.357488 14736 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.438063 14880 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.438596  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.441023 14890 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:07.442116  8729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.023s
W20260709 12:24:07.442541  8729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.017s	sys 0.023s
I20260709 12:24:07.441682 14890 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.473274  8142 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:07.482280  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:07.470256 14919 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:07.486290  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.487331  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.488355 14837 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.490164  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.516978  8144 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:07.491163  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:07.491963  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:07.502435 14736 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.504544 14856 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.509227 14527 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.510612  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.519333 14922 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.527798  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:07.481827  8729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.129:34867 timed out after 1.586s (SENT) [suppressed 1 similar messages]
W20260709 12:24:07.525838  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 159420us
I20260709 12:24:07.527770  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.532531  8219 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:07.534650  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:07.537760  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 156977us
I20260709 12:24:07.537107  8215 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:07.527432 14928 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.535085 14706 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.576277 14855 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:07.586457  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 104664us
I20260709 12:24:07.560279 14565 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.568588 14921 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:07.619997  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:07.592492  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 153779us
W20260709 12:24:07.622223  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52465.9us
I20260709 12:24:07.623106  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.625424  8138 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:07.628871  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.630228  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.539568 14922 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.631059  8215 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
W20260709 12:24:07.637167  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 115357us
I20260709 12:24:07.568130 14862 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:24:07.638162  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:07.639429  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.643208  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.641413  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:07.648437  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.577035 14928 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.636719 14772 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:07.653810  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.655136  8764 raft_consensus.cc:2393] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 15: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:07.636958 14821 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.655941  8215 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:07.644250 13979 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:07.659119  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.659605  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.661075  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.661716  8217 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:24:07.627892 14565 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.664675  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.664943  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.666100  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.667169  8760 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:07.667898 14922 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.668896 14890 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.631978 14706 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.670722  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.659199 13979 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:07.668015 14947 consensus_queue.cc:1059] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:24:07.674959 13979 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:07.676932  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.682570  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.683427  8764 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:07.653430 14527 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.682698  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.681341 14947 raft_consensus.cc:3055] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:07.636045 14921 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.662253 14855 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:07.703374  8217 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:24:07.706275 14533 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.707226  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.707880 14565 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.707942  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:07.708756 14927 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:24:07.710424 14928 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.711588 14942 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.659198 14772 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.712718 14527 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.714663  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.716526  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:07.656090 14821 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.727872  8216 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:07.674237 14890 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.729489 14875 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.735387  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.730196  8220 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:07.705302 14947 raft_consensus.cc:740] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:07.744547  8764 raft_consensus.cc:3060] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:07.743876  8110 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.726864 14855 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:24:07.731702  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 92338.5us
I20260709 12:24:07.751677  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:07.754060  8213 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:07.754196  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.771135  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:07.778674  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.780025 14954 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:07.746249 14533 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.780665 14954 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.777220 14947 consensus_queue.cc:260] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.781632  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.780797 14917 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:07.759372 14855 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:07.785519 14706 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.785882 14533 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.787247  8139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51464 (request call id 2714) took 1119 ms. Trace:
I20260709 12:24:07.789000 14917 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.789198 14757 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:07.789551 14917 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:07.789644 14757 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.790163 14757 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:07.791492 14919 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:07.787689  8139 rpcz_store.cc:276] 0709 12:24:06.668224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.668405 (+   181us) service_pool.cc:224] Handling call
0709 12:24:06.685312 (+ 16907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:06.975370 (+290058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:06.975433 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:06.979761 (+  4328us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.303916 (+324155us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:24:07.303958 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.304028 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:07.786962 (+482934us) raft_consensus.cc:1685] finished
0709 12:24:07.786994 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:07.787152 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49039,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8239,"thread_start_us":561589,"threads_started":2,"wal-append.queue_time_us":359317}
I20260709 12:24:07.792042 14919 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:07.751892 14875 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.792979  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:07.793012  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:07.793751  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.794037  8139 raft_consensus.cc:2368] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
W20260709 12:24:07.794234 14938 log.cc:927] Time spent T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:24:07.794353  8142 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:24:07.791653 14937 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:07.795763 14937 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.796203 14937 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:07.795344 14939 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:07.799233 14921 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.802687 14837 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.803509 14837 consensus_queue.cc:1059] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:07.804591 14533 raft_consensus.cc:3055] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:07.804994 14533 raft_consensus.cc:740] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:07.783677 14900 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:24:07.794380  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.802819 14911 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.808642  8142 raft_consensus.cc:1275] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:07.784453  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.795369  8139 raft_consensus.cc:1240] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:07.806135 14533 consensus_queue.cc:260] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:07.835598  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 119651us
W20260709 12:24:07.787536 14930 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.306s	user 0.000s	sys 0.004s
I20260709 12:24:07.846541  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.752317 14890 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.857040  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:07.857127  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.857972  8758 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:24:07.858144  8213 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:07.853540  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.854043  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.853542  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.744731 14942 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.858237  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.863636  8765 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
W20260709 12:24:07.867209  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 82838.6us
I20260709 12:24:07.868439  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.872946 14772 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.873456 14935 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.875514 14890 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.875679 14527 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.876472 14879 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:07.879014 14954 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.880499  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1149) took 1040 ms. Trace:
I20260709 12:24:07.867048  8186 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.881021  8067 rpcz_store.cc:276] 0709 12:24:06.840343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:06.840494 (+   151us) service_pool.cc:224] Handling call
0709 12:24:06.840865 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.375492 (+534627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.880264 (+504772us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540011dad4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca8ce01 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2 00007f498adc748c 00007f498adc68c6
0709 12:24:07.880440 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226787200}
W20260709 12:24:07.883823  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 111980us
I20260709 12:24:07.884799  8184 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.886188  8110 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:07.890358  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 62267.9us
I20260709 12:24:07.867659 14533 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:07.892642  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:07.894596 14928 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:07.894721  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.895097 14928 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.895418  8215 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:07.895694 14928 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:07.898027 14706 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:07.900735  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.901347  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.908424  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.911237  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.911778  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:07.912011  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:07.886724 14486 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.914357  8186 leader_election.cc:400] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:07.914544  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.917747  8186 leader_election.cc:403] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:24:07.891301 14879 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:07.922266 14772 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.922937 14920 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:07.915124 14565 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:07.928189  8186 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.917171  8110 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:07.923723  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:07.923059 14942 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.932282 14486 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:07.928942 14772 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:07.936758 14940 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:07.962915 14957 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:07.963802 14959 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:07.964257 14959 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:07.965179 14959 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:07.966077 14855 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.928691 14875 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:07.929148 14565 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:07.973744 14565 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:07.975342 14940 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.975878 14940 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:07.928536 14920 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:07.979300 14920 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:07.961400 14486 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:07.913548 14706 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:24:08.009198 14486 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:07.939144 14629 raft_consensus.cc:2804] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:24:08.015864  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 232929us
I20260709 12:24:08.003350  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.020035  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:08.031491  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91272.2us
W20260709 12:24:08.048072  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 44841.5us
I20260709 12:24:08.053778 14957 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:08.059738  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.060803 14486 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.061425 14486 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.063251 13979 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.065325  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.065518 13979 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.073093  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.074616  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.075250  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.075862  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.077050  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:08.077347 14855 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.077653 14879 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.079571 14772 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:08.080834 14527 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:08.081274 14527 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:08.081642 14527 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:08.060462  8033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.089092  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:24:08.090430  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 45823.4us
I20260709 12:24:08.091830  8729 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.093051 14952 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:08.093622 14952 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.094115 14952 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:08.094810  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.095659  8061 raft_consensus.cc:2393] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:24:08.044413 14963 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:24:08.044137 14960 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:24:08.103824  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52184.9us
I20260709 12:24:08.104877  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.063687 14486 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.110222 14540 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.111009  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.111720  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:08.031169 14890 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:08.123968  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.126152 14890 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:08.126701 14890 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:08.045559 14629 raft_consensus.cc:697] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:08.028261 14757 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.151599 14973 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.152659  8061 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:24:08.152827 14937 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:08.152876  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 61142us
I20260709 12:24:08.157450  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:08.158627  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45492.5us
I20260709 12:24:08.159333  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.153522 14629 consensus_queue.cc:237] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.154225 14875 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.167860  8764 raft_consensus.cc:2468] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:08.096916 13979 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.174942  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.175630  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.179812  8760 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:08.179877  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.183424  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.183183  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.192749  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.198928  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.178366 14922 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:08.201728  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.202445  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.202647  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.187048 14942 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.170331 14772 consensus_queue.cc:1048] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:24:08.208200  8186 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.204792  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.201797  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.204730  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.178326 14540 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.203542  8763 raft_consensus.cc:1275] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:24:08.207376  8213 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:08.205860  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.209415  8184 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.204600  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.184665 14969 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.190687 14857 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:08.215504  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.218691 14970 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:08.203326 14937 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.213874  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.214953 14856 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.221457  8034 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.249734  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.250109  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:08.250613  8034 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.222774 14966 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.224181  8035 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.226163 14920 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.262791  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.263496 14979 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:08.220178 14890 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.265197  8219 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:08.266021 14966 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.266924 14856 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.228924  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.269642  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.242803 14942 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.264448  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.276268  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.174312 14940 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.231897  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.234536 14757 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.174047 14875 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.178594 13979 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:08.209890 14923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.005s
I20260709 12:24:08.204946 14956 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.246093  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.254709  8034 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.273445 14922 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:08.266362 14533 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.228762  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.230430 14917 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.305231  8069 raft_consensus.cc:1240] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21. Ops: []
W20260709 12:24:08.300514 14923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.007s	sys 0.006s
I20260709 12:24:08.291399  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.309172  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.292798  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.310070 14909 consensus_queue.cc:1059] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:24:08.310828 14968 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:08.311497 14946 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:08.312388  8137 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:08.313364 14978 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:08.301501 14922 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:08.315341 14922 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:08.305331  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.317528  8212 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.319605 14909 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:08.320055 14909 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:08.320926 14909 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.322301 14909 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.296559  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.261956 14837 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.329349 14940 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.336158 14952 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.338827 14952 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.339533  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.341107  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.342844  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.304163 14757 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.343703  8068 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 13.
I20260709 12:24:08.348101 14565 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.349080 14822 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:08.340322  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.348114 14928 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.355309  8139 raft_consensus.cc:1240] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:08.355906 13979 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.357203 14856 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.309418  8215 raft_consensus.cc:2376] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22. Re-sending same reply.
I20260709 12:24:08.358690 14920 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:08.298488  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.300041  8214 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:08.255653  8061 raft_consensus.cc:2410] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:24:08.364478  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.364670 14933 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:24:08.300439  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 45819.5us
I20260709 12:24:08.365763  8034 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.365885  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.366667  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.367628  8144 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:08.368279 14920 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:08.301566  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.242837 14540 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.371778 14540 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:08.301610  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.273759 14522 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.248059 14857 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.374511 14857 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.305943  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.287446 14957 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.376230 14957 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.368556  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.378908 14957 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:08.244815 14919 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.380056 14821 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.381479 14890 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.381592 14919 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.314170 14527 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.396070  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.426328  8217 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:08.426755  8212 raft_consensus.cc:2410] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:24:08.427393  8214 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21. Ops: []
W20260709 12:24:08.435925  8728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.440740  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.441643  8066 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:08.442756  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 155653us
I20260709 12:24:08.446627  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.448313  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.448945  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:08.449182  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:08.449882  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.450654  8062 raft_consensus.cc:3060] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:08.457947  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:08.459980  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.462504  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:24:08.463619  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 170542us
I20260709 12:24:08.464591  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.464777  8758 raft_consensus.cc:1240] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:08.466930  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.470940  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.471283  8035 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.471913  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.472746  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.474558  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.478700  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.428020 14822 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.478777  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.487346  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.489388  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.490360  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.491369  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.491493  8035 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.493244  8035 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.495743  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:08.498947  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.405085 13979 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:24:08.482434 14837 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:08.556877  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.557977  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.488706 14533 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:08.563699  8731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.563737  8069 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:08.500996 14736 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:08.499692 14880 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:08.502465 14978 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.568174  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.555900 14890 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.570309 14900 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.571259  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.571911  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.501245 14822 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.575316  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.569854 14932 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.555179 14527 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.557309 14957 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.565088 14486 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.589665  8142 raft_consensus.cc:2393] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:08.591907  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.606590  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76facb821d9488284580418cf9bbf22" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.601648  8062 raft_consensus.cc:2468] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:08.618669  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.594578 14533 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.585543 14880 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:08.623946 14986 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:08.608217 14954 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.626724 14954 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.627399 14954 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.590394 14900 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.630712 14900 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:08.635813  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:24:08.637533 14987 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:08.637768 14981 consensus_queue.cc:1059] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:08.639113 14981 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:08.639545 14981 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:08.639606  8217 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:24:08.642841 14981 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.622637 14533 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.644927 14981 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:08.646206  8066 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:08.646960 14533 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.648691 14855 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.649145  8219 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:08.649300 14855 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.651728 14880 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.660175 14954 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.669680 14954 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.671372 14954 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.674387 14922 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.677209 14922 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.679112  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.681392  8216 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:08.681455 14954 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.690143  8069 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:08.696018  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:08.674049  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.724663  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 231489us
I20260709 12:24:08.726505  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.728232  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.731096 14975 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.735502  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.738395  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.740953  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.741178  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.743553 14875 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.746044  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.739421 14909 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:08.734848 14966 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.758186  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.746045 14959 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:08.762904 14998 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.729321 14969 consensus_queue.cc:1059] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:24:08.763271  8036 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.764019 14969 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:08.764410 14969 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:08.765413 14533 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:08.763285 14947 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:08.767514 14928 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.771317  8762 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:08.772307  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.773160  8140 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:08.777007  8036 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:08.777961 14736 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:08.778401 14736 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.760115 14981 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:24:08.778764 14736 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.779796 15002 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:08.783453  8756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:08.784256  8756 raft_consensus.cc:606] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.784722 14933 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.785327 14933 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:08.787798  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 196024us
I20260709 12:24:08.790778  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.792516  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:08.793292  8062 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:24:08.793572  8063 raft_consensus.cc:1240] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:08.794385  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:08.795985  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.792380 14533 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:08.798198 14533 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.781682 15002 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.807554  8140 raft_consensus.cc:1240] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:08.808847  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.812685  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.820271  8061 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 19.
I20260709 12:24:08.823939  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.802150 15002 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:08.829676 14890 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:08.830296 14890 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:08.830744 14890 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:08.765432 14969 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.833166 14772 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:08.833426 14969 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.833884 14772 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:08.834801 14900 consensus_queue.cc:1175] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "92362bf8983f4a71a3511e987a2c6578" responder_term: 20 status { last_received { term: 20 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 20 index: 15 } }
I20260709 12:24:08.830677  8764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:08.836036  8764 raft_consensus.cc:606] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:08.836409  8764 raft_consensus.cc:614] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:08.838631 14924 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.839339 14855 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.840827 14565 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.841419  8212 raft_consensus.cc:1240] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:08.844633  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.844460  8765 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:08.799355 14935 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.801235 14952 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:08.853205  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.854951  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:08.855181  8035 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.842495  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.863133  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.836441 14772 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:08.866369  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.848834 14959 consensus_queue.cc:1059] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:24:08.867929 14862 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:08.868754 14915 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.870275  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:08.875078  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.834555 14533 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:08.851507 14952 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.878741  8758 raft_consensus.cc:606] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:08.860389 14855 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.871845 14978 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.869838 14968 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.889319  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.890559  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.891155  8212 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:08.892482  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.847961 14981 consensus_queue.cc:1059] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:24:08.891045  8109 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.880829 14527 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.898708  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.899065  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.899959  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.900916  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:08.905608  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.887761 14952 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.909051  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.901383 14921 consensus_queue.cc:1059] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:24:08.910126 14875 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:08.895435 14812 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:08.883167 14757 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:24:08.882910 14932 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:24:08.914943  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:08.917461  8109 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.920048 14878 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:08.920539 14878 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:08.920989 14878 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:08.899276 14956 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.923820 14920 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:08.924271 14920 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:08.925230 14920 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.928850 14527 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.912410 14928 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.931027 14878 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.934131 14878 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.939170  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.939662  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.941604  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.943164  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:08.944280  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:08.947540  8219 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:08.947710  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.947788  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:08.948766  8214 raft_consensus.cc:2393] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:08.951534 14822 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:08.955493 14916 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:08.956009 14916 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:08.961975 14757 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:08.961671 14916 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.962462 14757 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:08.962955 14757 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:08.963092 14947 raft_consensus.cc:993] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:08.963552 14916 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:08.963761 14947 raft_consensus.cc:1081] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:08.916195 14891 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:08.965801 14921 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:08.966331 14921 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:08.966867  8138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:34716
I20260709 12:24:08.967504  8138 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.968123  8138 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:08.967432 14921 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.966472  8212 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:08.969722 14862 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:08.970047 14921 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:08.970201 14862 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:24:08.960489  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61527.7us
I20260709 12:24:08.972999  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:08.986189  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:08.989185  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:08.990547  8064 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:08.993382 14932 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:08.987520 14875 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:08.995851  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.002038 14968 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.999249 14736 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:08.958899 14909 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:08.973316 14878 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.009280 14862 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.014786 14917 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:09.015177 14933 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:08.987212 14891 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:24:08.971916 14928 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:09.021011  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:09.023038 14880 consensus_queue.cc:1048] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:24:09.024133  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.025378 14973 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:09.025938 14973 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:09.026921 14973 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.029004 14975 consensus_queue.cc:1059] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:09.030299 14975 raft_consensus.cc:3055] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:09.030663 14975 raft_consensus.cc:740] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:09.031641 14975 consensus_queue.cc:260] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.037465 14975 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:09.043613  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:09.034690 14933 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:09.037984  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:09.045234  8146 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:09.056248  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:09.066017  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:09.067114  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.067759  8762 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:09.068593  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:09.072467 14736 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:09.076036  8762 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:09.078909  8763 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:09.076329 14862 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.091717 14952 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.064430  8138 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.106477  8138 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:09.107518 14890 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.109859 14890 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:09.111330  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.118695  8138 raft_consensus.cc:1240] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:09.112367  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.113077  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.111649  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:09.119930  8762 raft_consensus.cc:2376] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21. Re-sending same reply.
I20260709 12:24:09.119097  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:09.120787  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:09.121490  8066 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:09.122738  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.124244  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.124823  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.127206  8034 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:09.129603  8070 raft_consensus.cc:1275] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:09.130755  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.135070  8109 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.137317  8146 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:09.078406 14757 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:09.146605  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.147789  8035 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.150027  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.172457  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:09.173357  8066 raft_consensus.cc:606] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.173832  8066 raft_consensus.cc:614] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.176867  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.185016 14955 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.137847 14856 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:09.184840  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.145576 14527 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:09.194211 14952 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:09.197335 14880 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:09.178155 14736 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:09.177961 14772 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.128713 14979 consensus_queue.cc:1059] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:24:09.200037 14856 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:09.149468 14875 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:09.201004 14856 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.206384 15002 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:09.209395  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:09.171710 14911 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:09.211576 15002 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:09.188915 14926 consensus_queue.cc:1059] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:24:09.214170  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:09.214421  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:09.216698  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:09.217629  8146 raft_consensus.cc:1240] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:09.219847  8211 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:09.226486  8064 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:09.227141  8760 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:09.231079  8765 raft_consensus.cc:606] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.231609  8765 raft_consensus.cc:614] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.229112  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.233314  8067 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:09.233665  8758 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:09.257642  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.262310  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.233003 14942 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:09.259497  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:09.266309  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:09.267004  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.267280  8758 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:09.248781 14812 raft_consensus.cc:3055] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:09.267194  8070 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:09.270886  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.248163 15007 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:24:09.279968  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:09.280781  8216 raft_consensus.cc:2393] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 19: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:09.280965  8184 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.271272 13979 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:09.265869 14941 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:09.291076  8067 raft_consensus.cc:2468] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 21.
I20260709 12:24:09.272951 14812 raft_consensus.cc:740] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:09.267549 14880 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 12:24:09.289594  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 139644us
I20260709 12:24:09.281668 14955 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:24:09.342190  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.338404  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.285190 14772 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:09.355424 15010 log.cc:927] Time spent T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:09.355849 14920 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.357350  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:09.358037  8762 raft_consensus.cc:606] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.358394  8762 raft_consensus.cc:614] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.292493 14736 consensus_queue.cc:1059] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:24:09.369076 14812 consensus_queue.cc:260] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.370446 14812 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:09.371089  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:09.377121 15012 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:09.378311 15012 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:09.297765 14941 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.378669 15012 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.379573 15012 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:09.380432 14941 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:09.365427 14917 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:09.380942 15012 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:09.385779  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:09.389173  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.390625 15013 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.392985  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:09.399945  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:09.410898 14565 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:09.413718  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:09.399839 14917 raft_consensus.cc:2764] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:24:09.424348 14975 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:09.424901 14975 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:09.425781 14975 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.427000 14975 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:09.430419  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.415892 14757 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:09.409123 14928 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:24:09.452339 14928 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:09.452821 14928 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.453725 14928 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:09.462754  8729 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:09.431015  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 143567us
I20260709 12:24:09.434980 14941 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:09.486492  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56198.4us
I20260709 12:24:09.477511  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:09.505059  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:09.506994  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 12:24:09.509522  8212 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:09.483533 14522 raft_consensus.cc:2804] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:24:09.511117 15020 log.cc:927] Time spent T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:24:09.511377 15017 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.494176 14928 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.517267 14973 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:09.506737 15016 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:09.520962 15016 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.521365 15016 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:09.516165  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.529518 14875 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:09.529954  8109 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.530181 14875 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:09.530858 15019 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.531785 14522 raft_consensus.cc:697] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:09.532579  8068 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:09.532840 14522 consensus_queue.cc:237] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.533793 15019 consensus_queue.cc:1048] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:09.539940 14880 consensus_queue.cc:1059] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:09.531157 14915 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:09.541097 14915 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:09.541877 14565 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:09.542407 14565 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.542106 14915 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.543071 14979 raft_consensus.cc:3055] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:09.543567 14979 raft_consensus.cc:740] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:09.543385 14565 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:09.545351 14979 consensus_queue.cc:260] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.546998 14979 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.543598 14915 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:09.552924 14875 raft_consensus.cc:3060] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.564239  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.572059  8066 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:09.577629  8070 raft_consensus.cc:1240] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:09.577629  8067 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:24:09.580807  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66326.3us
I20260709 12:24:09.590308 15016 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.591200  8063 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:09.593175 15016 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:09.593930  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.596688  8067 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:24:09.597514  8068 raft_consensus.cc:1240] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:09.602366  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:09.607026  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:24:09.609977  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.610386  8109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.614310  8758 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:09.614111 14922 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:09.619946  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.620988  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.621619  8068 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:09.621809  8729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.627023  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.629470  8109 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:09.633673  8068 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:24:09.634855  8756 raft_consensus.cc:1275] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:09.646046  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:09.646687  8758 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:09.653770  8035 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:09.654757 14920 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:09.664505 14937 raft_consensus.cc:2764] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:24:09.665299  8109 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.666620 14937 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:09.667274 14937 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.667308  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.668787 14878 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:09.668551 14937 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.669337 14878 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.671172  8109 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.636765 14880 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:09.673362 14880 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:09.636999 14917 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:09.673791 14878 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.673801 14880 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:09.686874 14880 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.689890 14942 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:09.694267 14928 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:09.694881 14928 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.695816 14928 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.700753  8220 raft_consensus.cc:1240] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:09.706784  8758 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:24:09.711839  8763 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:09.714812  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:09.728102  8765 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:24:09.727185 14917 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:09.724223 14891 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:24:09.768190  8184 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:09.813967  8760 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:09.766889 14917 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:09.807755 14937 consensus_queue.cc:1048] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 12:24:09.822067  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 98913.2us
I20260709 12:24:09.776317 14955 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:09.768946 14565 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:09.833812 15031 consensus_queue.cc:1059] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:09.831740 14955 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:09.828984 14954 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:24:09.885927 14917 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:09.994228 14812 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.011s
W20260709 12:24:09.996771  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 164617us
W20260709 12:24:09.985949 15022 log.cc:927] Time spent T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.180s	user 0.000s	sys 0.005s
I20260709 12:24:10.001299 14955 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:09.985844 14565 consensus_queue.cc:1059] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:09.989156 14875 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.011528 14875 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:09.990962 14822 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:10.012305 14822 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.014557 14822 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:09.990314  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103396us
I20260709 12:24:09.831508 14915 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.016865 14915 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.019222 14915 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:10.022508  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.026861  8140 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:24:09.900053  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65371.1us
I20260709 12:24:10.032784 14565 consensus_queue.cc:1059] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:10.047209 15013 raft_consensus.cc:3055] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:10.047397 14928 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:10.047675 15013 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.047816 14928 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.048617 15013 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.050151 15013 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:10.045665 14880 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.055166  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:10.048617 14928 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.058806 14928 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:10.050195  8141 raft_consensus.cc:3055] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:10.061450  8141 raft_consensus.cc:740] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.062311  8141 consensus_queue.cc:260] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.063366  8141 raft_consensus.cc:3060] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:10.064486  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:09.609037  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.070240  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:10.072055 14880 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:10.072798 14880 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.073909 14880 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.072163  8063 raft_consensus.cc:1240] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:24:10.029124 15012 consensus_queue.cc:1059] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:24:10.091706  7963 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 261) took 53750 ms (client timeout 15000 ms). Trace:
W20260709 12:24:10.092334  7963 rpcz_store.cc:269] 0709 12:23:16.349957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.361097 (+ 11140us) service_pool.cc:224] Handling call
0709 12:23:17.716756 (+1355659us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001a5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f6090 00007f498ca94f3a 00007f499284ae9c 00007f499294904e 00007f4990e0a2a4 00007f4990e0a232 00007f4990e0a161 00007f4990e0a0dc 00007f4990e09392 00007f498adc748c 00007f498adc68c6
0709 12:24:10.091542 (+52374786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.428964 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.429633 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.429683 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:24:07.429700 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:07.430443 (+   743us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.430540 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.430568 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:07.494569 (+ 64001us) tablet.cc:701] Row locks acquired
0709 12:24:07.494627 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:24:07.494828 (+   201us) write_op.cc:270] Start()
0709 12:24:07.495000 (+   172us) write_op.cc:276] Timestamp: P: 1783599847494745 usec, L: 0
0709 12:24:07.495044 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:24:07.649026 (+153982us) log.cc:844] Serialized 2084 byte log entry
0709 12:24:08.159388 (+510362us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54001a5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca87e28 00007f49904c2581 00007f49904c1d58 00007f49904c69f1 00007f49904c69a9 00007f49904c6939 00007f49904c6901 00007f49904c5b2d 0000000000388634 0000000000388479
0709 12:24:08.481804 (+322416us) op_driver.cc:464] REPLICATION: finished
0709 12:24:08.629530 (+147726us) write_op.cc:301] APPLY: starting
0709 12:24:08.629641 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:08.664746 (+ 35105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:08.664793 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:08.686198 (+ 21405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:08.686563 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:24:08.686638 (+    75us) write_op.cc:312] APPLY: finished
0709 12:24:08.687019 (+   381us) log.cc:844] Serialized 57 byte log entry
0709 12:24:08.687239 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.691663 (+  4424us) write_op.cc:454] Released schema lock
0709 12:24:08.691741 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:08.729173 (+ 37432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.730151 (+   978us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1898172,"reported_tablets":49,"spinlock_wait_cycles":329483520,"child_traces":[["op",{"apply.queue_time_us":147383,"apply.run_cpu_time_us":10961,"apply.run_wall_time_us":84174,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":590033,"prepare.run_cpu_time_us":31273,"prepare.run_wall_time_us":730643,"raft.queue_time_us":285830,"raft.run_cpu_time_us":6034,"raft.run_wall_time_us":131201,"replication_time_us":986570,"spinlock_wait_cycles":50075392,"thread_start_us":857353,"threads_started":4,"wal-append.queue_time_us":266029,"wal-append.run_cpu_time_us":39044,"wal-append.run_wall_time_us":1762335}]]}
I20260709 12:24:10.098469  8070 raft_consensus.cc:2468] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:10.102211  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:10.108596  8212 raft_consensus.cc:2393] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:10.111438  8109 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:10.115617  8763 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:10.115754  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:10.115123  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.119154  8211 raft_consensus.cc:2393] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:10.119300  8141 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:24:10.119771  8141 pending_rounds.cc:85] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 14
I20260709 12:24:10.120292  8109 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:10.121635 14935 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.122136 14935 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.119123  8137 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:24:10.120106  8141 pending_rounds.cc:107] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:24:10.136024  8141 raft_consensus.cc:2889] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:10.145118 15035 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:24:10.136305 14875 raft_consensus.cc:2804] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:10.153898 14875 raft_consensus.cc:697] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.154150 14917 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:10.154369  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:10.155269  8068 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:10.154873 14875 consensus_queue.cc:237] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.155329 14917 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.159912 14920 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:10.160954 14736 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.161514 14736 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.163492 14917 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.166560  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:10.178797  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:10.180743  8066 raft_consensus.cc:1275] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:10.183240 15016 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:10.183777 15016 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:10.195850  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:10.202912  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 66852.1us
I20260709 12:24:10.214044  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.202948 14522 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:10.217811 15042 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:24:10.219256  7961 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 16, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 16 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:10.194347 15016 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:10.238644  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 111302us
I20260709 12:24:10.198516 14915 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:24:10.253793  8220 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:10.259933  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60332.9us
I20260709 12:24:10.269436  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:10.270143  8764 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:10.262452 14935 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.283363  7961 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.304860 14736 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.343971  8212 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:10.347728 15019 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:10.354387 14891 raft_consensus.cc:3055] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:10.354863 14891 raft_consensus.cc:740] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:10.355712 14891 consensus_queue.cc:260] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.371336  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:10.372234  8762 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:10.372087 14955 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:10.383473 14955 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.385705  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.307703  7961 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:10.392256  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:10.394119  8762 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:10.395006  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:10.386427  8140 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:10.418934  8220 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:10.367967 15016 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.415783 14979 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:10.419483 14822 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:10.436580  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:10.437481  8068 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:10.406566 14921 consensus_queue.cc:1048] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:24:10.439735 14736 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.445055 14736 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.447784 14736 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.449947  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:10.450816  8220 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:10.458601  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:10.458603 14955 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.459944 15016 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:10.461469  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:10.432169 14822 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.463071 14822 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:10.464892  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:10.465764  8070 raft_consensus.cc:2393] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:10.466990 15016 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:10.467594 15016 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.469527  8137 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:24:10.470007 15016 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:10.430733 15036 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:24:10.471138 15033 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:10.432601 14979 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.472905 14979 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:10.474634  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:10.406570  7961 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:10.477681 14957 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:10.478258 14957 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:10.478353  7961 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 8 to 12, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 12 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:10.479285 14957 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.483126 14891 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:10.483426  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.497676  8070 raft_consensus.cc:1240] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:10.484167  8137 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:10.501055  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:10.501925  8070 raft_consensus.cc:2393] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:10.503484  8219 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:10.503980  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:10.504681  8216 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:10.509903  8762 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:10.512841  8765 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:10.516310  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:10.516968  8765 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
W20260709 12:24:10.518556  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60072us
I20260709 12:24:10.519260 14917 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:10.520012 14968 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:10.520473 14968 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.520908 14968 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:10.520828 14891 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:10.521437 14917 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:10.526580  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:10.527505  8762 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:10.517948 15016 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:10.542550  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:10.545981  8068 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:24:10.600085  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51294.7us
I20260709 12:24:10.623651 14822 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.626124 14880 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:24:10.631270 14822 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:10.635769  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:24:10.628799  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 79363us
I20260709 12:24:10.541217 15016 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:10.548952 14989 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:24:10.655861  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 99772.4us
I20260709 12:24:10.644982 15002 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.665539 15002 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.678068  8220 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:10.646870 15016 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:10.649361 14989 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:10.751425  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:24:10.755972  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 109760us
I20260709 12:24:10.756978  8765 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:10.748903 14989 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:10.752556  8758 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:10.826833  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68692.4us
I20260709 12:24:10.774910 14522 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.841671  8758 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:10.813850 14879 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.818795 14935 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:10.835661 14932 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.834066 14917 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:24:10.949731  8219 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:10.957352 14970 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.958006 14970 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:10.958901 15055 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:24:10.960139 15062 log.cc:927] Time spent T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:24:10.960397 15057 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
W20260709 12:24:10.962675 15054 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 12:24:10.968048 14979 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.981592  7961 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 12 to 15, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.844156 14522 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.910115 15002 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:10.997836  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:10.915639 15077 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:10.998577  8143 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:10.871635 14935 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:10.868814 14879 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:10.875288 14932 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.078091 14879 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.080940 15075 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.082084 14935 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.081785 15075 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.069672 14527 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.087523 14527 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.087908  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:11.088847 15031 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.089784 14527 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.089159  7961 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 3 to 7, term changed from 7 to 13, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130), VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 13 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:11.089448 15031 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.090706 14937 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:11.092702 15031 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.111141  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.114655  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.000502 15071 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.121227  8065 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:11.126379  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.127061  8146 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
W20260709 12:24:11.135872  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45437.5us
I20260709 12:24:11.136346  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.137686  8061 raft_consensus.cc:2410] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:24:11.148110  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.148885  8211 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:11.151602  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:11.010537 15077 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.135355 15071 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.000862 15073 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:11.165797 14522 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.167220 15071 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.091982  7961 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:11.171846 15077 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.148295 15078 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:11.173853  8066 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 15.
I20260709 12:24:11.148993 15075 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:11.154394 14968 consensus_meta.cc:287] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.002s
I20260709 12:24:11.158473 15002 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.176287 14928 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:11.167234 14932 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:11.188117  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67080.8us
I20260709 12:24:11.181886 15078 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.190155 14928 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.208360  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:11.184706 14968 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.200343 15078 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:11.187861 15002 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.204087 14979 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:11.212713  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61201.5us
I20260709 12:24:11.204665 14928 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.179930 15073 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.212654 14955 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.211797 15081 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:11.237284 15081 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.237751 15081 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:11.242292 15073 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.217583 15075 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.243016 15075 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.245316 15075 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.216787 15074 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.216475  7961 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 12 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.276944 14928 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.282796 14928 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.268149 15089 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.285961 15089 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.267057 14955 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.268422 14957 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.290343  8067 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:24:11.294788 15087 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.290009 14957 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.295454 15087 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.297979 15087 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.300110  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:11.300714  8214 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.300884  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.301397  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.301573 15017 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:11.302353  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.302827  8215 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:24:11.303088  8066 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 21: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:11.303550 15017 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:11.303972 15017 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.308799  8214 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:11.268862 14879 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.288375 15089 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.298039 14957 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.304334 15017 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:11.305150 14968 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.326738  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.329107  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.331809  8068 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:11.326212  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:11.333943 15086 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:24:11.335220 14970 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.341922 15002 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:11.342238 15059 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.803s	user 0.003s	sys 0.009s
I20260709 12:24:11.328050  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.329264 14879 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.344187  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:11.344761  8217 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:11.345536 14879 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.346496  8213 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:11.347895  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.348757  8067 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 13.
W20260709 12:24:11.350605 14989 consensus_meta.cc:287] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.005s
I20260709 12:24:11.351097 14989 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.352505  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.353299  8067 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 19: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:11.353957  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.348459  8213 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 18.
I20260709 12:24:11.359246  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.360386  8215 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 22: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:11.361706  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.364001  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.362354  8068 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:11.365427  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.366389  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:24:11.329190 15016 consensus_meta.cc:287] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 12:24:11.330086  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.368649  8218 raft_consensus.cc:2393] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 14: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:11.271817 15074 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.331657  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:11.370872  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43673.9us
I20260709 12:24:11.375567  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.380784  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:11.381019  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:11.407128  8215 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
W20260709 12:24:11.408694  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51570.7us
I20260709 12:24:11.409754  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.407202  8063 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.411646  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.329572 14928 consensus_queue.cc:1059] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:24:11.410481  8065 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 19.
I20260709 12:24:11.423763  8064 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:11.416978  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.379573 14522 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:11.418179  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:11.431152  8061 raft_consensus.cc:2393] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 16: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:11.431206  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.401430 15052 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:11.417097  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.433818  8218 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 14.
I20260709 12:24:11.402380 14922 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:11.373315 15016 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.415717 14890 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:11.427503 14954 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:11.433275 14522 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.475241  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:11.441370  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 64820.2us
I20260709 12:24:11.454262  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.477531  8141 raft_consensus.cc:2368] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:11.478479  8110 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:11.443533  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.427256 15089 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.445891  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.483212  8140 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:11.459527  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.465408  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.433027 15052 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.476078  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:11.490811  8146 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.476250  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.496873  8145 raft_consensus.cc:2393] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 22: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:11.480309  8137 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:11.438271 14937 raft_consensus.cc:476] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:11.481778  8214 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:11.479591  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:11.487368  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 70373.4us
I20260709 12:24:11.498904  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:11.477579 15064 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:11.479140 14522 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:11.505334  8063 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:11.445024 14922 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.506415 15052 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:11.539322 14928 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:11.485469 14891 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:11.485357 14989 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.478048 14890 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:11.490475 15075 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.554260  8140 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:24:11.544847  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57472.1us
W20260709 12:24:11.507319 15055 log.cc:927] Time spent T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:11.571592  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.574782 15074 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.574255 14890 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.546703 15064 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:11.577579  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 98034.1us
W20260709 12:24:11.600152  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 101407us
I20260709 12:24:11.601132  8036 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:11.606132  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:11.607592  8214 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:24:11.491509 15089 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.605036  8146 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:11.560467 14891 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:11.614338  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:11.614974 15092 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:11.615526  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.616605  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.575354 15067 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.596267 14875 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:11.599790 15064 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.629333  8140 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
W20260709 12:24:11.630805  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 62439.5us
I20260709 12:24:11.607224 14736 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:11.595443 14956 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:11.636300  8036 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:11.606117 14922 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.566184 14937 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:24:11.587136 15075 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.635516  8142 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
W20260709 12:24:11.623322  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46274.6us
I20260709 12:24:11.636713 15102 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:11.632107  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:11.658224 15073 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:11.650913 15101 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:11.663298 14928 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:11.665230 14921 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:11.683681 15081 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.674692 15102 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.637156 14875 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.688510 15101 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:11.689450 15058 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.885s	user 0.000s	sys 0.010s
I20260709 12:24:11.675405 15016 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:11.698652 15096 log.cc:927] Time spent T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:24:11.699143 15073 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:11.634150 15067 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.699949 14928 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.688083 15078 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.704277  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:11.799651  8765 raft_consensus.cc:606] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:11.800164  8765 raft_consensus.cc:614] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:11.659122 14956 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.674574 14891 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.707937 14955 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.709349 15089 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.756860 15102 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:11.793614 15111 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.801019  8070 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:11.803148 15073 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.758741 14875 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:11.732448 14921 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.766633 14937 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:11.808002  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 125309us
I20260709 12:24:11.751809 15101 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:11.755087  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 96223.5us
I20260709 12:24:11.813687  8212 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:11.807266 15116 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:11.823825  8186 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:11.825685  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.771072 15106 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.788221 15107 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:11.817272  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.817272  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.829532  8063 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 20.
I20260709 12:24:11.805186 15016 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.824761  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:11.824971  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:24:11.812124  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 148566us
I20260709 12:24:11.838008  8186 leader_election.cc:400] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:11.843063  8186 leader_election.cc:403] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:11.819929 14975 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.822609 14891 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:11.876835 15068 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:11.877904 14954 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.878355 14954 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:11.883667 15078 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.885550  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:11.883670  8137 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:11.883735 14975 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.841238 14736 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:11.894292 14736 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:11.877206 15113 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:24:11.895076 14956 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.895236 14736 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:11.887683  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56005.5us
W20260709 12:24:11.887538  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 65824.1us
W20260709 12:24:11.891908  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 46022.6us
I20260709 12:24:11.841061 14989 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:11.902777  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:11.830801 15116 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.907706  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:11.909204 15116 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.817111 15111 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.825982 14937 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.918681  8765 raft_consensus.cc:606] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:11.925705  8765 raft_consensus.cc:614] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:11.840464 15016 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.843768 15107 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.845237 15052 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.904276 15075 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.853734 15106 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:11.944437 15015 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:11.951175 15083 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:11.945827 15113 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:11.972179  8146 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:11.986290 14937 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:11.978627 15083 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.990132 15083 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.976317 15015 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.997062 15015 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.999454 14875 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.001423 15064 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.003019  8061 raft_consensus.cc:2393] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 22: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:11.997100 14975 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:11.980257 15113 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.005342 14975 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.007691 15113 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.013176 14975 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.011545  8138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34716 (request call id 1356) took 1518 ms. Trace:
I20260709 12:24:12.016460  8138 rpcz_store.cc:276] 0709 12:24:10.492820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.493001 (+   181us) service_pool.cc:224] Handling call
0709 12:24:10.493379 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.493753 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.493785 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.494301 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:24:10.530040 (+ 35739us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:24:10.530079 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.530155 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.341677 (+811522us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f498c62786e 00007f498c626bb6 00007f498c6267d8 00007f498c630221 00007f498c6301d9 00007f498c630169
0709 12:24:12.010639 (+668962us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b24000fb438. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898259c4 00007f4989823acb 00007f49899dedc9 00007f49899dea55 00007f49899ddfb0 00007f498c654488 00007f498c654be8 00007f498c62c398 00007f498c62776a 00007f498c626bb6
0709 12:24:12.011306 (+   667us) raft_consensus.cc:1685] finished
0709 12:24:12.011329 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.011480 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":58,"spinlock_wait_cycles":34728960,"thread_start_us":35412,"threads_started":1,"wal-append.queue_time_us":44273}
I20260709 12:24:12.022990 15061 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:12.023504 15061 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:12.023866 15061 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:12.024297 15017 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.007s
I20260709 12:24:12.025485 14921 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.027004 14921 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:12.027496 14921 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.030562 15107 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.030843 15106 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:12.031876 15110 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:12.038476 15067 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.039121 15067 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:12.039638 15067 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:11.984436 14954 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.042801 14954 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.043370 14979 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:12.043916 14979 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.046005 14979 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.050400 15067 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:11.947319 15081 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.054729  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.057583  8064 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:12.063119  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.063849  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.063997 15100 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:12.060096 14522 consensus_meta.cc:287] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:24:12.064602 15100 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.064963  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.065135 14522 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.076090 14522 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.073334 15100 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.066012 15115 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:12.078413 15115 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.078900 15115 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:12.079002 15016 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.080785 14921 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.082350 15052 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.056767 15017 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.085209 15017 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.087728  8215 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:12.091462  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:12.091917  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:12.092470  8146 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:12.094394  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.095775  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:12.096526  8137 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:12.099150  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:12.099900  8142 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:12.088361 15115 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.102663  8138 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:12.094509  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.106134  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.004448 15064 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.115006  8140 raft_consensus.cc:2393] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 21: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:12.116854 15111 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.120745 15115 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.123507  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.133100  8067 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:12.127794  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.133914  8215 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:12.145732  8219 raft_consensus.cc:1275] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:12.159343  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.159541  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:12.162938  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 287558us
I20260709 12:24:12.144115 14954 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:12.146931 14736 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:12.165961  8137 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:12.173749  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.174273  8186 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:12.174937  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 272245us
I20260709 12:24:12.177358  8067 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:12.179262  8109 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:12.179771  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 336960us
I20260709 12:24:12.182942  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.182126  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.187505  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.185002  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.190452  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.190836  8146 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:12.195722  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.197146  8063 raft_consensus.cc:3060] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:24:12.198488  8765 raft_consensus.cc:1240] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:12.194007  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.195333  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:12.200985  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.182714 14891 raft_consensus.cc:2804] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:12.190088 15066 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:12.228983 14891 raft_consensus.cc:697] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:12.229986 14891 consensus_queue.cc:237] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.205060  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.180279 14954 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.206137  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.233408  8068 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:12.234930 14975 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.194169 15123 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:24:12.206259  8110 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:12.202361  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.183866 14736 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.217780 14875 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.239665  8036 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.240972  8186 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:12.242818  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:12.222510  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.222841 15102 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.227923 15101 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.205942 15083 consensus_queue.cc:1048] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:12.251300  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.253149  8141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.254187  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.258211  8141 raft_consensus.cc:1240] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:24:12.258520  8139 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:24:12.258849  8139 pending_rounds.cc:85] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting all ops after (but not including) 13
I20260709 12:24:12.259064  8139 pending_rounds.cc:107] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:24:12.259310  8139 raft_consensus.cc:2889] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:12.234700 14954 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.244138  8067 raft_consensus.cc:2393] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
W20260709 12:24:12.245741  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 369206us
I20260709 12:24:12.247330  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.261551  8068 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
I20260709 12:24:12.291791  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:12.291702  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.240072  8142 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:12.263841  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.264403  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.293927  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.264724  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.266273  8063 raft_consensus.cc:2468] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:24:12.259665  8110 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:12.248863 15123 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:12.265077  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.271144 15101 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.271786  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.274644  8066 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:24:12.244524 15109 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:12.240833 15017 consensus_queue.cc:1059] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:24:12.308732 15105 raft_consensus.cc:2764] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:24:12.280501  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.309574 15033 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:12.283174  8036 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.311000 15033 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:12.311749 15069 raft_consensus.cc:3055] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:12.312140 15069 raft_consensus.cc:740] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:12.312749 14954 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:12.313346 14954 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:12.312966 15069 consensus_queue.cc:260] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.314110 15069 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:12.314265 14954 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.283962 15081 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:12.315459 15081 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:12.284997  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:12.260875 14875 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:12.287609  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.317335 15038 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:12.296860  8729 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:12.294765  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.286530 14736 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:12.286688  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.318820 15102 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:12.320006 15123 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:12.320952 15123 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.324072 15125 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:12.302337  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.301023  8143 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:12.309927  8065 raft_consensus.cc:2368] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:12.318884 15118 raft_consensus.cc:2804] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:12.288411 14942 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:12.304390  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.311067  8036 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.318753  8220 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:12.286046 15066 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:12.290773  7961 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.017s	sys 0.010s
I20260709 12:24:12.341645  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.357374  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:12.361392  8142 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:12.360862  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 56845.5us
I20260709 12:24:12.365649  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.368115  8217 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:12.369434  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.369357  8142 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:12.337805 14942 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:12.324600 15125 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:12.385756  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.372668  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.372668  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.373903  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:12.360492  7961 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.018s	sys 0.010s
I20260709 12:24:12.375972  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.370913  8036 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:12.379804  8144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.389480  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.384615  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.391280  8142 raft_consensus.cc:2393] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 22: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:12.316342 15081 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.364779 15118 raft_consensus.cc:697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:12.413450  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:12.420823  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:12.421409  8218 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:24:12.423552  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.385470 14942 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:12.413805  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.412910 15074 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:12.428022  8220 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
I20260709 12:24:12.430745  8217 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:12.356535 15061 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.432430  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.390342 15116 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:12.434393  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47456.4us
I20260709 12:24:12.438621  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.439677 15052 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:12.440107  8731 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.441102 15052 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:12.430394 15092 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:12.436138  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.454821  8035 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.458380  8758 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:12.459978  8070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:12.433944 15016 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:12.460618  8070 raft_consensus.cc:606] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.470237  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.444036 15111 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:12.451715 15074 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:12.458189 15078 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:12.494572  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.461925 15075 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:12.506896  8184 leader_election.cc:400] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:12.507347  8184 leader_election.cc:403] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:12.507244 15130 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:12.508581 15131 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:12.509267 15131 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.511437 15095 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:12.551023  8218 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
W20260709 12:24:12.554049  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58380.3us
I20260709 12:24:12.561196  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.557641  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:12.513262 14956 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:12.518034 15095 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
W20260709 12:24:12.558135 15134 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:12.551765 15066 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 21. Current term is 22.
I20260709 12:24:12.581876  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.591512  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:12.573243 15123 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:12.479724 15125 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.638187  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.638937  8762 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:12.515654 15118 consensus_queue.cc:237] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.566855 14957 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:24:12.594240 15131 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.685549  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:24:12.695139  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 146197us
W20260709 12:24:12.697090 15137 log.cc:927] Time spent T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:24:12.703138  8762 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
W20260709 12:24:12.705235  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.696527  8110 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:12.705493 15061 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.707605 15095 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.722954  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.723672  8763 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:24:12.725620  8219 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:24:12.726902 14879 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:12.730127 14879 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:12.589309 15074 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.734772 14879 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:12.734961 15140 log.cc:927] Time spent T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:24:12.714604 15083 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:12.767439 15052 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:12.777781  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.778716  8763 raft_consensus.cc:2468] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
W20260709 12:24:12.781962  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.797762  8064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:12.732424 15100 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:24:12.817900  8758 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:12.768329 14942 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:12.829499  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.830148  8763 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:12.835040  8216 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:12.837983  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.838846  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:12.845645  8764 raft_consensus.cc:1275] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:24:12.846112  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.846596  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.847313  8759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.847421  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.847697  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.848815  8759 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:24:12.858806  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:12.860651  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:12.862835  8765 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:12.869740  8140 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:12.878489  8216 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:12.883409  8765 raft_consensus.cc:3060] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:12.892575  8184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.182.132:35761 timed out after 1.688s (SENT) [suppressed 2 similar messages]
I20260709 12:24:12.931762  8066 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:12.932358  8763 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 17.
W20260709 12:24:12.942027  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68001us
W20260709 12:24:12.963770  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 92971.7us
I20260709 12:24:12.967031 15015 consensus_queue.cc:1059] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:12.967895 14942 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:12.968104 15015 raft_consensus.cc:3055] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:12.968654 15015 raft_consensus.cc:740] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:12.969694 15015 consensus_queue.cc:260] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:12.977684  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 95888.5us
W20260709 12:24:13.062263  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83778.9us
W20260709 12:24:13.061721  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 162179us
I20260709 12:24:12.977669 15123 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.060505 15081 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.088929  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:13.090195  8143 raft_consensus.cc:2368] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20.
W20260709 12:24:13.101044  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 208464us
I20260709 12:24:13.091609 15017 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:13.127349  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 56299.8us
I20260709 12:24:13.139412  8765 raft_consensus.cc:1275] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:24:13.149688  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.151089  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.151947  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:13.092105 15123 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.153961  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:13.154911  8070 raft_consensus.cc:2368] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20.
I20260709 12:24:13.155668  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.155893 15123 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.103163 15081 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.159480 15081 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.168407  8213 raft_consensus.cc:2393] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 17: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:13.121075 15073 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.176007 15162 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:13.176757 15162 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.179514 15162 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:13.180099  8730 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.181154 15080 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.181811  8730 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:13.183223  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.183301 15080 raft_consensus.cc:2749] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:13.183983 15052 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:13.185729  8184 leader_election.cc:400] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20.
I20260709 12:24:13.186142  8184 leader_election.cc:403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:24:13.186775 15067 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20.
I20260709 12:24:13.188396  8186 leader_election.cc:400] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Vote denied by peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085) with higher term. Message: Invalid argument: T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20.
I20260709 12:24:13.205137  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.206457  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:13.207139  8214 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.160952 14890 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:24:13.173447 15155 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:13.218791  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.126030 15017 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.202937 15123 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.224376  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:13.241165  8184 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.220024 15067 consensus_queue.cc:1048] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:24:13.250861 14956 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:13.238998 15068 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:13.214334 15113 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:24:13.255836  8184 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:13.256731  8214 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 15.
W20260709 12:24:13.267097  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 324357us
I20260709 12:24:13.205809 15073 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.270483  8142 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:13.220741 14890 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.289760  8034 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:13.268788 15068 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:13.261092 15162 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.312047  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.314369  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:13.315099 15147 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.675s	user 0.017s	sys 0.014s
W20260709 12:24:13.307386  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 68882.5us
I20260709 12:24:13.288450 15067 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:24:13.296697 15074 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:24:13.312460 14932 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.349225 14880 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.349893 14880 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.242722 15123 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:13.364900  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67006.2us
I20260709 12:24:13.368110  8034 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:13.365515  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 97333us
I20260709 12:24:13.379184  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:13.381353  8034 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:24:13.396147  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.398825  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.407323 15162 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.416266 15123 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.416981 15175 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:13.420382 14890 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.423827 15017 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.384542 14954 raft_consensus.cc:2764] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 12:24:13.430727  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 138119us
I20260709 12:24:13.433565  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.444262 15123 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.444865 15123 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.445416  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.446982 15123 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.447788  8143 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:24:13.453253  8063 raft_consensus.cc:1240] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:13.453984 15073 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.455057  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.455089 15081 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:13.458148  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.459733  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:13.409718  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 66846.3us
I20260709 12:24:13.463560  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.436097 14880 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.464601  8063 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:24:13.466012  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
W20260709 12:24:13.467238  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 85908.8us
I20260709 12:24:13.466825  8062 raft_consensus.cc:2468] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:24:13.463431 14932 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:13.482919  8220 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:13.469981  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:13.485869  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.484799 14932 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:13.493216 14932 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:13.508150  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.508728  8212 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:24:13.509158  8212 pending_rounds.cc:85] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 7
I20260709 12:24:13.509034  8758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:13.509388  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.509668  8758 raft_consensus.cc:606] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:13.510006  8217 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:13.509423  8212 pending_rounds.cc:107] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:24:13.510748  8212 raft_consensus.cc:2889] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:13.511768  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.484812 15176 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:24:13.517614  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:13.518173  8765 raft_consensus.cc:606] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.510306 15081 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:13.518561  8765 raft_consensus.cc:614] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:13.518757 15081 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:13.528764 15073 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.520438  8761 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:24:13.529171  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:13.533357  8765 raft_consensus.cc:606] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.533795  8765 raft_consensus.cc:614] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:13.535197  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:13.519723 15081 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.538312 15073 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.538975  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.552906  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.553838 15015 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:13.554248  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.564716  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.578184  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.578912  8757 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:13.580227  8142 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:13.587714 15073 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.589614  8220 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:24:13.590451  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49244 (request call id 2523) took 1325 ms (client timeout 1504 ms). Trace:
W20260709 12:24:13.590874  8216 rpcz_store.cc:269] 0709 12:24:12.264648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.264864 (+   216us) service_pool.cc:224] Handling call
0709 12:24:13.590267 (+1325403us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54002251d4. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca902fa 00007f4991a51b17 00007f498afcc6d4 00007f498afcc662 00007f498afcc591 00007f498afcc50c 00007f498afcb7c2 00007f498adc748c 00007f498adc68c6 00007f498adc626f
0709 12:24:13.590369 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229545216}
I20260709 12:24:13.583935 15109 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.593159 15109 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.649286  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.653278  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.656193  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.659020  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.666049  8146 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:24:13.621033 15105 consensus_queue.cc:1048] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:24:13.685576  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.661690 14957 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.694993  8109 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:13.695576 15095 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:13.696141 14928 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:13.661612 15109 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.649629 14954 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:24:13.701068  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.700546  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.703939  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.711333 14921 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:13.711340  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:13.712164 14911 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.712714 14911 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.714529 14911 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.697058 15176 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:24:13.714948  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.716390  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.667071 14932 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.743840 15070 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:13.752123 15070 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.752578 15070 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:13.753921  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44956.5us
I20260709 12:24:13.757247  8034 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:13.758401  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:13.759737 14911 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:13.761454 15171 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:13.762399  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.763720  8184 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.766440 15174 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:13.768533  8063 raft_consensus.cc:1240] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:13.733465 14942 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:13.767843 14932 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.768849 15174 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.771814  8184 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:13.745321 15185 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:24:13.775354  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:13.777896  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.779554  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:13.776214 15095 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:13.777750  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:13.783774  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.783918  8035 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.789280 15162 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:13.789744 15162 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.790124 15162 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:13.792800 15189 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:13.793488 14879 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:13.776805 15017 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:13.776612 15174 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:13.798048 14932 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:13.798225 15190 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:13.798645 14932 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:13.789292  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.780596 14911 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:24:13.804942 15162 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.807857  8034 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.814738  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.816676  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33996 (request call id 3726) took 1019 ms. Trace:
I20260709 12:24:13.817350  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:13.814013 14911 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:13.818650  8067 rpcz_store.cc:276] 0709 12:24:12.797616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.799015 (+  1399us) service_pool.cc:224] Handling call
0709 12:24:12.799324 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:12.820419 (+ 21095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:12.820467 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.708945 (+888478us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18000422e0. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a
0709 12:24:13.798840 (+ 89895us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b2c000014c8. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498b385a11 00007f498b395372 00007f498cac7a01 00007f498ca8c43a 00007f498ca8b83e 00007f4991a50419 00007f498afc7bd4 00007f498afc7b62 00007f498afc7a91 00007f498afc7a0c 00007f498afc6cc2
0709 12:24:13.799312 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.816213 (+ 16901us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:13.816285 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.816417 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.816463 (+    46us) raft_consensus.cc:1685] finished
0709 12:24:13.816482 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.816602 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20657,"raft.queue_time_us":23641,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3479,"spinlock_wait_cycles":11806976,"thread_start_us":16510,"threads_started":1,"wal-append.queue_time_us":15523}
I20260709 12:24:13.813673 15182 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:13.835260 15182 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.820360 15095 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:24:13.832448  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:13.780576 15087 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:24:13.824657 15083 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:13.838311 15083 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.839969  8184 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.841282 15067 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:13.841895 15067 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.844246 15067 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:13.844354 15150 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:13.848290 15069 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:13.848724 15187 log.cc:927] Time spent T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 12:24:13.848981 15069 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.852459  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:13.855163  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:13.799639 14932 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:13.883941  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:13.883947  8066 raft_consensus.cc:1275] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:13.887006  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.888027  8067 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:13.898660 15182 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:13.909754 15190 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:13.910418 15190 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:13.879984 15162 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.936654  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:13.936715  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:13.896384 15083 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:13.947001  8217 raft_consensus.cc:1240] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:24:13.947742  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:13.946792  8729 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.950827 15118 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:13.925515 15190 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:13.962563  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:13.986434 15081 raft_consensus.cc:993] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:14.029258 15070 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.031792 15070 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:14.032011 15188 log.cc:927] Time spent T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.266s	user 0.001s	sys 0.003s
W20260709 12:24:14.032655 15193 log.cc:927] Time spent T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
I20260709 12:24:14.049368  8035 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:14.061839  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:14.033133 15192 log.cc:927] Time spent T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.275s	user 0.003s	sys 0.000s
I20260709 12:24:14.035940 15081 raft_consensus.cc:1081] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:14.036708 15111 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:14.039791 15069 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:14.043679  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:14.046320 15078 consensus_queue.cc:1059] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:14.068970  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:14.047335 15195 log.cc:927] Time spent T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.086s	user 0.003s	sys 0.004s
I20260709 12:24:14.076435  8219 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:14.080981 14970 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:14.090597  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:14.094766 15176 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:14.105014  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:14.107348  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:14.084829 14954 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:14.110169  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:14.133127  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:14.129443  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:14.121539  8137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:14.134848  8137 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.135150  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:14.135228  8137 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:14.146719  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60003.1us
I20260709 12:24:14.093902 14970 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.157423 15162 consensus_queue.cc:1059] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:14.117853 15066 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:14.150408  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56628.5us
I20260709 12:24:14.163749  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:14.167721 14955 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:24:14.108170 15173 consensus_queue.cc:1048] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:24:14.171033 14970 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:14.171855  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:14.172520  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67602.1us
I20260709 12:24:14.173555 15095 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:14.103466 15118 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:24:14.190294  8761 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:14.193598 15177 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:14.196288 15073 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:14.183995 15066 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.198725 15066 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:14.196753 15073 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:14.205413 15073 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.206256  8216 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:24:14.206710  8216 pending_rounds.cc:85] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Aborting all ops after (but not including) 10
I20260709 12:24:14.206928  8216 pending_rounds.cc:107] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:24:14.206877 15073 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:14.207378  8216 raft_consensus.cc:2889] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.210377 15162 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:14.210843 15162 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:14.211680 15162 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.212774 15182 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:14.214228 15162 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:14.224064  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 114919us
W20260709 12:24:14.224673  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 97930.6us
I20260709 12:24:14.231942  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.235872 14970 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:14.247537  8212 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:14.246551  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:14.258556  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:14.238569  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:14.266383 14970 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:14.267172 15078 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:14.273797  8184 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.274677 14970 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:14.276259  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:14.282984  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:14.287497  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:14.290158 15207 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:14.291252 15118 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:14.291695 15118 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:14.292546 15118 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.294091 15118 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:14.438267 15162 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.438964 15162 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.441768 15162 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:14.449851  8137 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.464241  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:14.479930  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:14.480106  8137 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:14.480582  8066 raft_consensus.cc:3055] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:14.483448  8066 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:14.478322  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:14.486855  8214 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:14.486862  8731 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.485466  8066 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.495810 15165 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:14.555157  8143 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:14.557611  8142 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:14.516839 15052 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:14.572904  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 271775us
W20260709 12:24:14.586809  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 91320us
I20260709 12:24:14.597463 15111 raft_consensus.cc:993] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:14.610709 15111 raft_consensus.cc:1081] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
W20260709 12:24:14.614569  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 126069us
I20260709 12:24:14.615247  8216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:14.615883  8216 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.616026  8186 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.616319  8216 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:14.624322  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:14.617388  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.617012 14879 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:14.654533  8217 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:14.665330  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 48022.1us
I20260709 12:24:14.666453 14879 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:14.669049  8143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:14.669750  8216 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.617156  8066 raft_consensus.cc:3060] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:14.673247  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 114896us
I20260709 12:24:14.686295  8066 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:14.643121 15078 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:14.692960  8216 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:14.697818  8212 raft_consensus.cc:1240] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Rejecting Update request from peer 1659f359000d40bda3fc864911b1c75c for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:14.698900  7965 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 21 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:14.700728  7965 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:14.702097  7965 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.703472  7965 catalog_manager.cc:5697] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:24:14.641973  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 58527us
I20260709 12:24:14.717757  8217 raft_consensus.cc:2468] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:14.725666  8213 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:14.726269  8186 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:14.732421  7965 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:14.741282  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:14.735827  8109 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:14.748924  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:14.748093 15118 consensus_queue.cc:1059] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:24:14.763350 15165 raft_consensus.cc:2804] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:14.773926 15165 raft_consensus.cc:697] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:14.775048 15165 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:14.743496 14979 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:24:14.796276 15073 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:14.805675  8211 raft_consensus.cc:1240] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:14.814224  8067 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:14.825394  8765 raft_consensus.cc:3055] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:14.825878  8765 raft_consensus.cc:740] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:14.826664  8765 consensus_queue.cc:260] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.828114  8765 raft_consensus.cc:3060] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:14.837039  8765 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:24:14.841480  7965 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:14.842973  7965 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.844408  7965 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.846065  7965 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 17 to 21, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 21 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.847990  7965 catalog_manager.cc:5697] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:14.852522  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50758.7us
I20260709 12:24:14.861271 15076 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:14.882603  8184 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:14.893983  8067 raft_consensus.cc:2468] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 16.
I20260709 12:24:14.899652 14955 raft_consensus.cc:2804] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:14.908066 14955 raft_consensus.cc:697] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:14.909142 14955 consensus_queue.cc:237] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:14.961922  7965 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 22, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:14.963546  7965 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.965971  7965 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.969146  7965 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.975633  7965 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.980609  7965 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:14.986692  7965 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 12 to 16, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
W20260709 12:24:14.978042  7961 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 262) took 27870 ms (client timeout 15000 ms). Trace:
W20260709 12:24:14.994098  7961 rpcz_store.cc:269] 0709 12:23:47.108017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.111732 (+  3715us) service_pool.cc:224] Handling call
0709 12:24:14.977949 (+27866217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:12.029411 (+     0us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f49898c5c85 00007f49898c66a2 00007f498c6381db 00007f498c633aaf 00007f49899820ac 00007f49927dc9a9 00007f498999e69b 00007f498999c93f 00007f498999c455 00007f49904c116c
0709 12:24:12.386459 (+357048us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:12.552987 (+166528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:12.555516 (+  2529us) write_op.cc:435] Acquired schema lock
0709 12:24:12.555535 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:12.768310 (+212775us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:12.768369 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:12.768405 (+    36us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:24:12.769189 (+   784us) tablet.cc:701] Row locks acquired
0709 12:24:12.769212 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:12.769368 (+   156us) write_op.cc:270] Start()
0709 12:24:12.769567 (+   199us) write_op.cc:276] Timestamp: P: 1783599852769318 usec, L: 0
0709 12:24:12.769594 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:24:12.770296 (+   702us) log.cc:844] Serialized 3616 byte log entry
0709 12:24:13.125213 (+354917us) op_driver.cc:464] REPLICATION: finished
0709 12:24:13.349228 (+224015us) write_op.cc:301] APPLY: starting
0709 12:24:13.349324 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:13.355311 (+  5987us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:13.355345 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:13.416153 (+ 60808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:13.416377 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:24:13.416440 (+    63us) write_op.cc:312] APPLY: finished
0709 12:24:13.416748 (+   308us) log.cc:844] Serialized 89 byte log entry
0709 12:24:13.417593 (+   845us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.417730 (+   137us) write_op.cc:454] Released schema lock
0709 12:24:13.417780 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:13.418162 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.418191 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":152341,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":223739,"apply.run_cpu_time_us":13362,"apply.run_wall_time_us":68949,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":649109,"prepare.run_cpu_time_us":41631,"prepare.run_wall_time_us":459978,"raft.queue_time_us":274274,"raft.run_cpu_time_us":26438,"raft.run_wall_time_us":140971,"replication_time_us":355419,"spinlock_wait_cycles":42536704,"thread_start_us":1020711,"threads_started":4,"wal-append.queue_time_us":78204,"wal-append.run_cpu_time_us":103342,"wal-append.run_wall_time_us":1590517}]]}
I20260709 12:24:14.999424  7965 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:15.010892  7965 catalog_manager.cc:5697] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 15, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 15 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:15.045151  7965 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:15.046414  7965 catalog_manager.cc:5697] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:15.048058  7965 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:15.050168  7965 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:15.051713  7965 catalog_manager.cc:5697] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 21, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 21 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:15.054250  7965 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.063500  7965 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 9 to 19, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:15.064783  7965 catalog_manager.cc:5697] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:15.101257  7965 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.108718  7965 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.110391  7965 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.111920  7965 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 13 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 18 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:15.113224  7965 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 11 to 13, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 13 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.165498  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 767edb8a304f440591a33aae36a36252 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56948
I20260709 12:24:15.286979  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.281663 15234 tablet_replica.cc:333] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:15.369226 15234 raft_consensus.cc:2243] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.370523 15234 raft_consensus.cc:2272] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.372809 15177 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:15.373412 15177 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.374820 15234 ts_tablet_manager.cc:1916] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:15.375975 15177 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.377238  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:15.377907  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:15.377914  8765 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
I20260709 12:24:15.378777  8217 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:15.379662  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:15.378684  8212 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:24:15.381382 15177 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:15.381794 15177 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:15.382187 15177 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:15.383028 15113 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:15.390765  8067 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:24:15.393162 15105 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:15.397249 15177 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.400902  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:15.401840  8217 raft_consensus.cc:2393] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d67d00ae45b444cbe343726df1760e8 in current term 20: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:15.407758 15016 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.408372 15016 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.410737 15016 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.419626  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:15.422439  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:15.425611  8063 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:15.427110  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:15.426395 15222 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:15.438408 15076 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:15.467941  8765 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:15.471115  8063 raft_consensus.cc:1275] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:15.486568 15177 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.458542 15076 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.478708 15069 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:24:15.495329 15076 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:15.458922 15222 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.503080 15016 consensus_queue.cc:1048] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:24:15.578635  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 85733.8us
I20260709 12:24:15.589277  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:15.589962  8765 raft_consensus.cc:606] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:15.590371  8765 raft_consensus.cc:614] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:15.611795  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:15.602238 14979 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.615516  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:15.616842  8066 raft_consensus.cc:606] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:15.617208  8066 raft_consensus.cc:614] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:15.621448 15222 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:15.626192  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:15.632225  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:15.633107  8217 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 22: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
W20260709 12:24:15.654031  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56730us
W20260709 12:24:15.701948  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 84724.5us
I20260709 12:24:15.643285 14979 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.703814 15245 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:15.728698  8067 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
W20260709 12:24:15.736442  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 94865.2us
I20260709 12:24:15.698822  8757 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 20.
W20260709 12:24:15.736965  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68096.3us
I20260709 12:24:15.753563  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:15.762535  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:24:15.763244  8765 raft_consensus.cc:606] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:15.763612  8765 raft_consensus.cc:614] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:15.766088  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 114174us
I20260709 12:24:15.777218  8034 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:24:15.782727  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 47975us
I20260709 12:24:15.766198 14921 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:15.733070 15245 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.790133 14921 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:15.805585  8063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:15.784658 15076 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.806193  8063 raft_consensus.cc:606] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:15.806399 15177 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:15.804044 14921 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:15.818455 15076 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.826881 14979 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.827353 15177 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:15.827688 15245 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:15.828362 15177 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.835070  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:15.843616  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:15.841930  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:15.849231  8217 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:15.850108  8063 raft_consensus.cc:2393] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 20: Already voted for candidate 3d67d00ae45b444cbe343726df1760e8 in this term.
I20260709 12:24:15.860046  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:24:15.880676  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 89533.9us
I20260709 12:24:15.883733 14921 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.876869 15251 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:15.900173 15251 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.900712 15251 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:15.905325  8757 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:15.913482  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:15.914247  8212 raft_consensus.cc:2368] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21.
I20260709 12:24:15.916133  8730 leader_election.cc:400] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21.
I20260709 12:24:15.916435  8730 leader_election.cc:403] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:15.917359 15207 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:24:15.899315 15234 ts_tablet_manager.cc:1929] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.6
I20260709 12:24:15.925292  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:15.926111 15207 raft_consensus.cc:2749] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 20. Current term is 21.
I20260709 12:24:15.929663 14921 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:15.934828 15234 log.cc:1199] T 767edb8a304f440591a33aae36a36252 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/767edb8a304f440591a33aae36a36252
I20260709 12:24:15.936578  8765 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:15.938777 15251 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:15.941286 15251 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:15.975244  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 767edb8a304f440591a33aae36a36252 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:15.975459  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:15.977075  8066 raft_consensus.cc:606] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:15.976953  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:15.978085  8066 raft_consensus.cc:614] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:15.978531  8065 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:15.980047  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:15.980266  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:15.981343  8063 raft_consensus.cc:2368] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 22. Current term is 23.
W20260709 12:24:16.006959  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 133984us
I20260709 12:24:16.068840  8729 leader_election.cc:400] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 22. Current term is 23.
I20260709 12:24:16.069458  8729 leader_election.cc:403] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:24:16.071554 15243 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:16.074371  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:16.076659  8214 raft_consensus.cc:2393] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c in current term 22: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:16.080142  8065 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:16.100751  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:16.102969 14954 raft_consensus.cc:993] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:16.103657 14954 raft_consensus.cc:1081] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:16.115423  8143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:16.116290  8143 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:16.116813  8143 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:16.140920 15269 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:16.142409  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46580.9us
I20260709 12:24:16.141919 15269 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.149727 15269 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:16.155870  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:16.158483  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.153343  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
W20260709 12:24:16.159284  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 133033us
I20260709 12:24:16.159509  8214 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:16.201288  8184 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:16.210289  8143 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.211795 15267 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:16.212527  8143 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:16.212497 15267 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:16.246731 15267 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.256551  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:16.257359  8063 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:16.257717  8063 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:16.258772  8063 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.260048  8063 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:16.260222  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:16.260929  8763 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:16.262485  8214 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 23.
I20260709 12:24:16.270147  8763 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:16.279253 15243 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867) with higher term. Message: Invalid argument: T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 22. Current term is 23.
I20260709 12:24:16.289693  8758 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 23.
I20260709 12:24:16.293100  8063 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 18.
I20260709 12:24:16.294021  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:16.294831  8757 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:16.295948  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:16.324388  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:16.328868 15256 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:16.329375 15256 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.329758 15256 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:16.342684  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:16.352947  8035 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:16.353801 15250 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:16.354406 15250 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:16.354759 15273 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:16.355346 15273 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:16.355578 15250 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.356452 15273 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:16.361726  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 85513.1us
I20260709 12:24:16.363371  7960 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 16 to 18, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.365343  7960 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 17 to 20, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.386253  8758 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:24:16.388810 14954 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:16.391916 15256 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.394174 15256 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:16.399410  8212 raft_consensus.cc:1240] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 3d67d00ae45b444cbe343726df1760e8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:16.400676  7960 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 11 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 19 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.403401 15176 consensus_queue.cc:1059] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:24:16.407097 15002 raft_consensus.cc:3055] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:16.407605 15002 raft_consensus.cc:740] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:16.408730 15002 consensus_queue.cc:260] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:16.410184 15002 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:16.406998  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:16.418095  7960 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 14 to 20, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.431298  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:16.480773  7960 catalog_manager.cc:5697] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 7 to 16, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.498003  7960 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 16 to 19, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.500615  7960 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 15 to 19, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 19 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.502032  7960 catalog_manager.cc:5697] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 15 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.503487  7960 catalog_manager.cc:5697] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 10 to 15, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.508453  8065 raft_consensus.cc:2410] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:24:16.509786  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 767edb8a304f440591a33aae36a36252 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:56948
I20260709 12:24:16.511080  7965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 257) took 6732 ms. Trace:
I20260709 12:24:16.518965  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:16.521206 15246 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:16.521101  7960 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.523037  7960 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.524614  7960 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.526041  7960 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.511536  7965 rpcz_store.cc:276] 0709 12:24:09.778820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.779131 (+   311us) service_pool.cc:224] Handling call
0709 12:24:16.510828 (+6731697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:15.208224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:15.209118 (+   894us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:15.209158 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:24:15.209178 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:15.214558 (+  5380us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:15.214672 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:15.214713 (+    41us) tablet.cc:685] Acquiring locks for 32 operations
0709 12:24:15.224659 (+  9946us) tablet.cc:701] Row locks acquired
0709 12:24:15.224679 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:15.224831 (+   152us) write_op.cc:270] Start()
0709 12:24:15.224948 (+   117us) write_op.cc:276] Timestamp: P: 1783599855224784 usec, L: 0
0709 12:24:15.224981 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:24:15.226264 (+  1283us) log.cc:844] Serialized 12560 byte log entry
0709 12:24:15.346338 (+120074us) op_driver.cc:464] REPLICATION: finished
0709 12:24:15.391630 (+ 45292us) write_op.cc:301] APPLY: starting
0709 12:24:15.391733 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:15.632054 (+240321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:15.632149 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:16.128345 (+496196us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:16.192512 (+ 64167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0709 12:24:16.192594 (+    82us) write_op.cc:312] APPLY: finished
0709 12:24:16.195504 (+  2910us) log.cc:844] Serialized 276 byte log entry
0709 12:24:16.198869 (+  3365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:16.199712 (+   843us) write_op.cc:454] Released schema lock
0709 12:24:16.199803 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:16.241979 (+ 42176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:16.242023 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":562072,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":44991,"apply.run_cpu_time_us":51051,"apply.run_wall_time_us":850273,"cfile_cache_hit":130,"cfile_cache_hit_bytes":138015,"num_ops":32,"prepare.queue_time_us":62253,"prepare.run_cpu_time_us":15479,"prepare.run_wall_time_us":70132,"raft.queue_time_us":23213,"raft.run_cpu_time_us":6444,"raft.run_wall_time_us":31266,"replication_time_us":121170,"spinlock_wait_cycles":1920,"thread_start_us":165840,"threads_started":4,"wal-append.queue_time_us":63202}]]}
I20260709 12:24:16.528017  7960 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.556493  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 767edb8a304f440591a33aae36a36252 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:16.755605  8065 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:16.757951 15179 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:16.813220  8067 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:16.815378  8765 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:16.817888 15069 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:16.819777 15069 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:24:16.844408  7965 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.871855  7965 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 20, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.874666  8214 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:16.876209 15253 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:16.879025  7965 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 20 to 22, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.882882  7965 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 20, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.927937  8765 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:16.932462  7965 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.933447 15253 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 12:24:16.948060  7960 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 263) took 9574 ms. Trace:
I20260709 12:24:16.949051  7965 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.950712  7965 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 22, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 22 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.957229  7965 catalog_manager.cc:5697] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.958565  7965 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.960439  7965 catalog_manager.cc:5697] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.966706  7965 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 22, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 22 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.970899  7965 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 17, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:16.972885  7965 catalog_manager.cc:5697] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 17 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:16.948472  7960 rpcz_store.cc:276] 0709 12:24:07.386149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.399972 (+ 13823us) service_pool.cc:224] Handling call
0709 12:24:07.984347 (+584375us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54001a5c54. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f6090 00007f498ca94f3a 00007f499284ae9c 00007f499294904e 00007f4990e0a2a4 00007f4990e0a232 00007f4990e0a161 00007f4990e0a0dc 00007f4990e09392 00007f498adc748c 00007f498adc68c6
0709 12:24:16.947979 (+8963632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:16.639260 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:16.639962 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:16.640014 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:16.640035 (+    21us) tablet.cc:662] Decoding operations
0709 12:24:16.654321 (+ 14286us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:16.654446 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:16.654481 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:24:16.656695 (+  2214us) tablet.cc:701] Row locks acquired
0709 12:24:16.656742 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:24:16.656922 (+   180us) write_op.cc:270] Start()
0709 12:24:16.657092 (+   170us) write_op.cc:276] Timestamp: P: 1783599856656852 usec, L: 0
0709 12:24:16.657117 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:16.658597 (+  1480us) log.cc:844] Serialized 5536 byte log entry
0709 12:24:16.702095 (+ 43498us) op_driver.cc:464] REPLICATION: finished
0709 12:24:16.702506 (+   411us) write_op.cc:301] APPLY: starting
0709 12:24:16.702608 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:16.710012 (+  7404us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:16.710134 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:16.730739 (+ 20605us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:16.730971 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:24:16.731019 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:16.731343 (+   324us) log.cc:844] Serialized 129 byte log entry
0709 12:24:16.731506 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:16.731685 (+   179us) write_op.cc:454] Released schema lock
0709 12:24:16.731738 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:16.732117 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:16.732149 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56170,"reported_tablets":49,"spinlock_wait_cycles":77584768,"child_traces":[["op",{"apply.queue_time_us":153,"apply.run_cpu_time_us":17553,"apply.run_wall_time_us":29555,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58576,"num_ops":14,"prepare.queue_time_us":73250,"prepare.run_cpu_time_us":5728,"prepare.run_wall_time_us":19745,"replication_time_us":44807,"spinlock_wait_cycles":46080,"thread_start_us":30388,"threads_started":1}]]}
I20260709 12:24:16.995162  7965 catalog_manager.cc:5697] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 20 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 21 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.016371  7965 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 21, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 21 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.018436  7965 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 17, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:17.015851  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 83127.4us
I20260709 12:24:17.022905  7965 catalog_manager.cc:5697] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 21 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.030445  7965 catalog_manager.cc:5697] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 13 to 16, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.062762  7965 catalog_manager.cc:5697] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 20, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } }
I20260709 12:24:17.077034  8765 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:24:17.077395  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 61986.5us
W20260709 12:24:17.091924  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 91918.6us
I20260709 12:24:17.154206 15105 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:24:17.183157  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 88447.1us
W20260709 12:24:17.357740  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54594.9us
W20260709 12:24:17.433329  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72676.4us
W20260709 12:24:17.520810  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54229.8us
I20260709 12:24:17.545233  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:17.601567  7965 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 17 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 18 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.613343  7965 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:17.632488  7967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 269) took 42095 ms (client timeout 15000 ms). Trace:
W20260709 12:24:17.633103  7967 rpcz_store.cc:269] 0709 12:23:35.537439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.537746 (+   307us) service_pool.cc:224] Handling call
0709 12:24:17.632202 (+42094456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1991,"reported_tablets":50,"spinlock_wait_cycles":32512}
I20260709 12:24:17.653823 15273 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.654387 15273 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:17.658774  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:17.659507  8214 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:17.662302  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:17.663264 14954 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:17.663704 14954 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.664080 14954 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:17.670521 15273 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:17.661484  7958 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 18 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.672360  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:17.697975 14954 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:17.680953  7958 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 18 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.701144  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:17.701754  8214 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:17.701664  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:17.702301  7958 catalog_manager.cc:5697] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 12 to 15, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.710255  8214 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 22.
I20260709 12:24:17.714682  8035 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:17.715579 15273 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:17.716090 15273 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:17.717249 15273 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:17.746976  7958 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 19 to 21, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 21 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:17.700512 14954 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:17.817751  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 75404.4us
I20260709 12:24:17.826148  7958 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 16 to 17, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.863370  7958 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 18 to 19, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.871140  7965 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 16 to 22, leader changed from 1659f359000d40bda3fc864911b1c75c (127.6.182.132) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 22 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.908260 15300 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:17.909000 15300 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:17.915637 15300 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:17.919627  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:17.920754  8212 raft_consensus.cc:2368] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
I20260709 12:24:17.925922  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:17.940615  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:17.941267  8065 raft_consensus.cc:606] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:17.943521  8730 leader_election.cc:400] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
I20260709 12:24:17.943905  8730 leader_election.cc:403] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:17.945695 14921 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:24:17.949272  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:17.951100  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:17.955925  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:17.996423 14921 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
I20260709 12:24:18.117180 15253 raft_consensus.cc:993] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:18.117771 15253 raft_consensus.cc:1081] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:18.120451  8211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:24:18.121093  8211 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.121433  8211 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:18.134327  8756 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:24:18.132133  8211 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:18.142952 15253 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:18.157078  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:18.157781  8065 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:18.158099  8065 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:18.169116  8065 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:18.179765  8065 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:18.182130  8211 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:18.184566  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:18.185254  8757 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:18.208637  8757 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:18.211284  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:18.212306 15305 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:18.213580  8065 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
I20260709 12:24:18.236883 15305 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:18.257886 15305 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:18.284750  7958 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 271) took 3501 ms. Trace:
I20260709 12:24:18.288575  8211 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:24:18.292089 15253 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:18.285394  7958 rpcz_store.cc:276] 0709 12:24:14.766341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.767186 (+   845us) service_pool.cc:224] Handling call
0709 12:24:14.929175 (+161989us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400260610. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4989827db1 00007f4989967b71 00007f49899680b2 00007f49928e1759 00007f4992879a76 00007f499284ad58 00007f499294904e 00007f4990e0a2a4 00007f4990e0a232 00007f4990e0a161 00007f4990e0a0dc
0709 12:24:18.267927 (+3338752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:17.993202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:17.994007 (+   805us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:17.994063 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:24:17.994098 (+    35us) tablet.cc:662] Decoding operations
0709 12:24:17.995282 (+  1184us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:17.995377 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:17.995429 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:17.996240 (+   811us) tablet.cc:701] Row locks acquired
0709 12:24:17.996269 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:24:17.996488 (+   219us) write_op.cc:270] Start()
0709 12:24:17.996679 (+   191us) write_op.cc:276] Timestamp: P: 1783599857996420 usec, L: 0
0709 12:24:17.996715 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:24:17.997634 (+   919us) log.cc:844] Serialized 2452 byte log entry
0709 12:24:18.006374 (+  8740us) op_driver.cc:464] REPLICATION: finished
0709 12:24:18.009014 (+  2640us) write_op.cc:301] APPLY: starting
0709 12:24:18.009130 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:18.022872 (+ 13742us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:18.022964 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:18.030107 (+  7143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:18.030245 (+   138us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:24:18.030317 (+    72us) write_op.cc:312] APPLY: finished
0709 12:24:18.030576 (+   259us) log.cc:844] Serialized 65 byte log entry
0709 12:24:18.030764 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:18.030885 (+   121us) write_op.cc:454] Released schema lock
0709 12:24:18.030939 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:18.062250 (+ 31311us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:18.062297 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14792,"reported_tablets":50,"spinlock_wait_cycles":24714496,"child_traces":[["op",{"apply.queue_time_us":2322,"apply.run_cpu_time_us":9943,"apply.run_wall_time_us":53204,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25104,"num_ops":6,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":4853,"prepare.run_wall_time_us":32924,"replication_time_us":9478}]]}
W20260709 12:24:18.379522  7959 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42564 (request call id 270) took 20915 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.380026  7959 rpcz_store.cc:269] 0709 12:23:57.464011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:57.464282 (+   271us) service_pool.cc:224] Handling call
0709 12:24:18.379398 (+20915116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":759565,"reported_tablets":50,"spinlock_wait_cycles":83072}
I20260709 12:24:18.570894  8757 consensus_queue.cc:237] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:18.574785  7963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 179) took 4673 ms. Trace:
I20260709 12:24:18.575358  7963 rpcz_store.cc:276] 0709 12:24:13.901547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.902627 (+  1080us) service_pool.cc:224] Handling call
0709 12:24:18.574594 (+4671967us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487037,"reported_tablets":31}
I20260709 12:24:18.596385  8211 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:18.597739  8139 raft_consensus.cc:1275] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:18.599269 15300 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:18.601224 15300 consensus_queue.cc:1048] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:18.657325  8065 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:18.659219 15267 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:24:18.669092  7964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 177) took 39115 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.669667  7964 rpcz_store.cc:269] 0709 12:23:39.553961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.556798 (+  2837us) service_pool.cc:224] Handling call
0709 12:24:18.668821 (+39112023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74498,"reported_tablets":31,"spinlock_wait_cycles":470272}
W20260709 12:24:18.679910  7966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 176) took 64234 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.681506  7966 rpcz_store.cc:269] 0709 12:23:14.445698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.445932 (+   234us) service_pool.cc:224] Handling call
0709 12:24:18.679718 (+64233786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105576,"reported_tablets":31}
W20260709 12:24:18.696287  7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57846 (request call id 178) took 22160 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.703255  7962 rpcz_store.cc:269] 0709 12:23:56.536262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.536637 (+   375us) service_pool.cc:224] Handling call
0709 12:24:18.696089 (+22159452us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108788,"reported_tablets":31}
I20260709 12:24:18.720007 15308 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 4 to 13, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:18.724196  8137 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 4 to 13, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:18.734308  8211 raft_consensus.cc:2955] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 4 to 13, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:18.771538  7962 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 17 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 18 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:18.776695  7964 catalog_manager.cc:5697] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 4 to 13, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 16 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:18.799780  8756 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:18.822587  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e200bb1befd04bcf9b902618b83b1f88 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:18.824802 15267 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:18.859143  7960 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 264) took 1521 ms. Trace:
I20260709 12:24:18.869190  7960 rpcz_store.cc:276] 0709 12:24:17.337589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.338055 (+   466us) service_pool.cc:224] Handling call
0709 12:24:18.859032 (+1520977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18443,"reported_tablets":28}
I20260709 12:24:19.012247  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet e200bb1befd04bcf9b902618b83b1f88 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56948
I20260709 12:24:19.017344 15332 tablet_replica.cc:333] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:19.035856 15332 raft_consensus.cc:2243] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:19.041440 15332 raft_consensus.cc:2272] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:19.071026 15332 ts_tablet_manager.cc:1916] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:19.119693 15332 ts_tablet_manager.cc:1929] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:24:19.120316 15332 log.cc:1199] T e200bb1befd04bcf9b902618b83b1f88 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/e200bb1befd04bcf9b902618b83b1f88
I20260709 12:24:19.124643  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet e200bb1befd04bcf9b902618b83b1f88 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:19.371163  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.577890  8146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:19.578636  8146 raft_consensus.cc:606] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
W20260709 12:24:19.863334  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 80461.1us
W20260709 12:24:20.008039  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45907.5us
W20260709 12:24:20.045083  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 69339.3us
W20260709 12:24:20.155342  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 12:24:20.228475  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:20.229262  8216 raft_consensus.cc:606] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:20.248099  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:20.248803  8213 raft_consensus.cc:606] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:20.258924  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:20.259621  8066 raft_consensus.cc:606] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:20.280969 15366 raft_consensus.cc:993] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:20.281595 15366 raft_consensus.cc:1081] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:20.284672  8142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:20.285316  8142 raft_consensus.cc:606] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:20.293776 15312 raft_consensus.cc:993] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:20.294320 15312 raft_consensus.cc:1081] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:20.299006  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:20.301064  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:20.301887  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.304790  8757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49958
I20260709 12:24:20.305536  8757 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.305950  8757 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.310935 15345 raft_consensus.cc:993] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:20.314107 15345 raft_consensus.cc:1081] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:20.331907 15305 raft_consensus.cc:993] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:20.332806 15355 raft_consensus.cc:1081] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:20.335366  8757 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:20.348385  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:20.349191  8066 raft_consensus.cc:3055] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:20.349793  8066 raft_consensus.cc:740] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:20.350673  8066 consensus_queue.cc:260] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:20.351951  8066 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.382301  8765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:24:20.382926  8765 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.383286  8765 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.394601  8765 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:20.397524  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:20.398157  8065 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.409176  8065 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
I20260709 12:24:20.410493  8729 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:20.411337 15368 raft_consensus.cc:2804] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:20.412225 15368 raft_consensus.cc:697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:20.414932 15368 consensus_queue.cc:237] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:20.439009  8757 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:20.439272  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:20.440105  8142 raft_consensus.cc:3060] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.446121  8765 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:20.452395  8211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:24:20.453356  8211 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.454291  8211 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.454700  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:20.455367  8214 raft_consensus.cc:3055] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:20.455670  8214 raft_consensus.cc:740] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:20.458217  8213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:24:20.458932  8213 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.459375  8213 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:20.456523  8214 consensus_queue.cc:260] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:20.712853  8214 raft_consensus.cc:3060] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:20.715513  8213 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:20.986721  8142 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.010s
I20260709 12:24:20.987128  8142 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
I20260709 12:24:20.994809  8214 raft_consensus.cc:2468] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
W20260709 12:24:21.106297  8066 consensus_meta.cc:287] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: Time spent flushing consensus metadata: real 0.754s	user 0.019s	sys 0.008s
I20260709 12:24:21.106798  8066 raft_consensus.cc:2468] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
I20260709 12:24:21.149677  8729 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:24:21.169377  8211 consensus_meta.cc:287] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.005s
I20260709 12:24:21.169986  8211 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:21.178108 15379 raft_consensus.cc:2804] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:21.178812 15379 raft_consensus.cc:697] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:21.183365  8211 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:21.179922 15379 consensus_queue.cc:237] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:21.204128  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.213958  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 64366.6us
I20260709 12:24:21.234989  8217 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 22. Current term is 23. Ops: []
W20260709 12:24:21.251717  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 535066us
I20260709 12:24:21.258615  8213 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:21.259006  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:21.259642  8066 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:21.255559 15349 raft_consensus.cc:993] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:21.262033 15349 raft_consensus.cc:1081] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:21.278687  8066 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 23.
I20260709 12:24:21.302326  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:21.303176  8137 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:21.303556  8137 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:21.313019  8137 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:21.319742  8137 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:21.342948  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:21.343621  8146 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:21.343924  8146 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:21.344663  8146 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:21.345235  8111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.345559  8146 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:21.381356  7962 catalog_manager.cc:5697] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 22 to 23, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 23 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:21.385102  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 23.
W20260709 12:24:21.391484 15368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.009s	sys 0.038s
W20260709 12:24:21.391909 15368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.009s	sys 0.038s
I20260709 12:24:21.392577  8758 raft_consensus.cc:1240] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 22. Current term is 23. Ops: []
I20260709 12:24:21.404788  8066 raft_consensus.cc:1240] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 22. Current term is 23. Ops: []
I20260709 12:24:21.406726  8146 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:24:21.406962  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:21.407615  8067 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:21.481834  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 80438.7us
W20260709 12:24:21.482366  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46525.6us
I20260709 12:24:21.494947  8062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:34012
I20260709 12:24:21.568948  8062 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.574067  8067 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
W20260709 12:24:21.573927  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 83255.4us
I20260709 12:24:21.577011  8062 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:21.579008  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 95795.2us
I20260709 12:24:21.581938  8184 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
W20260709 12:24:21.637776  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 234122us
W20260709 12:24:21.624153 15369 log.cc:927] Time spent T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.129s	user 0.003s	sys 0.009s
W20260709 12:24:21.640861  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59014.6us
I20260709 12:24:21.642391  8062 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:21.667125  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:21.668603  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88118.3us
I20260709 12:24:21.665483 15398 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:21.689787 15388 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:21.690616 15388 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:21.700564 15388 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:21.748562  8142 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:21.760943  8142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:21.761705  8142 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:21.765625  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.765847  8062 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:21.780731 15379 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:24:21.792838  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125826us
W20260709 12:24:21.805697  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 88768.2us
I20260709 12:24:21.811004 15401 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:21.811733 15401 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:21.814316 15401 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:21.811069  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.841744  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2820 after lost signal to thread 6877
I20260709 12:24:21.840389 15382 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:24:21.843081  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080033a300 after lost signal to thread 8001
I20260709 12:24:21.842931 15382 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:21.844583  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080013fe20 after lost signal to thread 8094
I20260709 12:24:21.848829  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:21.855659  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7960 after lost signal to thread 8170
W20260709 12:24:21.857141  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08003b86a0 after lost signal to thread 8244
I20260709 12:24:21.857926  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:21.858595  8212 raft_consensus.cc:3055] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:24:21.860291  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9c40 after lost signal to thread 8790
W20260709 12:24:21.861358  7998 debug-util.cc:398] Leaking SignalData structure 0x7b0800382e60 after lost signal to thread 15300
W20260709 12:24:21.862739  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1c60 after lost signal to thread 15334
W20260709 12:24:21.863088  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080038c680 after lost signal to thread 15337
W20260709 12:24:21.863607  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3160 after lost signal to thread 15351
I20260709 12:24:21.858911  8212 raft_consensus.cc:740] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:21.866158 15398 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:21.859666  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:21.868470  8067 raft_consensus.cc:1275] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:21.846426 15385 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:21.845639 15382 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:21.872967  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 204380us
I20260709 12:24:21.881184  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:21.887456  8142 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:24:21.892642 15365 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:21.893267 15365 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:21.902995  8067 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:21.911046  8139 raft_consensus.cc:1240] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Rejecting Update request from peer 0c70d5020db543caa986f80b0adaa8d2 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:21.936759  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:21.937922 15365 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:21.938594 15365 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:21.939106 15365 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:21.941792 15403 consensus_queue.cc:1059] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:21.893702 15398 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:21.979002  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 54995.7us
I20260709 12:24:21.996439  8212 consensus_queue.cc:260] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:21.997246  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 74617.9us
W20260709 12:24:22.001765  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 94926.5us
W20260709 12:24:22.000231  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 77913.5us
I20260709 12:24:22.004983  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:21.894337 15385 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.007388  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:21.919716 15368 consensus_queue.cc:1048] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:24:21.943681 15365 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:21.998693 15388 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:22.020404 15397 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:22.021131 15397 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.023507 15397 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:22.024997  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.024893  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.026916  7963 catalog_manager.cc:5697] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 22 to 23, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 23 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:22.057134  8036 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:22.057701  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52166us
I20260709 12:24:22.059197 15373 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:22.059746 15373 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:22.060761 15373 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.073549 15389 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:22.074184 15389 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.076788 15397 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:22.077381 15397 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.079514 15397 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:22.080144  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53671.8us
I20260709 12:24:22.085134  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.085960 15385 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:22.087577  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.018950 15388 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.090060 15388 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:22.076435 15389 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:22.116029  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.103299  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.122479 15382 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:22.123158 15382 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.126400  8211 raft_consensus.cc:1240] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:22.133181  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:22.145267  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 43987.9us
I20260709 12:24:22.163792  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.168789  8212 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:22.170171 15305 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:22.173065  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.174758 15410 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:22.201594  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.202811 15411 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:24:22.204114  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.208462  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:22.209237 15382 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:22.210971  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbb2d697a734b0baef1073024333311" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:22.212468  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:22.214124  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:22.219345  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:22.223392  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:22.227205  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:22.261650  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67264.4us
I20260709 12:24:22.267056  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.228279  8212 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 16.
I20260709 12:24:22.269204 15397 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:22.270699  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:22.270617  8184 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.301229 15382 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:22.302628  8184 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.310822 15403 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:22.343035  8186 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.351001 15383 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:22.352083  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.384099 15402 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:22.384451  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.388520 15383 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:22.389833  8184 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:22.391716 15383 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:22.394152  7962 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42556 (request call id 266) took 1151 ms. Trace:
I20260709 12:24:22.396848  8145 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:22.400142  7960 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42580 (request call id 268) took 1005 ms. Trace:
I20260709 12:24:22.402117  7960 rpcz_store.cc:276] 0709 12:24:21.394642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.395784 (+  1142us) service_pool.cc:224] Handling call
0709 12:24:22.400080 (+1004296us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:24:22.394590  7962 rpcz_store.cc:276] 0709 12:24:21.236988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.237146 (+   158us) service_pool.cc:224] Handling call
0709 12:24:22.388569 (+1151423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:21.667795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:21.703959 (+ 36164us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:21.704011 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:21.704038 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:21.704466 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:21.704545 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:21.704585 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:21.704850 (+   265us) tablet.cc:701] Row locks acquired
0709 12:24:21.704870 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:21.705076 (+   206us) write_op.cc:270] Start()
0709 12:24:21.705209 (+   133us) write_op.cc:276] Timestamp: P: 1783599861705009 usec, L: 0
0709 12:24:21.705233 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:21.706103 (+   870us) log.cc:844] Serialized 536 byte log entry
0709 12:24:22.178605 (+472502us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b1800192a60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:24:22.298793 (+120188us) op_driver.cc:464] REPLICATION: finished
0709 12:24:22.346001 (+ 47208us) write_op.cc:301] APPLY: starting
0709 12:24:22.346084 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:22.384897 (+ 38813us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:22.384925 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:22.385708 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:22.385877 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:22.385926 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:22.386102 (+   176us) log.cc:844] Serialized 25 byte log entry
0709 12:24:22.386286 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:22.386372 (+    86us) write_op.cc:454] Released schema lock
0709 12:24:22.386414 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:22.386780 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:22.386815 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":46963,"apply.run_cpu_time_us":3212,"apply.run_wall_time_us":40769,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":253692,"prepare.run_cpu_time_us":16717,"prepare.run_wall_time_us":163813,"raft.queue_time_us":100586,"raft.run_cpu_time_us":2313,"raft.run_wall_time_us":67619,"replication_time_us":590184,"spinlock_wait_cycles":2195200,"thread_start_us":326792,"threads_started":4,"wal-append.queue_time_us":98373}]]}
I20260709 12:24:22.404209 15383 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:22.478533  8140 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:24:22.480348  7960 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 15 to 16, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:22.490020  8138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:22.490669  8138 raft_consensus.cc:606] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:22.493491  8140 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:22.498800 15413 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.499428  8065 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:22.489692 15383 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:24:22.508512  8068 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:24:22.522249  8220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:22.524230  8220 raft_consensus.cc:606] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:22.514727 15402 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:24:22.513918 15383 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:24:22.541628  8220 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:22.542981  8065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:22.543690  8065 raft_consensus.cc:606] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:22.552279  8220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:22.553042  8220 raft_consensus.cc:606] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:22.553210 15405 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:22.552364  7962 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 22 to 23, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 23 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.554886  7962 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 18 to 19, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 19 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.576279  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:22.577256  8145 raft_consensus.cc:606] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Received request to transfer leadership to TS 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:22.583905  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:22.586556  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.587725  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.779541 15399 raft_consensus.cc:993] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:22.780932 15365 raft_consensus.cc:993] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.781527 15365 raft_consensus.cc:1081] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.781635 15391 raft_consensus.cc:1081] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:22.784873  8066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:24:22.793859  8763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:24:22.799917  8763 raft_consensus.cc:493] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.785440  8066 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.801508  8066 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:22.800846  8763 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:22.825611 15105 raft_consensus.cc:993] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.826212 15105 raft_consensus.cc:1081] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.831974  8763 raft_consensus.cc:515] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.839617  8758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49964
I20260709 12:24:22.840390  8758 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.840828  8758 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:22.850961  8068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:22.851648  8068 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:22.853561  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac329aaff89417f8e5eeb5f5f3e9a17" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:22.854244  8220 raft_consensus.cc:3055] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:22.854573  8220 raft_consensus.cc:740] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:22.855408  8220 consensus_queue.cc:260] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.855901  8066 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.856595  8220 raft_consensus.cc:3060] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:22.858378  8763 leader_election.cc:290] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:22.858655  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:22.859195  8146 raft_consensus.cc:3055] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:22.859485  8146 raft_consensus.cc:740] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:22.860181  8146 consensus_queue.cc:260] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.861218  8146 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:22.878100  8758 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.879423  8220 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:24:22.881069  8730 leader_election.cc:304] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:22.884123  8146 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:22.885139  8066 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:22.890270  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:22.890940  8220 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:22.894948  8036 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:22.907009  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:22.908092  8138 raft_consensus.cc:3055] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:22.908501  8138 raft_consensus.cc:740] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:22.915571 15383 raft_consensus.cc:993] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.916219 15383 raft_consensus.cc:1081] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Signalling peer 1659f359000d40bda3fc864911b1c75c to start an election
I20260709 12:24:22.915786  8138 consensus_queue.cc:260] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.918087  8138 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:22.920598 15381 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:22.921182 15381 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:22.921990  8763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce"
dest_uuid: "1659f359000d40bda3fc864911b1c75c"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:24:22.922638  8763 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.923053  8763 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:22.922034 15381 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:22.932114  8758 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:22.935725  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:22.936385  8212 raft_consensus.cc:3060] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:22.941001  8068 raft_consensus.cc:2468] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:24:22.904942 15410 raft_consensus.cc:2804] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:24:22.953629  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 50951.7us
I20260709 12:24:22.965474  8763 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.980325  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:22.981046  8216 raft_consensus.cc:3055] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:22.981365  8216 raft_consensus.cc:740] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:22.982354  8216 consensus_queue.cc:260] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:22.983548  8216 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:22.987973  8138 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:22.992172  8216 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:24:22.994028  8730 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:22.992775  8763 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:23.007263 15384 raft_consensus.cc:2804] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:23.008045 15384 raft_consensus.cc:697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:22.969972 15410 raft_consensus.cc:697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:23.014748 15410 consensus_queue.cc:237] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:23.042884  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 71294.4us
I20260709 12:24:23.044239  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:23.044924  8146 raft_consensus.cc:3060] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:23.050202  8731 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:23.051374 15360 raft_consensus.cc:2804] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:23.055927  8146 raft_consensus.cc:2468] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:24:23.056437 15384 consensus_queue.cc:237] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:23.085865  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 186121us
I20260709 12:24:23.118481  7962 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 20 to 21, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 21 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.123492 15360 raft_consensus.cc:697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:23.124563 15360 consensus_queue.cc:237] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:23.126094  8212 raft_consensus.cc:2468] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:23.129637 15436 raft_consensus.cc:993] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:23.130136 15436 raft_consensus.cc:1081] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:23.175940  8220 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 21.
I20260709 12:24:23.182205  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:24:23.182904  8212 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.183372  8212 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:23.192222  7960 catalog_manager.cc:5697] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 21 to 22, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 22 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.267766  8212 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:23.307152  8212 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:23.317934  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:23.318586  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:23.319233  8066 raft_consensus.cc:3055] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:23.319571  8066 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:23.318637  8146 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:23.327780  8066 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:23.331815  8066 raft_consensus.cc:3060] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:23.349344  8146 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:24:23.363392  8066 raft_consensus.cc:2468] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 14.
I20260709 12:24:23.377184  8186 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:23.378222 15398 raft_consensus.cc:2804] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:23.378784 15398 raft_consensus.cc:697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:23.379720 15398 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:23.408046  7962 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 13 to 14, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.417208  8146 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:23.419559 15413 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:23.422276  7960 catalog_manager.cc:5697] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 21 to 22, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 22 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.424160  7960 catalog_manager.cc:5697] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 17 to 18, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.544243  8212 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:23.553203 15413 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:23.572072  8213 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:24:23.576081 15410 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:23.620384  8062 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:24:23.626284  8220 raft_consensus.cc:1275] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:24:23.631191 15410 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:23.636263  8146 raft_consensus.cc:1275] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:24:23.637929 15443 consensus_queue.cc:1048] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:23.648337 15440 consensus_queue.cc:1048] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:24:23.671967  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 73895.3us
W20260709 12:24:23.713502  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 45586.8us
W20260709 12:24:23.782739  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 54555.9us
I20260709 12:24:23.813809  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:23.861572  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 126112us
I20260709 12:24:23.895738  8138 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:24:23.898105  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 113480us
W20260709 12:24:23.904522  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 110689us
I20260709 12:24:23.908934  8140 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:23.916790  8066 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:23.919137 15465 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:23.924336 15410 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:24:23.880520 15453 log.cc:927] Time spent T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:24:23.955626  8213 raft_consensus.cc:1275] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:24:23.986306 15461 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:24:23.991592 15473 consensus_queue.cc:1048] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:24:23.993361 15470 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:24:24.144124  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 50092.7us
W20260709 12:24:24.148043  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 65685.1us
W20260709 12:24:24.203676  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 43892.6us
W20260709 12:24:24.337855  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 177851us
I20260709 12:24:24.438046  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:24.438931  8211 raft_consensus.cc:606] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:24.451782 15461 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.098s	user 0.004s	sys 0.003s
W20260709 12:24:24.430431 15456 log.cc:927] Time spent T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.170s	user 0.010s	sys 0.000s
W20260709 12:24:24.525597  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 339234us
W20260709 12:24:24.647444  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 172107us
W20260709 12:24:24.647426  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 279356us
W20260709 12:24:24.780092  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 108706us
W20260709 12:24:24.796092  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 125759us
W20260709 12:24:24.849298  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 52180.5us
W20260709 12:24:24.918543 15485 log.cc:927] Time spent T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.070s	user 0.000s	sys 0.005s
W20260709 12:24:24.927232  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 157472us
W20260709 12:24:24.990314  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 56316.6us
I20260709 12:24:25.015237 15505 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:25.015920 15505 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.020520 15505 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:25.029111 15497 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:25.029757 15497 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.032213 15497 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:25.110634 15470 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:25.140005  8066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:25.140815  8066 raft_consensus.cc:606] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:25.141853  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 125606us
I20260709 12:24:25.126906 15470 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.148674 15470 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:25.152932  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:25.165642  8063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.166718  8069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.195781 15470 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:25.196393 15470 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.204919  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:25.206981  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:25.207798  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:25.209867 15470 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:25.214277 15478 raft_consensus.cc:993] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:25.214855 15478 raft_consensus.cc:1081] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:25.217916  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:25.218250  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:25.220178  8140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:25.220878  8140 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.221287  8140 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.225564 15470 raft_consensus.cc:493] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:25.233381  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:25.237083 15500 raft_consensus.cc:993] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:25.240947 15501 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:25.245942 15501 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.248253 15501 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:25.248663 15470 raft_consensus.cc:515] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.251127 15470 leader_election.cc:290] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:25.253793 15504 raft_consensus.cc:1081] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:25.258699  8145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51468
I20260709 12:24:25.259227  8145 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.259560  8145 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:25.267056  8145 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.272053  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.273007  8140 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.277567  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.276787  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:25.278441  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 103273us
I20260709 12:24:25.278861  8145 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:25.282821  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:25.285280  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.285526  8184 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:25.289403  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:25.290252  8140 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:25.290763  8215 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:25.291117  8215 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:25.291391 15417 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:25.291935  8215 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.293123  8215 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:25.289844 15472 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:25.314198  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:25.314818  8062 raft_consensus.cc:3055] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:25.315145  8062 raft_consensus.cc:740] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:25.315987  8062 consensus_queue.cc:260] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.317190  8062 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.329555  8062 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:24:25.330984  8109 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:25.333561 15472 raft_consensus.cc:2804] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:25.335165  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:25.337045  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 51577.1us
I20260709 12:24:25.341292 15500 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:25.341723  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:25.342471  8219 raft_consensus.cc:3060] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:25.335942 15472 raft_consensus.cc:697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:25.346928 15472 consensus_queue.cc:237] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.360795  8215 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:25.365377  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:25.366722 15417 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:25.367244 15417 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:25.368135 15417 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.375555  8219 raft_consensus.cc:2468] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
W20260709 12:24:25.390501  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.414142  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:25.413959  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9647a9c32fa748e4bc9548eb7a92bdfc" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:25.439253 15463 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:25.440157 15463 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:25.443835  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.449011  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:25.440472  8730 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:25.452555 15491 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:25.460791  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:25.463107 15501 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:25.480520  7964 catalog_manager.cc:5697] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 15 to 16, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 16 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.482352  7964 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 19 to 20, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.489334  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:25.490326 15468 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:25.491870  8184 leader_election.cc:304] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:25.492758 15468 raft_consensus.cc:2749] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:25.453334 15463 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:25.519841  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:25.520692  8763 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:25.573710 15350 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:25.574481 15350 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:25.576905 15350 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:25.578459  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:25.579774  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d67d00ae45b444cbe343726df1760e8" is_pre_election: true
I20260709 12:24:25.589267  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:25.592226 15472 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:25.549947  8763 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
W20260709 12:24:25.861907  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 138043us
I20260709 12:24:25.870930  8219 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:25.875775  8220 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:25.882027 15472 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:25.888613  8061 raft_consensus.cc:1275] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:25.890357 15350 consensus_queue.cc:1048] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:25.896720 15350 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:25.915258  8763 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:25.917444 15417 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:26.370879  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.687065  8140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:26.688122  8140 raft_consensus.cc:606] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:26.691124  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:26.693248  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:26.694914  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.766655 15526 raft_consensus.cc:993] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:26.767338 15526 raft_consensus.cc:1081] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:26.781683  8068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:33996
I20260709 12:24:26.782414  8068 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.782917  8068 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:26.854334  8068 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:26.874104  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:26.875020  8140 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:26.875370  8140 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:26.876413  8140 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:26.890090  8140 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:26.900363  8068 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:26.901050  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:26.904884  8763 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:26.922817  8763 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:26.924764  8034 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:26.926105 15549 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:26.926736 15549 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:26.927932 15549 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:26.977234  8140 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:27.009559  7964 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 19, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.510113  8758 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:27.512140 15435 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:27.549300  8145 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:27.551172 15549 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:27.908982  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.148036  8068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:28.148736  8068 raft_consensus.cc:606] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:28.163390  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:28.167236  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:28.197479  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.474294 15549 raft_consensus.cc:993] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:28.474795 15549 raft_consensus.cc:1081] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:28.477381  8145 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:28.478109  8145 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.478500  8145 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:28.488149  8145 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:28.503242  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:28.503885  8066 raft_consensus.cc:3055] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:28.504209  8066 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:28.505031  8066 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:28.507076  8066 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:28.514842  8066 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 23.
I20260709 12:24:28.516984  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:28.518271  8212 raft_consensus.cc:3060] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:28.528326  8212 raft_consensus.cc:2468] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 23.
I20260709 12:24:28.529866  8110 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:28.530869 15563 raft_consensus.cc:2804] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:28.531406 15563 raft_consensus.cc:697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:28.532313 15563 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:28.517485  8145 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:28.574091  7962 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 22 to 23, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 23 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.152487  8213 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:24:29.154184 15563 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:29.158236  8068 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:24:29.160878 15563 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:24:29.196813  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 100058us
I20260709 12:24:29.339229  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.551712  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:29.552461  8145 raft_consensus.cc:606] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:29.560796  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:29.562788  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:29.565276  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.991036 15350 raft_consensus.cc:993] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:29.991664 15350 raft_consensus.cc:1081] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:30.016881  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:24:30.017647  8212 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.018121  8212 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:30.087692  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47155.9us
W20260709 12:24:30.099694  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 44125.5us
I20260709 12:24:30.107005  8212 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:30.140112  8212 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:30.140913  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:30.141736  8140 raft_consensus.cc:3055] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:30.142143  8140 raft_consensus.cc:740] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:30.144196  8140 consensus_queue.cc:260] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:30.149360  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:30.150087  8758 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:30.149572  8140 raft_consensus.cc:3060] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:30.175822  8758 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:30.185210  8184 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:30.186154 15569 raft_consensus.cc:2804] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:30.186657 15569 raft_consensus.cc:697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:30.187623 15569 consensus_queue.cc:237] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:30.180142  8140 raft_consensus.cc:2468] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:30.230394  7962 catalog_manager.cc:5697] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 19 to 20, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 20 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.647419  8140 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:30.652228 15535 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:30.753099  8763 raft_consensus.cc:1275] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:30.761912 15535 consensus_queue.cc:1048] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:30.793993  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.897235  8763 consensus_queue.cc:237] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:30.903915  8219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:30.904597  8219 raft_consensus.cc:606] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:30.908309  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:30.911542  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:30.912425  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.961083  8219 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:30.964232 15572 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.975034  8065 raft_consensus.cc:1275] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:30.977042 15547 consensus_queue.cc:1048] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:31.028695 15572 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 5 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:31.057925  8065 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 5 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:31.086838  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7490a68a6eb4ff18f8111dadec3d794 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 12:24:31.100035  8219 raft_consensus.cc:2955] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 5 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:31.101873  7962 catalog_manager.cc:5697] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 5 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 17 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.314558  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet f7490a68a6eb4ff18f8111dadec3d794 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41740
I20260709 12:24:31.334556 15603 tablet_replica.cc:333] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:24:31.336050 15603 raft_consensus.cc:2243] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.341046 15603 raft_consensus.cc:2272] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.345387 15603 ts_tablet_manager.cc:1916] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:31.367201 15603 ts_tablet_manager.cc:1929] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:24:31.367847 15603 log.cc:1199] T f7490a68a6eb4ff18f8111dadec3d794 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/f7490a68a6eb4ff18f8111dadec3d794
I20260709 12:24:31.371358  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet f7490a68a6eb4ff18f8111dadec3d794 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:31.412890 15590 raft_consensus.cc:993] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:31.413466 15590 raft_consensus.cc:1081] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:31.417834  8140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51468
I20260709 12:24:31.418479  8140 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:31.418839  8140 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:31.446362  8140 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:31.462467  8066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:31.463217  8066 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:31.469185  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a313281992bb42fbb55e3eb70444bb6f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:31.469919  8219 raft_consensus.cc:3055] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:31.470254  8219 raft_consensus.cc:740] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:31.471119  8219 consensus_queue.cc:260] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:31.472267  8219 raft_consensus.cc:3060] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:31.477151  8140 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:31.494195  8219 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:31.521566  8110 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:31.524761 15578 raft_consensus.cc:2804] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:31.525309 15578 raft_consensus.cc:697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:31.526330 15578 consensus_queue.cc:237] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:31.490851  8066 raft_consensus.cc:2468] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
I20260709 12:24:31.600415  7960 catalog_manager.cc:5697] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 16 to 17, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.058300  8212 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:32.068043 15578 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:32.086266  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:32.143116  8066 raft_consensus.cc:1275] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:32.156092 15605 consensus_queue.cc:1048] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:32.182832  8140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:32.183638  8140 raft_consensus.cc:606] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:32.190218  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:32.192219  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:32.193162  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:32.292557 15609 raft_consensus.cc:993] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:32.293159 15609 raft_consensus.cc:1081] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:32.298280  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:24:32.298959  8212 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.299357  8212 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:32.325575  8212 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:32.333257  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:32.334048  8140 raft_consensus.cc:3055] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:32.334443  8140 raft_consensus.cc:740] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:32.334569  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:32.335253  8758 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:32.335347  8140 consensus_queue.cc:260] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:32.351302  8140 raft_consensus.cc:3060] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:32.345870  8758 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:32.357952  8184 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:32.359120 15611 raft_consensus.cc:2804] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:32.359706 15611 raft_consensus.cc:697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:32.361366 15611 consensus_queue.cc:237] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:32.346318  8212 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:32.392189  7964 catalog_manager.cc:5697] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 19 to 20, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 20 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.425100  8140 raft_consensus.cc:2468] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:32.533627  8065 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:32.609838  8213 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:32.610803  8146 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:32.615007 15435 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:24:32.621456 15606 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:32.640549  8034 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a08eb4ae8cb45649565146d64ab2983. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:32.663614 15435 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.671653  8213 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.698383  8146 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.733861  8065 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:32.753475  7964 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:24:32.759615  8034 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96d399d9899c495382a6ba72d8479a9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:32.761380  8145 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:32.768455  8213 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:32.769927 15625 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:32.782538 15629 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:32.827260  8213 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.824256 15435 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.859812  8145 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.916182  8146 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:32.921653 15591 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:32.926525  7960 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:32.933462  8758 raft_consensus.cc:1275] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:32.935106 15608 consensus_queue.cc:1048] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:33.030447 15636 ts_tablet_manager.cc:933] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:24:33.038932  8219 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:33.112836 15636 tablet_copy_client.cc:323] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:24:33.117214  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet 4a08eb4ae8cb45649565146d64ab2983 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:24:33.118237  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet 4a08eb4ae8cb45649565146d64ab2983 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-4a08eb4ae8cb45649565146d64ab2983
W20260709 12:24:33.152766  8184 consensus_peers.cc:597] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 273de299acf94214b44aab4591da9b3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:33.157580  8140 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:33.164322  8065 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:33.171783  8080 tablet_copy_source_session.cc:215] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:33.175748 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08eb4ae8cb45649565146d64ab2983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:33.162341 15608 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:24:33.185482 15611 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:33.231401 15646 ts_tablet_manager.cc:933] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:24:33.237380 15644 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.239428  8140 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.237360 15646 tablet_copy_client.cc:323] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:24:33.250730  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet 96d399d9899c495382a6ba72d8479a9d from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:24:33.251417  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet 96d399d9899c495382a6ba72d8479a9d from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-96d399d9899c495382a6ba72d8479a9d
I20260709 12:24:33.272120  7964 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.279034  8080 tablet_copy_source_session.cc:215] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:33.287460 15646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d399d9899c495382a6ba72d8479a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:33.321200 15646 tablet_copy_client.cc:806] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:33.337729 15646 tablet_copy_client.cc:670] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:33.341122  8146 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:33.345667  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.240091  8065 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.367233 15646 tablet_copy_client.cc:538] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:33.405333 15646 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:33.443236 15636 tablet_copy_client.cc:806] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:33.443979 15636 tablet_copy_client.cc:670] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:33.468387  8219 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:33.470189 15563 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:33.468417 15636 tablet_copy_client.cc:538] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:33.513067  8220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:33.513849  8220 raft_consensus.cc:606] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:33.517362  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 423b8f313a0947a3a2819068b1105a8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:33.527271  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:33.529369  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.530236  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:33.587112  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 68898.6us
I20260709 12:24:33.589869  8061 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:33.601972 15654 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.605978 15636 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:33.604696  8212 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.620002 15563 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:33.642362 15655 ts_tablet_manager.cc:933] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:33.651598  8065 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.672821  7962 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:33.752132 15655 tablet_copy_client.cc:323] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:24:33.757205  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 273de299acf94214b44aab4591da9b3a from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:24:33.758061  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 273de299acf94214b44aab4591da9b3a from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-273de299acf94214b44aab4591da9b3a
I20260709 12:24:33.792551  8230 tablet_copy_source_session.cc:215] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:33.797945 15655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273de299acf94214b44aab4591da9b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:33.827098 15643 raft_consensus.cc:993] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:33.827710 15643 raft_consensus.cc:1081] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:33.856256  8146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23d9238fead43a79238d40702153004"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51468
I20260709 12:24:33.866021  8146 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.867839  8146 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:33.896541  8146 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:33.899663  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:33.900233  8065 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:33.907918 15655 tablet_copy_client.cc:806] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:33.911988 15655 tablet_copy_client.cc:670] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:33.925509  8146 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:33.927222  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:33.927928  8212 raft_consensus.cc:3055] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:33.928269  8212 raft_consensus.cc:740] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:33.932444  8065 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:33.933702  8212 consensus_queue.cc:260] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:33.934621  8109 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:33.940544 15651 raft_consensus.cc:2804] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:33.941191 15651 raft_consensus.cc:697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:33.942193 15651 consensus_queue.cc:237] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:33.956838 15655 tablet_copy_client.cc:538] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:33.960075 15636 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:33.960893  8212 raft_consensus.cc:3060] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:33.970949 15646 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:33.972235 15646 tablet_bootstrap.cc:492] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:33.995726  8212 raft_consensus.cc:2468] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:34.001583 15661 ts_tablet_manager.cc:933] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:34.007388 15636 tablet_bootstrap.cc:492] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:34.018716 15636 ts_tablet_manager.cc:1403] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.413s	user 0.031s	sys 0.019s
I20260709 12:24:34.017591 15655 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:34.035393 15646 ts_tablet_manager.cc:1403] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.630s	user 0.040s	sys 0.024s
I20260709 12:24:34.077996  7964 catalog_manager.cc:5697] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 19 to 20, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.095104 15661 tablet_copy_client.cc:323] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:24:34.098256  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 423b8f313a0947a3a2819068b1105a8e from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:24:34.098858  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 423b8f313a0947a3a2819068b1105a8e from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-423b8f313a0947a3a2819068b1105a8e
I20260709 12:24:34.100011 15646 raft_consensus.cc:359] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.100978 15646 raft_consensus.cc:740] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:34.101697 15646 consensus_queue.cc:260] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.104470 15646 ts_tablet_manager.cc:1434] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 12:24:34.107640 15636 raft_consensus.cc:359] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.108565 15636 raft_consensus.cc:740] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:34.109297 15636 consensus_queue.cc:260] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.111846 15636 ts_tablet_manager.cc:1434] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.000s
W20260709 12:24:34.121752  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 45787.5us
I20260709 12:24:34.122998  8757 raft_consensus.cc:1217] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:24:34.126435  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-96d399d9899c495382a6ba72d8479a9d received from {username='slave'} at 127.0.0.1:34594
I20260709 12:24:34.127020  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-96d399d9899c495382a6ba72d8479a9d on tablet 96d399d9899c495382a6ba72d8479a9d with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:34.157673  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-4a08eb4ae8cb45649565146d64ab2983 received from {username='slave'} at 127.0.0.1:34594
I20260709 12:24:34.158190  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-4a08eb4ae8cb45649565146d64ab2983 on tablet 4a08eb4ae8cb45649565146d64ab2983 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:34.181841  8156 tablet_copy_source_session.cc:215] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:34.193228 15661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423b8f313a0947a3a2819068b1105a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.319773 15655 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:34.329043 15655 tablet_bootstrap.cc:492] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:34.329967 15655 ts_tablet_manager.cc:1403] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.313s	user 0.035s	sys 0.010s
I20260709 12:24:34.333313 15655 raft_consensus.cc:359] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.334237 15655 raft_consensus.cc:740] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:34.334964 15655 consensus_queue.cc:260] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:34.337906 15655 ts_tablet_manager.cc:1434] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:34.361070  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-273de299acf94214b44aab4591da9b3a received from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:34.361568  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-273de299acf94214b44aab4591da9b3a on tablet 273de299acf94214b44aab4591da9b3a with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:34.415333 15661 tablet_copy_client.cc:806] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:34.426476  8219 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:34.439271 15661 tablet_copy_client.cc:670] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:34.439846 15654 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:34.449007  8758 raft_consensus.cc:1217] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:24:34.454551 15661 tablet_copy_client.cc:538] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:34.467456  8061 raft_consensus.cc:1275] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:34.469657 15654 consensus_queue.cc:1048] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:34.491988 15661 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:34.649425  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:34.740899  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 83564.9us
W20260709 12:24:34.764925  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 106933us
I20260709 12:24:34.829720 15671 raft_consensus.cc:1064] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:34.833274  8763 raft_consensus.cc:1217] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:24:34.832391 15671 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:34.874109  8145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:57626
I20260709 12:24:34.874775  8145 raft_consensus.cc:606] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:34.876685 15654 raft_consensus.cc:993] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:34.877233 15654 raft_consensus.cc:1081] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:34.881985  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:34.885098  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:34.892300 15663 raft_consensus.cc:1064] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:34.897202 15663 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:34.902827  8219 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:34.903112  8145 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:34.903985  8763 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:34.906003 15674 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:34.906939 15606 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:34.921598 15435 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:34.952648 15606 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:34.954507  8758 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:34.967581  8219 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:34.969555 15674 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:34.982290  8763 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:34.984285 15684 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:34.987855  8145 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:34.992185  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.020758 15663 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:35.079525  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49240
I20260709 12:24:35.079137  8140 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.080191  8212 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.080663  8212 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:35.085750  7962 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.118613  8212 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:35.170280  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 71723.4us
I20260709 12:24:35.171840  8212 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:35.181115 15682 log.cc:927] Time spent T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:24:35.220238  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 49036.7us
I20260709 12:24:35.256157 15435 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.307358  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:35.308061  8140 raft_consensus.cc:3055] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:35.308349  8140 raft_consensus.cc:740] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:35.312995  8140 consensus_queue.cc:260] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:35.322772  8140 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:35.359932  8140 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:24:35.366248  8186 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:35.376013  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 53568.3us
W20260709 12:24:35.384162  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 126832us
W20260709 12:24:35.387678  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 166336us
I20260709 12:24:35.400753 15644 raft_consensus.cc:2804] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:35.401365 15644 raft_consensus.cc:697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:35.402240 15644 consensus_queue.cc:237] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:35.403770  8757 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:35.416917  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 65942us
I20260709 12:24:35.419059  8212 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:35.451314  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62958.9us
I20260709 12:24:35.457116  8140 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:35.460037  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 340843us
I20260709 12:24:35.422163  8220 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.482970  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:35.484035  8065 raft_consensus.cc:3060] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:35.520732 15707 raft_consensus.cc:1064] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:35.523923 15707 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:35.528730  8110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.533320  8065 raft_consensus.cc:2468] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:24:35.619216 15661 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:35.620337 15661 tablet_bootstrap.cc:492] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:35.621207 15661 ts_tablet_manager.cc:1403] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 1.129s	user 0.043s	sys 0.030s
I20260709 12:24:35.642719  8138 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:35.644474  8763 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:35.643678 15661 raft_consensus.cc:359] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:35.646298 15661 raft_consensus.cc:740] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:35.646095 15706 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:35.647179 15644 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:35.647064 15661 consensus_queue.cc:260] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:35.652448  8062 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:35.658722 15707 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:35.679610 15661 ts_tablet_manager.cc:1434] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:24:35.711158  7963 catalog_manager.cc:5697] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 21 to 22, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.748859 15707 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.753094  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-423b8f313a0947a3a2819068b1105a8e received from {username='slave'} at 127.0.0.1:34716
I20260709 12:24:35.756362  8763 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.758518  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-423b8f313a0947a3a2819068b1105a8e on tablet 423b8f313a0947a3a2819068b1105a8e with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:35.761948  8066 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.801163  7962 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.859463  8066 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:35.876098  8763 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:35.879628  8220 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:35.881551 15703 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:35.883618 15606 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:35.892701  7964 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.902184 15684 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.907063  8066 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:35.919289  8146 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.923177  8220 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.941025  8140 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:35.942962 15703 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:35.952296 15606 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.954435  8065 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:35.956770  8140 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.963683  8763 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:35.970484 15671 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:35.972779  8761 raft_consensus.cc:2955] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.976435  8763 raft_consensus.cc:2955] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:35.965262 15706 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:24:36.009496  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96d399d9899c495382a6ba72d8479a9d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:36.010363  8140 raft_consensus.cc:1275] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:36.022287 15644 consensus_queue.cc:1048] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:36.019526  7964 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 11 to 12, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 17 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.029973  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a08eb4ae8cb45649565146d64ab2983 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:36.081053  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 96d399d9899c495382a6ba72d8479a9d with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41740
I20260709 12:24:36.083065  7960 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 12 to 13, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 16 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:36.137776  8219 consensus_queue.cc:237] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:36.143215  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a08eb4ae8cb45649565146d64ab2983 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:33768
I20260709 12:24:36.146044  8761 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:36.157068  8146 raft_consensus.cc:1275] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:36.161435 15707 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:36.165916 15706 consensus_queue.cc:1048] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:36.166630  8763 raft_consensus.cc:1217] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:24:36.203096  8761 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:36.200199 15591 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:36.283008  8140 raft_consensus.cc:2955] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:36.310869 15720 tablet_replica.cc:333] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:24:36.313239 15724 tablet_replica.cc:333] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:24:36.338167  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.341631 15720 raft_consensus.cc:2243] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:36.342765 15720 raft_consensus.cc:2272] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:36.345562 15724 raft_consensus.cc:2243] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:36.346668 15724 raft_consensus.cc:2272] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:36.379958  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 52943.5us
I20260709 12:24:36.403456 15724 ts_tablet_manager.cc:1916] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:36.456207  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 273de299acf94214b44aab4591da9b3a with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:36.468791  8220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:36.469555  8220 raft_consensus.cc:606] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:36.471437  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:36.473459  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:36.474149 15720 ts_tablet_manager.cc:1916] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:36.474428  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.537355  7960 catalog_manager.cc:5697] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 11 to 12, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 16 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:36.576293  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 69375.2us
W20260709 12:24:36.608943  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 158765us
W20260709 12:24:36.635746  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 199442us
W20260709 12:24:36.656911  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 330330us
I20260709 12:24:36.714452 15724 ts_tablet_manager.cc:1929] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:24:36.715101 15724 log.cc:1199] T 4a08eb4ae8cb45649565146d64ab2983 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/4a08eb4ae8cb45649565146d64ab2983
I20260709 12:24:36.724819 15720 ts_tablet_manager.cc:1929] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:24:36.725531 15720 log.cc:1199] T 96d399d9899c495382a6ba72d8479a9d P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/96d399d9899c495382a6ba72d8479a9d
I20260709 12:24:36.751672  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 4a08eb4ae8cb45649565146d64ab2983 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:36.779942  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 273de299acf94214b44aab4591da9b3a with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56948
W20260709 12:24:36.793776  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 82047.1us
I20260709 12:24:36.798703 15591 raft_consensus.cc:993] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:36.808104 15727 raft_consensus.cc:1064] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:36.815325  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 96d399d9899c495382a6ba72d8479a9d (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:36.870065 15743 raft_consensus.cc:1081] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:36.931677  8066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:34012
I20260709 12:24:36.932756  8066 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:36.933557  8066 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:36.991447 15727 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:37.002583 15746 tablet_replica.cc:333] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:24:37.017268  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 181372us
I20260709 12:24:37.023257  8066 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:37.075337  8066 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:37.077991  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:37.096422  8145 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:37.120800  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:37.121600  8212 raft_consensus.cc:3055] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:24:37.121948  8212 raft_consensus.cc:740] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:37.123070  8212 consensus_queue.cc:260] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:37.137868  8212 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:37.165015  8145 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 24.
I20260709 12:24:37.175731  8036 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:37.177634 15747 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:24:37.178364 15747 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 24 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:37.180045  8212 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 24.
I20260709 12:24:37.181813 15747 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:37.273124 15700 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:37.278095  8761 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:37.277931 15700 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:37.285336  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:37.298270  8220 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:37.301852  8062 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:37.302443 15700 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:37.306367 15740 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:37.319540  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:37.319474 15740 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:37.326213  8035 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:37.350394 15671 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:37.355189 15695 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 12:24:37.372925  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 54689.1us
I20260709 12:24:37.420478  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:37.472117  7960 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 23 to 24, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 24 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.521935 15732 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.560505  8212 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.577021 15746 raft_consensus.cc:2243] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:37.578500 15746 raft_consensus.cc:2272] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:37.585394 15746 ts_tablet_manager.cc:1916] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:37.608775  8761 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.650014  7962 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.698752  8066 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.745617 15746 ts_tablet_manager.cc:1929] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:24:37.758010 15746 log.cc:1199] T 273de299acf94214b44aab4591da9b3a P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/273de299acf94214b44aab4591da9b3a
I20260709 12:24:37.760892  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 273de299acf94214b44aab4591da9b3a (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:37.843446  8145 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:24:37.845340 15703 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:37.864410  8139 consensus_queue.cc:237] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:37.873178  8761 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:37.874604  8066 raft_consensus.cc:1275] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:37.878290 15727 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:37.882511 15695 consensus_queue.cc:1048] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:24:37.917253  8763 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.912832 15740 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.919025  8066 raft_consensus.cc:2955] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.961333  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:37.960713  7963 catalog_manager.cc:5697] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 11 to 12, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:37.966032  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 423b8f313a0947a3a2819068b1105a8e with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:37.971073  8219 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:24:37.977694 15747 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:37.998525  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 423b8f313a0947a3a2819068b1105a8e with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:33768
I20260709 12:24:38.001647 15764 tablet_replica.cc:333] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:24:38.003582 15764 raft_consensus.cc:2243] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:38.005167 15764 raft_consensus.cc:2272] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:38.009800 15764 ts_tablet_manager.cc:1916] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:38.086458 15764 ts_tablet_manager.cc:1929] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:24:38.094697 15764 log.cc:1199] T 423b8f313a0947a3a2819068b1105a8e P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/423b8f313a0947a3a2819068b1105a8e
I20260709 12:24:38.130183  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 423b8f313a0947a3a2819068b1105a8e (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:38.133852  8061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:38.134557  8061 raft_consensus.cc:606] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:38.140815  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:38.154970 15674 raft_consensus.cc:993] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:38.155082  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:38.155866 15748 raft_consensus.cc:1081] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:38.158628  8215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:24:38.162457  8215 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:38.162942  8215 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:38.157562  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:38.180040  8215 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:38.199168  8061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:38.199813  8061 raft_consensus.cc:3055] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:24:38.200114  8061 raft_consensus.cc:740] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:38.201218  8061 consensus_queue.cc:260] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:38.202775  8061 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:38.216310  8215 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:38.217635  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9cc1738e4ab29ea95fed6e4f6b94" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:38.219420  8763 raft_consensus.cc:3060] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:38.250425  8763 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 24.
I20260709 12:24:38.260377  8061 raft_consensus.cc:2468] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 24.
I20260709 12:24:38.269109  8184 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:38.270042 15689 raft_consensus.cc:2804] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:24:38.270690 15689 raft_consensus.cc:697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:38.271692 15689 consensus_queue.cc:237] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:38.371613  7962 catalog_manager.cc:5697] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 23 to 24, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 24 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.737284  8763 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:24:38.741331 15739 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:24:38.812032  8062 raft_consensus.cc:1275] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:24:38.813913 15768 consensus_queue.cc:1048] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:24:39.270181  8062 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:24:39.314543  8034 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 627e9613a1ca4f19a4b790eac7fbbf2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.317303  8145 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:39.318046  8212 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:39.319119 15748 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:39.320864 15747 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:39.342361 15747 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.347098  8145 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.410418  8215 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.421212  7962 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.440454  8145 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:24:39.484674  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fe588c3d3ed44709862cae072b8e205. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.485111  8215 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:24:39.495234  8062 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:24:39.497048 15740 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:39.503648 15740 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:39.514261  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.529176 15740 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.532709  8215 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.614459  8215 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:39.622355  8062 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.639624  7963 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 16, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 23 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.700773  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
mode: GRACEFUL
new_leader_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:42952
I20260709 12:24:39.701479  8213 raft_consensus.cc:606] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Received request to transfer leadership to TS 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:39.705752  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:39.707525  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:39.708316  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.786793  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:39.788805 15778 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:39.790414 15788 ts_tablet_manager.cc:933] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
W20260709 12:24:39.792165  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a76facb821d9488284580418cf9bbf22. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.796198 15788 tablet_copy_client.cc:323] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.129:34867
I20260709 12:24:39.801801  8080 tablet_copy_service.cc:140] P 3d67d00ae45b444cbe343726df1760e8: Received BeginTabletCopySession request for tablet 627e9613a1ca4f19a4b790eac7fbbf2a from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34594)
I20260709 12:24:39.802438  8080 tablet_copy_service.cc:161] P 3d67d00ae45b444cbe343726df1760e8: Beginning new tablet copy session on tablet 627e9613a1ca4f19a4b790eac7fbbf2a from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34594: session id = 1659f359000d40bda3fc864911b1c75c-627e9613a1ca4f19a4b790eac7fbbf2a
I20260709 12:24:39.827922  8062 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:39.832600  8080 tablet_copy_source_session.cc:215] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:39.837044 15788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627e9613a1ca4f19a4b790eac7fbbf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:39.842921 15739 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:39.873709 15777 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.889444  8145 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:39.905592 15788 tablet_copy_client.cc:806] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:39.906296 15788 tablet_copy_client.cc:670] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:39.917291 15788 tablet_copy_client.cc:538] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:39.941715  8215 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:39.952131  7962 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.957096 15788 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:39.974314 15689 raft_consensus.cc:993] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: : Instructing follower 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:39.975119 15778 raft_consensus.cc:1081] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Signalling peer 3d67d00ae45b444cbe343726df1760e8 to start an election
I20260709 12:24:39.999984 15792 ts_tablet_manager.cc:933] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:40.032415  8061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
 from {username='slave'} at 127.0.0.1:34012
I20260709 12:24:40.033246  8061 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:40.033706  8061 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:40.036401  8145 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:40.045477  8061 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:40.050518 15778 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:40.068444  8061 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:40.068452  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:40.069304  8215 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:40.069675  8215 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:40.070304  8062 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:40.070533  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:40.071321  8763 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:40.071310  8215 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:40.072600  8215 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:40.072839 15792 tablet_copy_client.cc:323] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:24:40.075260  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet 7fe588c3d3ed44709862cae072b8e205 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:24:40.075768  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet 7fe588c3d3ed44709862cae072b8e205 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-7fe588c3d3ed44709862cae072b8e205
I20260709 12:24:40.075856  8061 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:40.090332 15689 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:40.091871  8156 tablet_copy_source_session.cc:215] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:24:40.095695  8184 consensus_peers.cc:597] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753bdf66ab9c48ceb9558028f4bcf7e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.100173 15792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe588c3d3ed44709862cae072b8e205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.113699  8763 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:40.116307  8034 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:40.125934 15674 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:40.127653  8215 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d67d00ae45b444cbe343726df1760e8 in term 19.
I20260709 12:24:40.128898 15674 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Leader. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:40.136667 15674 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:40.188591  7960 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: term changed from 18 to 19, leader changed from 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) to 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129). New cstate: current_term: 19 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.181155 15778 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:40.196295  8145 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:40.219748  7960 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:40.232652 15792 tablet_copy_client.cc:806] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:40.233386 15792 tablet_copy_client.cc:670] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:40.242825 15792 tablet_copy_client.cc:538] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:40.274331  8062 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:40.308873 15792 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:40.349452 15803 ts_tablet_manager.cc:933] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:40.365298 15803 tablet_copy_client.cc:323] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:24:40.369827  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet a76facb821d9488284580418cf9bbf22 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:24:40.370420  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet a76facb821d9488284580418cf9bbf22 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-a76facb821d9488284580418cf9bbf22
I20260709 12:24:40.382462  8230 tablet_copy_source_session.cc:215] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:40.399806 15803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76facb821d9488284580418cf9bbf22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.418980 15788 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.435286 15788 tablet_bootstrap.cc:492] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:40.441169 15788 ts_tablet_manager.cc:1403] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.513s	user 0.049s	sys 0.009s
I20260709 12:24:40.454111 15803 tablet_copy_client.cc:806] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:40.454227 15788 raft_consensus.cc:359] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.457710 15788 raft_consensus.cc:740] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:40.458729 15788 consensus_queue.cc:260] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.455322 15803 tablet_copy_client.cc:670] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:40.464766 15788 ts_tablet_manager.cc:1434] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:24:40.474709  8080 tablet_copy_service.cc:342] P 3d67d00ae45b444cbe343726df1760e8: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-627e9613a1ca4f19a4b790eac7fbbf2a received from {username='slave'} at 127.0.0.1:34594
I20260709 12:24:40.475230  8080 tablet_copy_service.cc:434] P 3d67d00ae45b444cbe343726df1760e8: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-627e9613a1ca4f19a4b790eac7fbbf2a on tablet 627e9613a1ca4f19a4b790eac7fbbf2a with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:40.479511 15803 tablet_copy_client.cc:538] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:40.526682 15803 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:40.613315 15788 ts_tablet_manager.cc:933] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:40.638464 15788 tablet_copy_client.cc:323] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:24:40.642357  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:24:40.642994  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 753bdf66ab9c48ceb9558028f4bcf7e1 from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-753bdf66ab9c48ceb9558028f4bcf7e1
I20260709 12:24:40.648105  8763 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:40.654736 15792 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.655860 15792 tablet_bootstrap.cc:492] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:40.655997 15674 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:40.659268  8219 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:40.663312 15792 ts_tablet_manager.cc:1403] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.355s	user 0.062s	sys 0.004s
I20260709 12:24:40.668066 15747 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:40.691421  8230 tablet_copy_source_session.cc:215] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:40.695701 15792 raft_consensus.cc:359] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.698334 15792 raft_consensus.cc:740] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:40.704792 15792 consensus_queue.cc:260] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.722261 15792 ts_tablet_manager.cc:1434] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:24:40.723634 15788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753bdf66ab9c48ceb9558028f4bcf7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.725294  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-7fe588c3d3ed44709862cae072b8e205 received from {username='slave'} at 127.0.0.1:34716
I20260709 12:24:40.725950  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-7fe588c3d3ed44709862cae072b8e205 on tablet 7fe588c3d3ed44709862cae072b8e205 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:40.762066 15803 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:40.765558 15803 tablet_bootstrap.cc:492] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:40.769014 15803 ts_tablet_manager.cc:1403] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.243s	user 0.033s	sys 0.015s
I20260709 12:24:40.773461 15803 raft_consensus.cc:359] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.774464 15803 raft_consensus.cc:740] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:40.782071 15803 consensus_queue.cc:260] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:40.785434 15803 ts_tablet_manager.cc:1434] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:24:40.794538  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-a76facb821d9488284580418cf9bbf22 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:40.795049  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-a76facb821d9488284580418cf9bbf22 on tablet a76facb821d9488284580418cf9bbf22 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:40.815703  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.882961 15788 tablet_copy_client.cc:806] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:40.883544 15788 tablet_copy_client.cc:670] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:40.940482  8765 raft_consensus.cc:1217] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 12:24:40.962435 15788 tablet_copy_client.cc:538] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:41.015075  8765 raft_consensus.cc:1217] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 LEARNER]: Deduplicated request from leader. Original: 23.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 12:24:41.061558 15788 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:41.086165  8062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:41.086896  8062 raft_consensus.cc:606] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Received request to transfer leadership to TS 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:41.088588  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:41.093529  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:41.095479  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.331830  8763 raft_consensus.cc:1217] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:24:41.342379 15788 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:41.343475 15788 tablet_bootstrap.cc:492] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:41.349226 15788 ts_tablet_manager.cc:1403] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.309s	user 0.050s	sys 0.023s
I20260709 12:24:41.359253 15788 raft_consensus.cc:359] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:41.363504 15788 raft_consensus.cc:740] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:41.364269 15788 consensus_queue.cc:260] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:41.405691 15788 ts_tablet_manager.cc:1434] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 12:24:41.414386  8230 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-753bdf66ab9c48ceb9558028f4bcf7e1 received from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:41.414942  8230 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-753bdf66ab9c48ceb9558028f4bcf7e1 on tablet 753bdf66ab9c48ceb9558028f4bcf7e1 with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:41.537607 15794 raft_consensus.cc:1064] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:41.545843 15794 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:41.564062  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 57271.1us
I20260709 12:24:41.607038  8765 raft_consensus.cc:1217] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 12:24:41.619067  8763 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:41.620815 15727 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:41.626690  8219 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:41.628990 15819 raft_consensus.cc:993] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:41.629838 15818 raft_consensus.cc:1081] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Signalling peer 92362bf8983f4a71a3511e987a2c6578 to start an election
I20260709 12:24:41.634466  8139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92"
dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:24:41.635049  8139 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:41.635246 15818 raft_consensus.cc:1064] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:41.635383  8139 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:41.638154 15740 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:41.638949 15818 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:41.661753  8139 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:41.669175  8139 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:41.671224  8062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:41.671928  8062 raft_consensus.cc:3055] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:41.672251  8062 raft_consensus.cc:740] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:41.673144  8062 consensus_queue.cc:260] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:41.674345  8062 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:41.693620  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:41.695133  8765 raft_consensus.cc:3060] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:41.725028  8062 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:41.727078  8109 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:41.755635  8763 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 LEARNER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:41.775524 15823 raft_consensus.cc:2804] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:41.803013  8765 raft_consensus.cc:2468] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:41.776384 15823 raft_consensus.cc:697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
W20260709 12:24:41.810003  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 49218.5us
I20260709 12:24:41.857955 15819 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:24:41.805658 15823 consensus_queue.cc:237] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:41.919734  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 61063.2us
W20260709 12:24:41.950332 15825 log.cc:927] Time spent T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:24:41.952287 15828 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:41.980412  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76375.5us
I20260709 12:24:42.018303  8219 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:42.020386  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 302419us
W20260709 12:24:42.025286  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 46735us
W20260709 12:24:42.104151  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 377138us
I20260709 12:24:42.190989 15801 raft_consensus.cc:1064] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:42.193689 15801 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:42.228785  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 189792us
I20260709 12:24:42.234515  8140 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:42.243669  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:42.247085  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.318604  8036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 72787.7us
I20260709 12:24:42.442562  8065 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:24:42.444870 15747 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:24:42.458776  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 84601.8us
W20260709 12:24:42.461722  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 197224us
I20260709 12:24:42.457182  7962 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 16 to 17, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.468050  7960 catalog_manager.cc:5697] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 19 to 20, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 20 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.485651  8214 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:42.520920  8758 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.584275 15830 raft_consensus.cc:1064] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
W20260709 12:24:42.597646  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 76110.8us
W20260709 12:24:42.612401  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 82706.7us
W20260709 12:24:42.613874  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 95258.4us
I20260709 12:24:42.618580 15832 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:42.619253 15832 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:42.622109 15838 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 12:24:42.600334 15830 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:42.624765  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 60736.6us
I20260709 12:24:42.650099  8068 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:42.654467 15832 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:42.659214  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:42.661532 15747 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:24:42.684830  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53057.8us
I20260709 12:24:42.699725 15841 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:24:42.701648  8145 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:42.700011  8065 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:42.707266  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:42.711483  8137 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:42.726660  8035 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:42.730479 15835 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:42.737171  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72884.9us
I20260709 12:24:42.755342  8763 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:24:42.757766 15801 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
W20260709 12:24:42.772684  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 111633us
I20260709 12:24:42.782480 15831 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:24:42.779350 15830 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:24:42.798235 15848 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:24:42.798956  8757 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:42.802543 15818 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.805171  8145 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.808710  8756 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:24:42.805116  8068 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } attrs { replace: true } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.879637 15727 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:42.878364 15778 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:24:42.958209  8065 raft_consensus.cc:1275] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:24:42.904358  8220 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.955209  8756 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:42.984795 15870 consensus_queue.cc:1048] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 12:24:43.025036 15801 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.042953  8062 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:43.134325  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 53977.6us
W20260709 12:24:43.132974  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56454.6us
W20260709 12:24:43.133363  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 54431us
W20260709 12:24:43.146785  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 67146.3us
W20260709 12:24:43.256228 15868 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:43.259420 15853 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.261291  8137 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:43.250805 15871 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:24:43.301508  8062 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.306460  7964 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:43.310117  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 159281us
I20260709 12:24:43.318252  8069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
mode: GRACEFUL
new_leader_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:51926
I20260709 12:24:43.319285  8069 raft_consensus.cc:606] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Received request to transfer leadership to TS 0c70d5020db543caa986f80b0adaa8d2
I20260709 12:24:43.331503  8758 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.353006  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:43.355017  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:43.355875  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:43.408716 15859 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.133s	user 0.010s	sys 0.018s
W20260709 12:24:43.371428 15868 log.cc:927] Time spent T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.095s	user 0.012s	sys 0.000s
W20260709 12:24:43.409014 15875 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 12:24:43.429685  8137 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:43.413136 15862 log.cc:927] Time spent T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.130s	user 0.007s	sys 0.010s
W20260709 12:24:43.413209 15881 log.cc:927] Time spent T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: Append to log took a long time: real 0.106s	user 0.002s	sys 0.003s
I20260709 12:24:43.511057  8758 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.514228  7960 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 11 to 12, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.516162  7960 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.604146  8065 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.618744 15819 raft_consensus.cc:993] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: : Instructing follower 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:43.619458 15818 raft_consensus.cc:1081] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Signalling peer 0c70d5020db543caa986f80b0adaa8d2 to start an election
I20260709 12:24:43.626025  8216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b"
dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
 from {username='slave'} at 127.0.0.1:49244
I20260709 12:24:43.626753  8216 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:43.627192  8216 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.637154  8220 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:43.641896 15819 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:43.647701  8758 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 3d67d00ae45b444cbe343726df1760e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:43.653227  8216 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.652894 15877 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.655030  8220 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.656859  8065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "3d67d00ae45b444cbe343726df1760e8"
I20260709 12:24:43.657642  8065 raft_consensus.cc:3055] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:43.657943  8065 raft_consensus.cc:740] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d67d00ae45b444cbe343726df1760e8, State: Running, Role: LEADER
I20260709 12:24:43.659571 15818 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:43.659468  8065 consensus_queue.cc:260] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.516185  8137 consensus_queue.cc:237] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.661728  8216 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:43.662528  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:43.662767  8065 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.663151  8756 raft_consensus.cc:3060] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.677872  7952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 627e9613a1ca4f19a4b790eac7fbbf2a with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:43.679596  8065 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:43.680950  8184 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8; no voters: 
I20260709 12:24:43.682258 15778 raft_consensus.cc:2804] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:43.682793 15778 raft_consensus.cc:697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:43.683562 15778 consensus_queue.cc:237] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.704888  8756 raft_consensus.cc:2468] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:43.731266  8220 consensus_queue.cc:237] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.711388  8757 raft_consensus.cc:2955] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.753494  7963 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 14 to 15, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 20 leader_uuid: "3d67d00ae45b444cbe343726df1760e8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.789333  8062 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:43.805935  8756 raft_consensus.cc:1275] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:43.813162  8062 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:24:43.799335 15854 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:24:43.819803 15851 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 12:24:43.830638  8065 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.831723  8220 consensus_queue.cc:237] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:43.842342 15854 consensus_queue.cc:1048] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:43.825554 15853 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.849284  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet 627e9613a1ca4f19a4b790eac7fbbf2a with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:41740
I20260709 12:24:43.851277  8756 raft_consensus.cc:1275] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:24:43.858074  8761 raft_consensus.cc:2955] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.847702 15829 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.880580  8137 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:24:43.887241  8065 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.890993 15778 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:43.891763  8756 raft_consensus.cc:1275] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:24:43.889402 15870 consensus_queue.cc:1048] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 12:24:43.897646 15890 tablet_replica.cc:333] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:24:43.899807 15778 consensus_queue.cc:1048] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:43.907088  7963 catalog_manager.cc:5697] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 19 to 20, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 20 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.918838  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7fe588c3d3ed44709862cae072b8e205 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:43.922634  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a76facb821d9488284580418cf9bbf22 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:43.927315 15890 raft_consensus.cc:2243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:43.934478 15890 raft_consensus.cc:2272] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:43.943615  8756 raft_consensus.cc:2955] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.943617  7962 catalog_manager.cc:5697] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 17 to 18, VOTER 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131) evicted. New cstate: current_term: 23 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.927861  7960 catalog_manager.cc:5697] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 reported cstate change: config changed from index 12 to 13, VOTER 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) evicted. New cstate: current_term: 17 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.962046 15890 ts_tablet_manager.cc:1916] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:43.966583 15853 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:44.001762  8203 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fe588c3d3ed44709862cae072b8e205 with delete_type TABLET_DATA_TOMBSTONED (TS 0c70d5020db543caa986f80b0adaa8d2 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:33768
I20260709 12:24:44.003012  8137 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:43.974056  8761 raft_consensus.cc:2955] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:44.016955 15892 tablet_replica.cc:333] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:24:44.026441 15892 raft_consensus.cc:2243] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:44.030927 15892 raft_consensus.cc:2272] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:44.035218  8136 tablet_service.cc:1558] Processing DeleteTablet for tablet a76facb821d9488284580418cf9bbf22 with delete_type TABLET_DATA_TOMBSTONED (TS 92362bf8983f4a71a3511e987a2c6578 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41740
I20260709 12:24:44.037236  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:44.057152 15892 ts_tablet_manager.cc:1916] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:44.074154  7962 catalog_manager.cc:5697] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:44.088761 15890 ts_tablet_manager.cc:1929] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 12:24:44.106950 15890 log.cc:1199] T 627e9613a1ca4f19a4b790eac7fbbf2a P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/627e9613a1ca4f19a4b790eac7fbbf2a
I20260709 12:24:44.111936  8054 tablet_service.cc:1558] Processing DeleteTablet for tablet 753bdf66ab9c48ceb9558028f4bcf7e1 with delete_type TABLET_DATA_TOMBSTONED (TS 3d67d00ae45b444cbe343726df1760e8 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:56948
I20260709 12:24:44.114840  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet 627e9613a1ca4f19a4b790eac7fbbf2a (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:44.121160 15890 tablet_replica.cc:333] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:24:44.122432 15890 raft_consensus.cc:2243] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:44.123353 15890 raft_consensus.cc:2272] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:44.146507 15892 ts_tablet_manager.cc:1929] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.17
I20260709 12:24:44.147147 15892 log.cc:1199] T 7fe588c3d3ed44709862cae072b8e205 P 0c70d5020db543caa986f80b0adaa8d2: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/wals/7fe588c3d3ed44709862cae072b8e205
I20260709 12:24:44.149336  7953 catalog_manager.cc:5028] TS 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): tablet 7fe588c3d3ed44709862cae072b8e205 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
I20260709 12:24:44.178112 15893 tablet_replica.cc:333] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:44.181102 15893 raft_consensus.cc:2243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:44.181808 15890 ts_tablet_manager.cc:1916] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:44.186254 15893 raft_consensus.cc:2272] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:44.196714 15893 ts_tablet_manager.cc:1916] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:44.249312  8756 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:44.254956 15841 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:44.286796  8065 raft_consensus.cc:1275] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:44.288594 15841 consensus_queue.cc:1048] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:44.347358 15890 ts_tablet_manager.cc:1929] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:24:44.347946 15890 log.cc:1199] T a76facb821d9488284580418cf9bbf22 P 92362bf8983f4a71a3511e987a2c6578: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/wals/a76facb821d9488284580418cf9bbf22
W20260709 12:24:44.354370  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 98452.7us
I20260709 12:24:44.401849  7954 catalog_manager.cc:5028] TS 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): tablet a76facb821d9488284580418cf9bbf22 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
W20260709 12:24:44.611080  8034 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.6.182.190:33539, user_credentials={real_user=slave}} blocked reactor thread for 46489.9us
I20260709 12:24:44.664132 15893 ts_tablet_manager.cc:1929] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.14
I20260709 12:24:44.664716 15893 log.cc:1199] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 3d67d00ae45b444cbe343726df1760e8: Deleting WAL directory at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/wals/753bdf66ab9c48ceb9558028f4bcf7e1
I20260709 12:24:44.672664  7952 catalog_manager.cc:5028] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): tablet 753bdf66ab9c48ceb9558028f4bcf7e1 (table test-workload [id=c554e408e96144d09daf087dd7b99f0f]) successfully deleted
W20260709 12:24:44.722247  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 63310.6us
I20260709 12:24:44.812975  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260709 12:24:44.970562  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:24:44.976811  8109 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:24:44.993233  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.037727  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.042811  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.043897  8109 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.120692  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.129148  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.129258  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.140455  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.140791  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.161650  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.168780  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.176364  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.192418  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.198887  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.203840  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.211663  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:45.213083  6874 tablet_replica.cc:333] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.215948  6874 raft_consensus.cc:2243] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.217070  6874 raft_consensus.cc:2272] T a313281992bb42fbb55e3eb70444bb6f P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.222872  6874 tablet_replica.cc:333] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.226178  6874 raft_consensus.cc:2243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.226833  6874 raft_consensus.cc:2272] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:45.243369  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.251904  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.255810  6874 tablet_replica.cc:333] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.256907  6874 raft_consensus.cc:2243] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.258250  6874 raft_consensus.cc:2272] T 61d6819393b345508f4a0ced5669567e P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.269845  6874 tablet_replica.cc:333] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:24:45.271816  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.271946  6874 raft_consensus.cc:2243] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.273129  6874 raft_consensus.cc:2272] T a76facb821d9488284580418cf9bbf22 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.276304  6874 tablet_replica.cc:333] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.293092  6874 raft_consensus.cc:2243] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.293779  6874 raft_consensus.cc:2272] T badbfade73ce40f0a89515d01fe50bd6 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:45.303076  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.313580  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.318058  8015 auto_rebalancer.cc:629] Failed to schedule move for tablet c14c286147e549768b521ff92a61fec9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:45.326295  8216 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:24:45.335368  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.337523  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.347332  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.348600  6874 tablet_replica.cc:333] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:24:45.364714  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.369095  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.377400  6874 raft_consensus.cc:2243] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.378829  6874 raft_consensus.cc:2272] T dea9fb7818f049248d8577e73c087888 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.409565  8140 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:45.411320 15848 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:45.421119  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.423745  8184 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2db314cd9b6453daa5d171b91113f3a. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.424418  8184 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.442757 15778 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:24:45.383750  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.457022  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 73339.8us
I20260709 12:24:45.457242  8140 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:45.515822  6874 tablet_replica.cc:333] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.516815  6874 raft_consensus.cc:2243] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:45.517320  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 59600.4us
W20260709 12:24:45.533185  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55907.2us
W20260709 12:24:45.569723  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.569634  6874 raft_consensus.cc:2272] T dbbb2d697a734b0baef1073024333311 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.590451  7962 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 9, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:24:45.597846  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:45.602761  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.614081  6874 tablet_replica.cc:333] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.615366  6874 raft_consensus.cc:2243] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.616945  6874 raft_consensus.cc:2272] T 4a08eb4ae8cb45649565146d64ab2983 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.620226  6874 tablet_replica.cc:333] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.621225  6874 raft_consensus.cc:2243] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.621966  6874 raft_consensus.cc:2272] T 90659c1daf854b0f9323204cf80f7aeb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.625114  6874 tablet_replica.cc:333] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.626117  6874 raft_consensus.cc:2243] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.626791  6874 raft_consensus.cc:2272] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.630326  6874 tablet_replica.cc:333] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.631313  6874 raft_consensus.cc:2243] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.632570  6874 raft_consensus.cc:2272] T 96d399d9899c495382a6ba72d8479a9d P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.635689  6874 tablet_replica.cc:333] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.636593  6874 raft_consensus.cc:2243] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.637282  6874 raft_consensus.cc:2272] T aa46cdee469046e0a85f4a03d2e03f92 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.642503  6874 tablet_replica.cc:333] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.643565  6874 raft_consensus.cc:2243] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.644357  6874 raft_consensus.cc:2272] T b2db314cd9b6453daa5d171b91113f3a P 3d67d00ae45b444cbe343726df1760e8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.653074  6874 tablet_replica.cc:333] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.653200  8216 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:45.654559  6874 raft_consensus.cc:2243] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:45.655771  6874 raft_consensus.cc:2272] T bcacb9654fe1491c9fa2dc488d15060a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:45.659010  6874 tablet_replica.cc:333] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.659916  6874 raft_consensus.cc:2243] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:45.660586  6874 raft_consensus.cc:2272] T 72a3a306870b4fb1b1c3a1860a643731 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:45.651503  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.723383  6874 tablet_replica.cc:333] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:45.726349  6874 raft_consensus.cc:2243] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:24:45.839748  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 125760us
W20260709 12:24:45.915652 15921 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:24:45.958055  6874 raft_consensus.cc:2272] T 20d361a1924b450abb7d5c5dee1414ab P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.008481  8140 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:46.062211  6874 tablet_replica.cc:333] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.067128  6874 raft_consensus.cc:2243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.080085 15913 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:24:46.090999  6874 raft_consensus.cc:2272] T 9647a9c32fa748e4bc9548eb7a92bdfc P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.102025  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 377970us
I20260709 12:24:46.107666  6874 tablet_replica.cc:333] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.124101  6874 raft_consensus.cc:2243] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:24:46.132544  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 47933us
W20260709 12:24:46.135619  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 47468.7us
I20260709 12:24:46.124933 15818 raft_consensus.cc:493] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:46.142196  6874 raft_consensus.cc:2272] T 4fd78a3bdb9948dd8d81b02f2028748e P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.191378 15933 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.219202 15933 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.221872 15933 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.222548 15933 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:46.218302 15907 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.222867  6874 tablet_replica.cc:333] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.224468 15818 raft_consensus.cc:515] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:46.227020  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 55945.7us
I20260709 12:24:46.237254  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:46.145586  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1037a99772cf4ae487cf4f6c27f6d4af. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:46.243067  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 97653.9us
I20260709 12:24:46.251209  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.251209  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7bfc6a04b14b94bfa1ea185d2d50d7" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.223397 15907 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.259727  6874 raft_consensus.cc:2243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.136986 15877 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.264743  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.266053 15951 raft_consensus.cc:493] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:46.266964 15951 raft_consensus.cc:515] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.244849 15818 leader_election.cc:290] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.233317 15952 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.270092 15944 ts_tablet_manager.cc:933] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.269706 15818 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.248301 15933 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.288990 15818 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.293823 15818 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.295490 15818 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.296516  6874 raft_consensus.cc:2272] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.298647 15933 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.305564  6874 tablet_replica.cc:333] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.301539 15951 leader_election.cc:290] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.306290 15951 raft_consensus.cc:493] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:46.306861 15951 raft_consensus.cc:515] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.320770  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:46.321696  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 48357.3us
I20260709 12:24:46.320339  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.302124 15818 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.325775 15907 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:46.328141  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 66599.3us
I20260709 12:24:46.275979 15877 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.277462 15952 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.355297  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.359112 15924 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.361342  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.368216  6874 raft_consensus.cc:2243] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.372428 15877 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.365191 15818 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.388916  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.391088 15952 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.391206  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.359834 15924 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.394433 15956 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.393481 15913 raft_consensus.cc:2955] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:46.395054 15956 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.397866  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.349532 15951 leader_election.cc:290] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.415731  6874 raft_consensus.cc:2272] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.413728  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.401897  8137 raft_consensus.cc:2955] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:46.404557  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.410938 15818 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.440923  8035 leader_election.cc:304] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:46.438829 15818 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.413955 15877 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.449602 15818 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.452054 15924 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:46.453827  6874 tablet_replica.cc:333] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.413156 15953 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.429598 15951 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:24:46.461881  8035 raft_consensus.cc:2686] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 3d67d00ae45b444cbe343726df1760e8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:46.464716  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.470155  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.469852  8036 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.476437  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.456995 15944 tablet_copy_client.cc:323] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:24:46.475181  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.473357 15955 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:46.470618 15953 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:46.488361  8036 raft_consensus.cc:2686] T eef17f41a1d74cc39da4096cfd1d9edd P 3d67d00ae45b444cbe343726df1760e8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:46.490911  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.490937  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.493541  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.491770  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7490a68a6eb4ff18f8111dadec3d794" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.459640 15877 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.498227  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cee9f5adec64ff983b1c5510d0979af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.470886 15951 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:46.520684  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.519498 15933 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.525173  6874 raft_consensus.cc:2243] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.494796 15958 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.526232 15933 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.536826 15958 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.537967  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7583ede5b943628d7b1b33336c660a" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.548560  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.524976 15956 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.552511  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.552361  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.553524  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet b2db314cd9b6453daa5d171b91113f3a from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:24:46.555444  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet b2db314cd9b6453daa5d171b91113f3a from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-b2db314cd9b6453daa5d171b91113f3a
I20260709 12:24:46.557336 15953 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.530676 15955 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.567875  6874 raft_consensus.cc:2272] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.580750  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.541921 15918 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.586318 15918 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.585491 15951 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.593194 15918 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:46.552822 15954 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:46.602840 15954 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.605082 15954 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:46.602057  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 68816.1us
I20260709 12:24:46.600106 15951 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:46.606345 15951 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.608325 15929 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.608606 15951 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.608922 15929 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.566772 15956 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:46.611061  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.580490 15955 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:46.613443  8184 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:46.627647  8230 tablet_copy_source_session.cc:215] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:46.636264 15959 ts_tablet_manager.cc:933] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.638628  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.681435  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.690644 15956 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.692987 15956 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.695035 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43532 (request call id 4) took 1045 ms. Trace:
I20260709 12:24:46.695650 15913 rpcz_store.cc:276] 0709 12:24:45.649341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.649471 (+   130us) service_pool.cc:224] Handling call
0709 12:24:45.657408 (+  7937us) log.cc:844] Serialized 506 byte log entry
0709 12:24:45.951835 (+294427us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b54002ed220. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f498c9f5571 00007f498ca05142 00007f498c9e5eaa 00007f498c9ecd53 00007f498c9eccd9 00007f498c9ecc69 00007f498c9ecc31 00007f498c9ebdfd 0000000000388634 0000000000388479 00007f498999f475
0709 12:24:45.953715 (+  1880us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b180006dc60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498996d2a6 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1
0709 12:24:45.955108 (+  1393us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b180006dc60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:24:46.694932 (+739824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101,"raft.queue_time_us":23751,"raft.run_cpu_time_us":13025,"raft.run_wall_time_us":250488,"spinlock_wait_cycles":28715904,"thread_start_us":96735,"threads_started":1,"wal-append.queue_time_us":143746}
I20260709 12:24:46.725849 15923 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.726667 15923 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.739032  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe51432fd48472eb0166224a6ee8797" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.739327 15923 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.747340  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.748499  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.748040  8139 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
I20260709 12:24:46.748565  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.734434 15933 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.740824 15929 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.771579  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.764814  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:46.752549  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 75302.5us
I20260709 12:24:46.751181  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe588c3d3ed44709862cae072b8e205" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.771487  8146 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:46.782990 15959 tablet_copy_client.cc:323] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.131:41179
I20260709 12:24:46.780233 15932 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.785925 15944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2db314cd9b6453daa5d171b91113f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.785719 15932 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.785075 15955 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.744688 15877 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:46.790225  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.779255  8034 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.757050 15923 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.745777 15958 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.803651  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.804347  8758 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:46.789645 15932 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:46.856016 15923 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.873737  8138 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 16.
I20260709 12:24:46.865558  6874 tablet_replica.cc:333] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.875507  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.869398  8230 tablet_copy_service.cc:140] P 0c70d5020db543caa986f80b0adaa8d2: Received BeginTabletCopySession request for tablet 1037a99772cf4ae487cf4f6c27f6d4af from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:51784)
I20260709 12:24:46.877447  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07fb1a83da4d4a9ab7b5ef8e9f7f10" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.814350 15955 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:24:46.879930  6874 raft_consensus.cc:2243] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.880652  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:46.881615  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 105372us
I20260709 12:24:46.889568  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:46.890003  6874 raft_consensus.cc:2272] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.891347  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423b8f313a0947a3a2819068b1105a8e" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:46.890093  8214 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:46.902311  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:46.907595  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.907881  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:46.909698 15930 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:46.910094 15930 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.910504 15930 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:46.917323  6874 tablet_replica.cc:333] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:46.918217  6874 raft_consensus.cc:2243] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.889325 15934 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.925873 15934 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:46.901927  7963 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: config changed from index -1 to 10, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.885210  8230 tablet_copy_service.cc:161] P 0c70d5020db543caa986f80b0adaa8d2: Beginning new tablet copy session on tablet 1037a99772cf4ae487cf4f6c27f6d4af from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:51784: session id = 1659f359000d40bda3fc864911b1c75c-1037a99772cf4ae487cf4f6c27f6d4af
I20260709 12:24:46.929863 15923 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:46.946346 15966 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:46.947028 15966 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:46.948812 15955 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:46.953366  8035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.953586  8034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46066us
I20260709 12:24:46.954317  8034 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.932293  8731 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:46.961871  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 55240.6us
I20260709 12:24:46.965137  8230 tablet_copy_source_session.cc:215] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:46.968979  6874 raft_consensus.cc:2272] T 9a48757da78d43b99132b4e9a4da86c5 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.969458  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 67227.9us
I20260709 12:24:46.974000  8034 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:46.928519 15934 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:46.986459  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:46.979952  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.004410 15818 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:46.975389 15877 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:46.979099  8035 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:47.006923  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 99078.6us
I20260709 12:24:46.955629 15913 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.008456  8034 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.009308 15818 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:47.010174 15959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1037a99772cf4ae487cf4f6c27f6d4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:47.010725 15955 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:47.012494  8035 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
W20260709 12:24:47.146381  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 138493us
W20260709 12:24:47.021714  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46767.6us
I20260709 12:24:47.233418 15959 tablet_copy_client.cc:806] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:47.235203 15959 tablet_copy_client.cc:670] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:47.025861  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a31800511c940e48a418a30b32976fd" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.019615  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.019371  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f5552bf1b244738e961ee3f9a8554b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.020131  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23d9238fead43a79238d40702153004" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.161578  6874 tablet_replica.cc:333] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.048966  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.243146  6874 raft_consensus.cc:2243] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.244731  6874 raft_consensus.cc:2272] T 0cbf17a8c7e94e15b3279358c79cf509 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.018371 15913 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.247394  8220 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:24:47.206646 15923 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.249583  6874 tablet_replica.cc:333] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.249214 15923 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.251673  6874 raft_consensus.cc:2243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.034529 15930 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.021291 15956 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:47.096280 15944 tablet_copy_client.cc:806] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:47.254463  6874 raft_consensus.cc:2272] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.254683 15944 tablet_copy_client.cc:670] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:46.973202 15967 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:47.031289 15966 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.255827 15930 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:47.023749 15971 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:47.256919 15971 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.257454 15971 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:47.259323  8730 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:47.261643 15968 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:47.262248  6874 tablet_replica.cc:333] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.262203 15968 raft_consensus.cc:493] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.262908 15968 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:47.255896 15967 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.264344 15913 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:47.267019  8110 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.268375 15967 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:47.270090 15948 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:47.270594 15948 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.271039 15948 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:47.275157 15923 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:47.292423  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.293624 15959 tablet_copy_client.cc:538] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:47.303598 15944 tablet_copy_client.cc:538] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:47.304665 15968 raft_consensus.cc:515] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.308000 15968 leader_election.cc:290] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:47.313257  8035 raft_consensus.cc:2686] T 14112996240a40858e18c7a0d75b2a12 P 3d67d00ae45b444cbe343726df1760e8: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:24:47.316614  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 304158us
I20260709 12:24:47.317579  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:47.318518  8214 raft_consensus.cc:3060] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:47.318578  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:47.322798 15970 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.323609 15970 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.327543 15970 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.330065  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:47.339679 15971 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.348881  6874 raft_consensus.cc:2243] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.351262  6874 raft_consensus.cc:2272] T c14c286147e549768b521ff92a61fec9 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.361416 15967 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.362982  8756 raft_consensus.cc:2393] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 17: Already voted for candidate 1659f359000d40bda3fc864911b1c75c in this term.
I20260709 12:24:47.379709  8035 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:47.381507  8216 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:24:47.382860 15959 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:47.389643  6874 tablet_replica.cc:333] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.390569 15944 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
I20260709 12:24:47.391021 15956 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.392915  8035 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.405242  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.416663  8216 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 16.
I20260709 12:24:47.407836 15967 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.392071 15948 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.418774 15956 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:47.419402 15948 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.421139  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea9fb7818f049248d8577e73c087888" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:47.421756  8035 leader_election.cc:304] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:47.422063  8756 raft_consensus.cc:3060] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:47.424764 15952 raft_consensus.cc:2749] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:47.408731  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:47.409060 15971 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.412927  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:47.428026  8138 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c70d5020db543caa986f80b0adaa8d2 in current term 23: Already voted for candidate 92362bf8983f4a71a3511e987a2c6578 in this term.
I20260709 12:24:47.430580  8139 raft_consensus.cc:3060] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:47.432156  8756 raft_consensus.cc:2468] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:47.413841  8214 raft_consensus.cc:2468] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 18.
I20260709 12:24:47.390813  6874 raft_consensus.cc:2243] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.443651  6874 raft_consensus.cc:2272] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.447131 15937 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.448184  6874 tablet_replica.cc:333] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.451108  6874 raft_consensus.cc:2243] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.452977  6874 raft_consensus.cc:2272] T 423b8f313a0947a3a2819068b1105a8e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.452502  8730 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:47.456283 15967 raft_consensus.cc:2804] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:24:47.456969  8109 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 -> Peer 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761): Couldn't send request to peer 1659f359000d40bda3fc864911b1c75c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5979a1457c14f8297c9143773c4d85d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.457258 15967 raft_consensus.cc:697] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:47.453835 15937 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.458761 15967 consensus_queue.cc:237] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.456223  8035 leader_election.cc:304] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:47.465728 15956 raft_consensus.cc:2749] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.467991  8035 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.469144 15956 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:47.480553  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d399d9899c495382a6ba72d8479a9d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:47.488948 15923 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:47.490571  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.492982 15948 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:47.493489 15948 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.493922 15948 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:47.494825  8139 raft_consensus.cc:2468] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 17.
I20260709 12:24:47.497234  6874 tablet_replica.cc:333] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.511128 15930 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:47.514338  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 46520.4us
I20260709 12:24:47.513270 15930 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:47.520994  8109 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.522076  6874 raft_consensus.cc:2243] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.524258 15937 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:47.534693  8731 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.535077  8035 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.536046 15952 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.546679 15966 raft_consensus.cc:2804] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:47.547386 15966 raft_consensus.cc:697] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:47.548705 15930 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.548928 15966 consensus_queue.cc:237] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:47.547278  8109 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:47.551404  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 56858.8us
I20260709 12:24:47.555537  7963 catalog_manager.cc:5697] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 17 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 18 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.573019  6874 raft_consensus.cc:2272] T d5979a1457c14f8297c9143773c4d85d P 3d67d00ae45b444cbe343726df1760e8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.577416  8035 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.579785  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:47.580775  8214 raft_consensus.cc:2393] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 23: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:47.585503 15952 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:24:47.591550  8109 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.586241  6874 tablet_replica.cc:333] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.593310  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.594904  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:47.598783  8220 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 20.
I20260709 12:24:47.604189  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:47.600899 15930 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.607149 15930 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.612264 15930 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.618258 15974 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:47.624541  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 47316.1us
I20260709 12:24:47.625658  8035 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:47.626493  8035 raft_consensus.cc:2686] T 1037a99772cf4ae487cf4f6c27f6d4af P 3d67d00ae45b444cbe343726df1760e8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:47.627876  8035 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:47.629674 15937 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.630616 15937 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.640436 15952 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:47.636950 15948 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.644753 15948 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.646893 15937 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.648046  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:47.647971  6874 raft_consensus.cc:2243] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.648901  8139 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:47.653760  8109 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.664786  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.666218 15970 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:47.666692 15970 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.667105 15970 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:47.669943  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
W20260709 12:24:47.672079  8184 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.673924  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.674819 15971 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.672336  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcacb9654fe1491c9fa2dc488d15060a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:47.677026  8214 raft_consensus.cc:3060] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:47.681126 15923 raft_consensus.cc:2804] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:47.681525  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.681746 15923 raft_consensus.cc:697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:47.683415 15943 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:47.683049 15923 consensus_queue.cc:237] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:47.683878 15943 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:47.684350 15943 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:47.707307  8035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 79581.7us
I20260709 12:24:47.709869  6874 raft_consensus.cc:2272] T df7583ede5b943628d7b1b33336c660a P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.715862  8214 raft_consensus.cc:2468] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 17.
W20260709 12:24:47.726989  8109 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.727604  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 44393.5us
I20260709 12:24:47.720276  8035 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:47.732417  8109 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:47.734227  8109 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:47.733471  8184 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.735517  8184 leader_election.cc:304] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.737756 15943 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.694835 15974 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
I20260709 12:24:47.741467  7963 catalog_manager.cc:5697] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 16 to 17, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 17 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:47.742544  8109 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.743095  8109 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.743897 15918 raft_consensus.cc:2749] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:47.745733 15930 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:24:47.747200  8184 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.747773  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.750722  6874 tablet_replica.cc:333] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.754272 15943 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:47.750777 15937 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:47.760104 15952 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:47.762516  8184 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.776064  8184 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.768533  6874 raft_consensus.cc:2243] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:24:47.775830  8109 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.777954  6874 raft_consensus.cc:2272] T 1f3e3220f9e94cdfb85d6632a64db657 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.778496 15971 raft_consensus.cc:2749] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:24:47.779826  8184 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.782639  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.789785  8110 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:47.793594  8109 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.799494 15920 raft_consensus.cc:2804] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:47.799115  8216 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } } }
W20260709 12:24:47.794397  8109 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.811074  6874 tablet_replica.cc:333] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.815147 15939 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:47.815819  6874 raft_consensus.cc:2243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.817008  6874 raft_consensus.cc:2272] T 627e9613a1ca4f19a4b790eac7fbbf2a P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.822136  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d361a1924b450abb7d5c5dee1414ab" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:47.823105  8215 raft_consensus.cc:3060] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:47.823742  6874 tablet_replica.cc:333] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.824807  6874 raft_consensus.cc:2243] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.825485  6874 raft_consensus.cc:2272] T c6f5552bf1b244738e961ee3f9a8554b P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.828379  6874 tablet_replica.cc:333] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.818790 15970 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.833418  6874 raft_consensus.cc:2243] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.834120  6874 raft_consensus.cc:2272] T afe51432fd48472eb0166224a6ee8797 P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.834146  8220 raft_consensus.cc:2393] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 22: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:47.835055 15970 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.852952 15959 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:47.853034  8729 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.853730  8729 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:47.854244 15959 tablet_bootstrap.cc:492] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
W20260709 12:24:47.856168  8729 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.856878 15966 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:47.857957  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:47.858520  8139 raft_consensus.cc:3060] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:47.865024  8036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.874058  7963 catalog_manager.cc:5697] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 21 to 22, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 22 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.848181 15920 raft_consensus.cc:697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:47.883458  8139 raft_consensus.cc:2468] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
W20260709 12:24:47.874935  8109 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.884985  6874 tablet_replica.cc:333] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:47.885484  8186 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:47.885972  6874 raft_consensus.cc:2243] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.886691 15970 raft_consensus.cc:2804] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:47.886809  6874 raft_consensus.cc:2272] T 2937575a0ea644128c0e2d4ba3aab05e P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.888017  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 90825.8us
I20260709 12:24:47.889880 15959 ts_tablet_manager.cc:1403] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.507s	user 0.059s	sys 0.000s
I20260709 12:24:47.891948  8215 raft_consensus.cc:2468] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:47.894078 15920 consensus_queue.cc:237] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:47.892351  8184 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.904248 15987 ts_tablet_manager.cc:933] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Initiating tablet copy from peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:47.912434  8110 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.915939  8110 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:47.900197 15970 raft_consensus.cc:697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
W20260709 12:24:47.918948  8729 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:47.927325 15948 raft_consensus.cc:2804] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:47.928076 15948 raft_consensus.cc:697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:47.929395 15948 consensus_queue.cc:237] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.926461 15943 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:47.943182 15974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41746 (request call id 2) took 1168 ms. Trace:
I20260709 12:24:47.945119 15974 rpcz_store.cc:276] 0709 12:24:46.757347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.757483 (+   136us) service_pool.cc:224] Handling call
0709 12:24:46.790773 (+ 33290us) log.cc:844] Serialized 506 byte log entry
0709 12:24:47.044293 (+253520us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b1800322c60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f4989919c0a 00007f4993059219 00007f49899a1a40 00007f498999c4e4 00007f498999c455 00007f498c9e5b0b 00007f498ca6ab63 00007f498ca92752 00007f4991a52d29
0709 12:24:47.051492 (+  7199us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b1800322c60. stack: 00007f498996d343 00007f498996d240 00007f49892fc1d4 00007f499303a304 00007f499303a299 00007f4992867ab1 00007f4992874281 00007f498999f3f3 00007f49899a17c1 00007f49899a1779 00007f49899a1709 00007f49899a16d1 00007f49899a09cd 0000000000388634 0000000000388479 00007f498998283a
0709 12:24:47.923065 (+871573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31210,"raft.queue_time_us":99394,"raft.run_cpu_time_us":2390,"raft.run_wall_time_us":63292,"spinlock_wait_cycles":17189632,"thread_start_us":161003,"threads_started":1,"wal-append.queue_time_us":222988}
I20260709 12:24:47.970252 15970 consensus_queue.cc:237] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:47.967428 15959 raft_consensus.cc:359] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:47.972841  6874 tablet_replica.cc:333] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:24:48.023712  8729 leader_election.cc:336] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:48.029623  8729 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:48.030560  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.008483  7963 catalog_manager.cc:5697] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 16 to 17, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 17 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.034284  7963 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index -1 to 13, NON_VOTER 1659f359000d40bda3fc864911b1c75c (127.6.182.132) added. New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.007680 15959 raft_consensus.cc:740] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:48.037885 15959 consensus_queue.cc:260] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:48.036238  7963 catalog_manager.cc:5697] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 20 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 21 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.046032  6874 raft_consensus.cc:2243] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.046700  8139 raft_consensus.cc:1275] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:48.044780 15959 ts_tablet_manager.cc:1434] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.154s	user 0.010s	sys 0.000s
I20260709 12:24:48.063649  8229 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-1037a99772cf4ae487cf4f6c27f6d4af received from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:48.064224  8229 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-1037a99772cf4ae487cf4f6c27f6d4af on tablet 1037a99772cf4ae487cf4f6c27f6d4af with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:48.047817 15970 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.049943 15944 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.053512 15966 consensus_queue.cc:1048] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:48.056466  8215 raft_consensus.cc:1275] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:48.058207 15987 tablet_copy_client.cc:323] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Beginning tablet copy session from remote peer at address 127.6.182.130:37085
I20260709 12:24:48.060145  6874 raft_consensus.cc:2272] T 5a31800511c940e48a418a30b32976fd P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:48.073537  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:48.068727  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:48.074321  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.071261 15970 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.076474 15960 consensus_queue.cc:1048] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:48.080353  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:48.082069 15970 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:48.085443  6874 tablet_replica.cc:333] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:48.085613 15944 tablet_bootstrap.cc:492] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:48.086304  6874 raft_consensus.cc:2243] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.087316  6874 raft_consensus.cc:2272] T e23d9238fead43a79238d40702153004 P 3d67d00ae45b444cbe343726df1760e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.103675  8156 tablet_copy_service.cc:140] P 92362bf8983f4a71a3511e987a2c6578: Received BeginTabletCopySession request for tablet d5979a1457c14f8297c9143773c4d85d from peer 1659f359000d40bda3fc864911b1c75c ({username='slave'} at 127.0.0.1:34716)
I20260709 12:24:48.106902  8156 tablet_copy_service.cc:161] P 92362bf8983f4a71a3511e987a2c6578: Beginning new tablet copy session on tablet d5979a1457c14f8297c9143773c4d85d from peer 1659f359000d40bda3fc864911b1c75c at {username='slave'} at 127.0.0.1:34716: session id = 1659f359000d40bda3fc864911b1c75c-d5979a1457c14f8297c9143773c4d85d
W20260709 12:24:48.116158  8184 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.130501  6874 tablet_replica.cc:333] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:48.131937  6874 raft_consensus.cc:2243] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.133037  6874 raft_consensus.cc:2272] T 7fe588c3d3ed44709862cae072b8e205 P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:48.133482  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.114627 15944 ts_tablet_manager.cc:1403] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.725s	user 0.040s	sys 0.037s
I20260709 12:24:48.114208  7963 catalog_manager.cc:5697] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 21 to 22, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 22 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:48.144883  8184 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.161047  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:48.169312 15989 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:48.198266  8156 tablet_copy_source_session.cc:215] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:48.216892 15987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5979a1457c14f8297c9143773c4d85d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:48.228840  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.235803 15944 raft_consensus.cc:359] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:48.247394 15948 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:48.250710  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.237234 15944 raft_consensus.cc:740] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:48.252562 15948 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.261194 15948 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:48.263682  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.269634  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:48.270316  8220 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
I20260709 12:24:48.272753  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:48.273661 15923 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:48.274070 15923 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.274430 15923 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:48.276289  8109 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.301148 15944 consensus_queue.cc:260] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
W20260709 12:24:48.327982  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.341930  6874 tablet_replica.cc:333] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:48.342988  6874 raft_consensus.cc:2243] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.350869  6874 raft_consensus.cc:2272] T 4cee9f5adec64ff983b1c5510d0979af P 3d67d00ae45b444cbe343726df1760e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.357571  8757 raft_consensus.cc:1275] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:24:48.353578  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.364272 15974 consensus_queue.cc:1048] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:48.367408  8216 raft_consensus.cc:1275] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:48.375609 15974 consensus_queue.cc:1048] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:48.377667  8757 raft_consensus.cc:1217] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:24:48.394326  6874 tablet_replica.cc:333] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:48.395263  6874 raft_consensus.cc:2243] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.396353  6874 raft_consensus.cc:2272] T f7490a68a6eb4ff18f8111dadec3d794 P 3d67d00ae45b444cbe343726df1760e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.396762 15974 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.397351 15974 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:48.399430 15974 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:48.411278  8146 raft_consensus.cc:1275] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:24:48.413169  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:48.420301  8756 raft_consensus.cc:1217] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:24:48.420456 15918 consensus_queue.cc:1048] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:24:48.422353  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.415817 15923 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.438125 15923 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:48.439301 15944 ts_tablet_manager.cc:1434] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.278s	user 0.017s	sys 0.014s
I20260709 12:24:48.442485  8215 raft_consensus.cc:1275] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:24:48.463785  8109 leader_election.cc:336] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.479876 15993 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.480580 15993 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.483268  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a48757da78d43b99132b4e9a4da86c5" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:24:48.484041  8215 raft_consensus.cc:3060] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:48.485023  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:48.500083 15987 tablet_copy_client.cc:806] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:48.537021  8229 tablet_copy_service.cc:342] P 0c70d5020db543caa986f80b0adaa8d2: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-b2db314cd9b6453daa5d171b91113f3a received from {username='slave'} at 127.0.0.1:51784
I20260709 12:24:48.544140  8229 tablet_copy_service.cc:434] P 0c70d5020db543caa986f80b0adaa8d2: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-b2db314cd9b6453daa5d171b91113f3a on tablet b2db314cd9b6453daa5d171b91113f3a with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:48.506633 15948 consensus_queue.cc:1048] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:24:48.546802 15948 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:48.548612  6874 tablet_replica.cc:333] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:48.549566  6874 raft_consensus.cc:2243] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:48.550508  6874 raft_consensus.cc:2272] T c0351f909341497abfdf11bbc6fd51e0 P 3d67d00ae45b444cbe343726df1760e8 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:48.550917  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.532022 15987 tablet_copy_client.cc:670] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:48.525785 15913 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:48.574076  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 89149.6us
I20260709 12:24:48.589236 15913 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.601118 15952 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:48.601740 15952 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.602962 15913 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:48.615803  8215 raft_consensus.cc:2468] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
I20260709 12:24:48.585008 16009 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:48.622913  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.604054 15952 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:48.643795  8110 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:48.674293  6874 tablet_replica.cc:333] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
W20260709 12:24:48.660812 16012 log.cc:927] Time spent T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:24:48.686282  6874 raft_consensus.cc:2243] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:48.680014 15974 raft_consensus.cc:2804] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:24:48.731667  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 174468us
I20260709 12:24:48.651223 16009 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:48.737282  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:48.738076  8138 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:48.744213 15974 raft_consensus.cc:697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:48.734921 15993 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:48.790230  8109 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.801410  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:48.793352  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.815076 15952 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:48.815762 15952 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:48.826854  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:48.824892 16032 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:48.833595 16028 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.851193 15974 consensus_queue.cc:237] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.853510 16032 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:48.872501  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:48.881758 15952 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:48.877887 16032 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:48.865483 16028 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.902942  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:48.904224 16028 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:48.906023  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:48.916456  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:48.917156  8184 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:48.929565  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:48.934656 15987 tablet_copy_client.cc:538] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:24:48.937731  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:48.950832  8034 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:48.958220  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:48.965718  6874 raft_consensus.cc:2272] T ab203f6136b5456cacf2c4f8c664004b P 3d67d00ae45b444cbe343726df1760e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:48.954789 15952 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:48.952548  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:48.980579  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:48.981523  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:48.989055 16032 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:48.991514  8211 raft_consensus.cc:2393] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92362bf8983f4a71a3511e987a2c6578 in current term 21: Already voted for candidate 0c70d5020db543caa986f80b0adaa8d2 in this term.
I20260709 12:24:48.993046 16032 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:49.003211  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.003453 16036 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:49.003868  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.004393 16036 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:49.006979  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.007531 16036 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:49.008947  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.026485  6874 tablet_replica.cc:333] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:49.027908  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:49.035348 15952 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:49.035984 15952 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.038619 15952 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:49.038664  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:49.027411  6874 raft_consensus.cc:2243] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.041836  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "3d67d00ae45b444cbe343726df1760e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:48.989183 16009 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.044910  8034 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:49.009764  8109 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.044581 16023 raft_consensus.cc:1064] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:49.054924 15952 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:49.047592  8729 leader_election.cc:336] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.047745  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:49.062394  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.067030  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 263424us
W20260709 12:24:49.066306  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.069245  8184 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.074491  8035 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d67d00ae45b444cbe343726df1760e8; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:49.075562  8184 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.076223  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.066746  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.078778 16034 log.cc:927] Time spent T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:24:49.080084  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:49.080893  8138 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 21.
W20260709 12:24:49.078985  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.081874 15952 raft_consensus.cc:2706] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Received pre-election callback for term 12 while not running: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 12:24:49.075347  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.084681 16020 raft_consensus.cc:1064] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:49.087870  7963 catalog_manager.cc:5697] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 21 to 22, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130). New cstate: current_term: 22 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:49.088778 16030 raft_consensus.cc:3060] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:49.089414 15987 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Bootstrap starting.
W20260709 12:24:49.099264  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.099001  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.101483  6874 raft_consensus.cc:2272] T 4e65d7e0170f493eaf2756b296fa073c P 3d67d00ae45b444cbe343726df1760e8 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:49.100862  8729 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:49.103551  8109 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.087798 16020 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.108176  8729 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.109694  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:49.110163 16009 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:49.114578  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.115782 16009 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:49.116195 16009 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.116618 16009 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:49.108342  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.130646 15948 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.131193 15948 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.133328 15948 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:49.133852 15948 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:49.139883 16030 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:49.147348  6874 tablet_replica.cc:333] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:49.148337  6874 raft_consensus.cc:2243] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:49.163295  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.175429  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49190.9us
I20260709 12:24:49.176452  6874 raft_consensus.cc:2272] T dfc6e4aa49014b1fb0432076a5974c70 P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.177004  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:49.185909  8137 raft_consensus.cc:2468] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
W20260709 12:24:49.188068  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.189121  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.193893  8186 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.204769 16019 raft_consensus.cc:2804] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:49.205312 16019 raft_consensus.cc:697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:49.206233 16019 consensus_queue.cc:237] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:49.211833  8184 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.221863  8109 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.222384  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.160228 16023 consensus_queue.cc:237] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.237640  8137 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:49.236686 15974 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:24:49.261729  6874 tablet_replica.cc:333] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:49.264961 16039 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:49.268368  6874 raft_consensus.cc:2243] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.269253  6874 raft_consensus.cc:2272] T 2f18c688c54647cc96908c6b4eb6a80b P 3d67d00ae45b444cbe343726df1760e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.271329 16009 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.273346  8761 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:49.279088  6874 tablet_replica.cc:333] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8: stopping tablet replica
I20260709 12:24:49.295248  7960 catalog_manager.cc:5697] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 20 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 21 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.297467 16009 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.286468 15937 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:24:49.296506 16037 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
W20260709 12:24:49.307029  8729 leader_election.cc:336] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.309005  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:49.318097  8137 raft_consensus.cc:3060] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:49.318935  6874 raft_consensus.cc:2243] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:49.318604 16037 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.315666  8146 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:49.319689  6874 raft_consensus.cc:2272] T bdd3a4527b584efbaf9d73ae4556e10f P 3d67d00ae45b444cbe343726df1760e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:49.316154  8764 raft_consensus.cc:1275] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 LEARNER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:49.324777 16032 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:49.326270 16037 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.327363  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:49.328049  8146 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 17.
I20260709 12:24:49.329274  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:49.334901  8137 raft_consensus.cc:2468] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:24:49.336272  8731 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.337693 16002 raft_consensus.cc:2804] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:49.339394 16002 raft_consensus.cc:697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:24:49.341033 16042 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:49.341547 16042 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.341990 16042 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:49.341540 16002 consensus_queue.cc:237] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.367653 16032 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.353452 16039 consensus_queue.cc:1048] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:24:49.370558 16019 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.388003 15971 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.433845  8184 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.396265 15971 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.383534 16032 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.404209 16019 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.460662 16032 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:49.465852 15971 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:49.466179 16049 log.cc:927] Time spent T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:49.467202 16019 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:24:49.475636  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.487002  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:49.497387  8139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:49.498411  8139 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 23.
W20260709 12:24:49.502413  8109 consensus_peers.cc:597] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.470206 16046 log.cc:927] Time spent T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:49.502697  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:49.495515  8764 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:49.510396  8216 raft_consensus.cc:1275] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:24:49.522593 16037 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:24:49.528971 16037 raft_consensus.cc:493] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.529346 16037 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:49.536481 16028 consensus_queue.cc:1048] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:49.538388  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:49.539149  8145 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 24.
W20260709 12:24:49.543623  8184 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.544483  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
W20260709 12:24:49.546065  8184 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.549721 15918 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:24:49.550500 15918 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.551019 15918 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:24:49.549876  8184 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.556958 16037 raft_consensus.cc:515] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:24:49.604863  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 93802.6us
I20260709 12:24:49.609498 16037 leader_election.cc:290] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.609406  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.611601 16039 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:49.610764  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d6819393b345508f4a0ced5669567e" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:49.613812 16039 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:49.614102  8145 raft_consensus.cc:3060] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:24:49.613163  7962 catalog_manager.cc:5697] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 21 to 22, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 22 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.619262 16039 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:49.618963 16042 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.627070  8138 raft_consensus.cc:1275] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:24:49.629439  8184 leader_election.cc:336] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.640322 15971 consensus_queue.cc:1048] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 12:24:49.653379  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.632552 15918 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.679049 15918 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.678730  8145 raft_consensus.cc:2468] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 24.
I20260709 12:24:49.680433  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:49.681151  8137 raft_consensus.cc:3060] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:24:49.696030  8137 raft_consensus.cc:2468] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 25.
I20260709 12:24:49.692934  8186 leader_election.cc:304] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:49.701529  8186 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 
I20260709 12:24:49.708820 16019 raft_consensus.cc:2804] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:24:49.709563 16019 raft_consensus.cc:697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 24 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:49.711800 15971 raft_consensus.cc:2804] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:24:49.729602 15971 raft_consensus.cc:697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 25 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:49.730626 15971 consensus_queue.cc:237] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.734961 16019 consensus_queue.cc:237] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.745276 16039 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.749464 15997 raft_consensus.cc:2955] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:49.762506  8184 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.765740 16039 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:49.766480  8140 raft_consensus.cc:1275] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:24:49.763589  8184 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.782531  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627e9613a1ca4f19a4b790eac7fbbf2a" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:49.791502  8761 raft_consensus.cc:3060] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:49.781472 16036 consensus_queue.cc:1048] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:24:49.808761  8758 raft_consensus.cc:2955] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.826943 16042 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:49.830065 16020 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.839119  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
I20260709 12:24:49.840045  8138 raft_consensus.cc:3060] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:49.849642  8138 raft_consensus.cc:2468] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 18.
W20260709 12:24:49.850512  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.852974  8761 raft_consensus.cc:2468] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 21.
I20260709 12:24:49.853703  8186 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:49.852114  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 60434.4us
I20260709 12:24:49.848732  8756 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.858372 16039 raft_consensus.cc:2804] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:49.876808 16039 raft_consensus.cc:697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:49.888156 16039 consensus_queue.cc:237] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:49.894737  8138 raft_consensus.cc:2955] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.897303  8146 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.908265  8184 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:24:49.910385 15937 raft_consensus.cc:2804] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:49.910964 15937 raft_consensus.cc:697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:49.911969 15937 consensus_queue.cc:237] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:49.916983  7962 catalog_manager.cc:5697] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 10 to 11, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:49.926806  7962 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c reported cstate change: config changed from index 9 to 10, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:49.921861  8184 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:49.929554  7963 catalog_manager.cc:5697] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 22 to 24, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 24 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:49.961103  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.945008  7963 catalog_manager.cc:5697] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 24 to 25, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 25 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:49.986603  8109 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 319 similar messages]
W20260709 12:24:50.003511  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.040511 15987 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:50.042094 15987 tablet_bootstrap.cc:492] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Bootstrap complete.
I20260709 12:24:50.043177 15987 ts_tablet_manager.cc:1403] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Time spent bootstrapping tablet: real 0.954s	user 0.070s	sys 0.007s
W20260709 12:24:50.058562 16068 log.cc:927] Time spent T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:24:50.121336 16070 log.cc:927] Time spent T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:50.133922  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:50.137663 15987 raft_consensus.cc:359] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:50.138815 15987 raft_consensus.cc:740] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Initialized, Role: LEARNER
I20260709 12:24:50.147467 15987 consensus_queue.cc:260] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: NON_VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: true } }
I20260709 12:24:50.156719 15987 ts_tablet_manager.cc:1434] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.004s
I20260709 12:24:50.161855  8156 tablet_copy_service.cc:342] P 92362bf8983f4a71a3511e987a2c6578: Request end of tablet copy session 1659f359000d40bda3fc864911b1c75c-d5979a1457c14f8297c9143773c4d85d received from {username='slave'} at 127.0.0.1:34716
I20260709 12:24:50.162366  8156 tablet_copy_service.cc:434] P 92362bf8983f4a71a3511e987a2c6578: ending tablet copy session 1659f359000d40bda3fc864911b1c75c-d5979a1457c14f8297c9143773c4d85d on tablet d5979a1457c14f8297c9143773c4d85d with peer 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:50.190527  8146 raft_consensus.cc:1275] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:24:50.214357 15971 consensus_queue.cc:1048] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:50.216073  7963 catalog_manager.cc:5697] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 17 to 18, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 18 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.217854  7963 catalog_manager.cc:5697] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 20 to 21, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 21 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.273255  8216 consensus_queue.cc:237] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:50.299403  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.322324  8140 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:24:50.336104  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.336928 15937 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:50.347031  8138 raft_consensus.cc:1275] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:50.370338 15989 consensus_queue.cc:1048] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:50.381791  8756 raft_consensus.cc:1275] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:50.391593 16023 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:50.401089  8756 raft_consensus.cc:1275] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:50.413376 16009 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:50.426967 16009 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:50.429258 16009 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:50.431203  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:50.440163 15937 consensus_queue.cc:1048] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:50.440832  8729 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:50.441360  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:50.446189 16002 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:50.451133 16039 consensus_queue.cc:1048] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:50.417017  8138 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:50.419914  8146 raft_consensus.cc:1275] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:24:50.477257 16039 consensus_queue.cc:1048] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:24:50.483294  8109 connection.cc:769] client connection to 127.6.182.129:34867 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:24:50.503715  7953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2db314cd9b6453daa5d171b91113f3a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:50.506608  8756 raft_consensus.cc:2955] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:50.526576  8184 connection.cc:769] client connection to 127.6.182.129:34867 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:24:50.543386  7963 catalog_manager.cc:5697] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 10 to 11, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 14 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:50.560081  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:50.618276  8109 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.623245  8761 raft_consensus.cc:1217] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
W20260709 12:24:50.634730  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.688890  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:50.701341  7952 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 72267.9us
W20260709 12:24:50.707792  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b2db314cd9b6453daa5d171b91113f3a: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:50.732200  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:50.732802  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.759392 16023 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:50.760084 16023 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:50.762494 16023 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:50.771152  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:50.776830  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:50.798290  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:50.798964  8756 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 22.
W20260709 12:24:50.836906  8184 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:50.838681  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:50.839872 16020 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:50.840282 16020 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d67d00ae45b444cbe343726df1760e8)
I20260709 12:24:50.840670 16020 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:50.849436 16020 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:50.879382 16020 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Requested vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:50.898710  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:50.905529  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:24:50.906189  8756 raft_consensus.cc:3060] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:24:50.911499  8184 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:50.918291  8756 raft_consensus.cc:2468] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 23.
W20260709 12:24:50.921418  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:50.922412  8184 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:50.923296 16023 raft_consensus.cc:2804] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:50.923820 16023 raft_consensus.cc:697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:24:50.924697 16023 consensus_queue.cc:237] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:50.964422  7963 catalog_manager.cc:5697] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 22 to 23, leader changed from 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 23 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:51.006286  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.025957  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.028785  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.053560 15990 raft_consensus.cc:1064] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: attempting to promote NON_VOTER 1659f359000d40bda3fc864911b1c75c to VOTER
I20260709 12:24:51.056600 15990 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:51.065222  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.078425  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.082144  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.091264  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.092849  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.095805  8756 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 LEARNER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:51.096880  8216 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:51.100059 16017 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:51.106799 16028 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:24:51.143200 16085 log.cc:927] Time spent T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:24:51.156951  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.254065  8109 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:51.270383  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.283892 16015 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:51.334239  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 51673.8us
W20260709 12:24:51.335682  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.336180  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.336673  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.356801  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.401209  8756 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:51.451826  7963 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.482982  8140 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:51.491196  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.493538  6874 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8091)
I20260709 12:24:51.504801  8216 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 1659f359000d40bda3fc864911b1c75c (127.6.182.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } attrs { replace: true } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:51.581833  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 70253.2us
W20260709 12:24:51.596997  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.597579  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.605576  8756 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:51.606076  8213 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:51.611091  8756 raft_consensus.cc:1275] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:24:51.624828 16028 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:24:51.631863  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.645893  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.646610  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.651479  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.699460  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 62564.9us
I20260709 12:24:51.700853 16023 consensus_queue.cc:1048] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:24:51.701135 16028 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
I20260709 12:24:51.707407 15990 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:51.711632  8758 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:51.733027  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.743718  7954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5979a1457c14f8297c9143773c4d85d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:51.765893  8216 raft_consensus.cc:2955] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } } }
W20260709 12:24:51.777729  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.778550  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:51.779495  7960 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: config changed from index 14 to 15, VOTER 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129) evicted. New cstate: current_term: 19 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:51.828945  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:51.829913  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:51.833860  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:51.870870  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:52.106552  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:52.194907  8109 consensus_peers.cc:597] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:52.205600  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:52.494196  6874 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8091)
I20260709 12:24:53.180792 16015 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.181407 16015 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:53.183533 16015 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:24:53.198906  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 920116us
I20260709 12:24:53.229600  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.246946 16099 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.247579 16099 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.269924 16106 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:53.270604 16106 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.258268 16094 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.278687 16094 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.284878 16036 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.285521 16036 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:53.287744  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdc80 after lost signal to thread 6877
I20260709 12:24:53.288499 16099 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:53.288955  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080038e4a0 after lost signal to thread 8001
W20260709 12:24:53.290531  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b2db314cd9b6453daa5d171b91113f3a: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:53.290946  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003785a0 after lost signal to thread 8170
I20260709 12:24:53.289491 16107 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:53.301301 16094 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:53.307025 16107 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:53.307483  8109 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.308058  8109 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:53.289415 16106 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:53.312474  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:53.313666  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.310760 16094 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:53.315552 16094 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.318002 16094 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:53.318154 16107 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:53.318627  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1740 after lost signal to thread 8244
I20260709 12:24:53.318780 16107 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:53.319587 16036 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:53.319321 16107 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:53.322438  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.322959  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:53.323081  8140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f18c688c54647cc96908c6b4eb6a80b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:53.314723  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.324995 16098 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.325573 16098 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.326443 16100 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:53.327961 16098 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:53.329146 16107 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:53.332526  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08002a04e0 after lost signal to thread 8790
W20260709 12:24:53.334367  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:53.335696 16036 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.336477 16036 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.338862 16036 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:53.345767 16098 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.346478 16098 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:53.348353  8109 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.349639 16098 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:24:53.355160  8109 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.370530 16110 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:53.371455 16110 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:53.374181 16110 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:53.384235 16098 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:24:53.384895 16098 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:24:53.387045 16098 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:53.390431  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.407173  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:53.412813  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:53.421836  8729 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.434312  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.435954  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.437393  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.439004  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:53.435982  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.445799  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.446313  8729 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.446718  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:53.447511 16036 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:53.448339  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.449762  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.449868  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.451419  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab203f6136b5456cacf2c4f8c664004b" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.468906  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.470886  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:53.481614  8110 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:53.483469 16100 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:53.494892  6874 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8091)
I20260709 12:24:53.506742  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:53.509935 16099 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:53.533529  8109 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:53.534809 16098 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:53.538574  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:53.539354 16098 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:53.540597  8109 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:24:53.541471  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:53.541716 16114 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:53.545689 16112 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:53.577951  8184 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:53.580847  8730 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:53.581787 16036 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:53.587340  8730 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:53.592427 16036 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:53.604661  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:53.617126  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:53.637318  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.708050  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:53.774181  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:53.781606  8184 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:53.782902 16104 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:53.788684 16105 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:53.861738  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:53.865622  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:53.957078  7952 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50759.9us
W20260709 12:24:53.963984  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:53.975797  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:54.051425  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.150182  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.170087  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.202075  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.430806  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.456187  8109 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:54.460973  8109 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:24:54.460388  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:54.464051 15990 raft_consensus.cc:2749] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:54.477638  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.484114  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:54.495442  6874 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8091)
W20260709 12:24:54.512531  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.523164  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.523866  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.554726  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.567134  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.610334  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:54.662500  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:54.737962  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.780601  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.800696  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 84880.1us
W20260709 12:24:54.922206  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.975387  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.982566  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:54.989710  8729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111) [suppressed 384 similar messages]
W20260709 12:24:55.023902  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.144639  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:55.146849  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:55.327080  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.346630  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.366729  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.374027  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.395524  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.413825  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.417968  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.442374  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.497321  6874 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8091)
W20260709 12:24:55.660733  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.825467  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.826759  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.830868  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 76265.8us
W20260709 12:24:55.825230  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 63872.5us
W20260709 12:24:55.855384  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:55.872886  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:55.876744  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:55.964956  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.036443  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.064690  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.128954  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:56.309655  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.327191  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.366932  8109 consensus_peers.cc:597] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:56.497876  6874 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8091)
W20260709 12:24:56.544466  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:56.582697  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.622335  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.704557  8787 debug-util.cc:398] Leaking SignalData structure 0x7b080024ec80 after lost signal to thread 6877
W20260709 12:24:56.705773  8787 debug-util.cc:398] Leaking SignalData structure 0x7b0800350200 after lost signal to thread 8001
W20260709 12:24:56.707142  8787 debug-util.cc:398] Leaking SignalData structure 0x7b080037faa0 after lost signal to thread 8170
W20260709 12:24:56.723878  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.727126  8787 debug-util.cc:398] Leaking SignalData structure 0x7b0800379340 after lost signal to thread 8244
W20260709 12:24:56.728528  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8da0 after lost signal to thread 8790
W20260709 12:24:56.789204  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.824679  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:56.888157  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.909726  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:56.992112  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.032263  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.044713  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 66345us
W20260709 12:24:57.044895  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.094149  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.120077  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.143927  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.145870  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:57.159271  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.283331  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:57.335966  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.474243  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:57.498601  6874 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8091)
W20260709 12:24:57.472606  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.306490  8729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 834061us
W20260709 12:24:58.225965  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.011s	sys 0.005s
W20260709 12:24:58.308204  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.011s	sys 0.006s
W20260709 12:24:58.298501  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 824460us
I20260709 12:24:58.455420 16162 raft_consensus.cc:493] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:58.456827 16162 raft_consensus.cc:515] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.461849 16162 leader_election.cc:290] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:58.480154  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.499033 16162 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.509429 16162 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.512248 16162 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:58.519197  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.531710 16169 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.532660 16169 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.531839 16165 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.535941 16165 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.538486 16165 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:58.539564 16169 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:58.541435  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef17f41a1d74cc39da4096cfd1d9edd" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.536314 16162 raft_consensus.cc:493] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:24:58.542546 16162 raft_consensus.cc:515] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.543900  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90659c1daf854b0f9323204cf80f7aeb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.546151 16162 leader_election.cc:290] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:58.556252 16165 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.563992 16165 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.566730 16165 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:58.567417  8137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
W20260709 12:24:58.570672  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:58.577306  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.583894  8756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9927bbb5560416bbc804210e19bb0ce" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:58.585294  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14112996240a40858e18c7a0d75b2a12" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:24:58.588186  8758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:24:58.588860  8729 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:58.588961  8758 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:24:58.589635  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:58.590758  8729 leader_election.cc:336] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:58.592813  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.591270 16165 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:58.596422 16165 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:58.601014  8184 leader_election.cc:336] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:58.648253  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.652112  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.659860  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.661074  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.662900  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:58.676676  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:58.701503 16169 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.702246 16169 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.704607 16169 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:24:58.706985 16165 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.708186 16165 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.709075  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.713960  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0351f909341497abfdf11bbc6fd51e0" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.714733 16165 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
I20260709 12:24:58.716763 16165 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.717419 16165 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:24:58.748170  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.753440  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:58.781253 16165 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:24:58.849588  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:24:58.851976  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa46cdee469046e0a85f4a03d2e03f92" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:24:58.860929  8184 leader_election.cc:304] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.864588 16154 raft_consensus.cc:2749] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:24:58.865983  8729 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:24:58.866611  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.867507 16165 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:24:58.868597  8729 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:58.748987  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.872219  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 123284us
I20260709 12:24:58.876587  8184 leader_election.cc:304] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:24:58.877756 16159 raft_consensus.cc:2749] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.880656  8731 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.881850 16165 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:58.885242  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.886426 16159 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:58.887642 16159 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:24:58.890672 16159 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:58.933403 16159 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:58.937142 16159 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:24:58.937455  8138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578"
W20260709 12:24:58.944506  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:58.946570  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:58.945901  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:58.962131 16163 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:58.967053  8730 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:24:58.969048  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.949599  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:58.970360  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:58.977433 16169 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.996471  8213 raft_consensus.cc:1240] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Rejecting Update request from peer 92362bf8983f4a71a3511e987a2c6578 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:58.998239 16176 consensus_queue.cc:1059] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:58.999445 16176 raft_consensus.cc:3055] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:58.999830 16176 raft_consensus.cc:740] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:24:59.001168 16176 consensus_queue.cc:260] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:24:59.002856 16176 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:59.041419  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080035cde0 after lost signal to thread 6877
W20260709 12:24:59.042698  8167 debug-util.cc:398] Leaking SignalData structure 0x7b0800360f40 after lost signal to thread 8001
W20260709 12:24:59.044158  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003665c0 after lost signal to thread 8170
W20260709 12:24:59.045475  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08001e61a0 after lost signal to thread 8244
W20260709 12:24:59.046803  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080027c800 after lost signal to thread 8790
W20260709 12:24:59.047149  8167 debug-util.cc:398] Leaking SignalData structure 0x7b0800294880 after lost signal to thread 16075
W20260709 12:24:59.047407  8167 debug-util.cc:398] Leaking SignalData structure 0x7b080039f020 after lost signal to thread 16111
W20260709 12:24:59.047640  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa1a0 after lost signal to thread 16117
I20260709 12:24:59.047828  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:24:59.047873  8167 debug-util.cc:398] Leaking SignalData structure 0x7b08003e91e0 after lost signal to thread 16126
W20260709 12:24:59.060707  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:59.073378  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:24:59.076869 16159 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:24:59.082620  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.199116  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.325675  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.421094  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.421810  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.434839  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.459283  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.472577  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:59.550931  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.652696  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.659365  7952 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 96713.4us
W20260709 12:24:59.690213  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b2db314cd9b6453daa5d171b91113f3a: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:24:59.787652  8109 consensus_peers.cc:597] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:59.822727  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.887111  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.940806  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:59.990831  8109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111) [suppressed 378 similar messages]
W20260709 12:24:59.991561  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.094285  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:00.122526  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.133889  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.184475 16176 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.185228 16176 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:00.199204  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:00.201494 16176 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:00.207000  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:25:00.241896  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.252204  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:00.252990  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 21.
W20260709 12:25:00.285450  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.287171  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:00.288923 16188 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:00.289499 16188 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.289909 16188 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:00.330718  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.349613 16188 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:00.384843 16188 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Requested vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:00.387639  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
W20260709 12:25:00.416813  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.433727  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:25:00.434396  8217 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:00.456974  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92362bf8983f4a71a3511e987a2c6578 in term 22.
W20260709 12:25:00.469933  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.482030  8110 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:00.483637 16188 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:00.488294 16188 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Becoming Leader. State: Replica: 92362bf8983f4a71a3511e987a2c6578, State: Running, Role: LEADER
I20260709 12:25:00.489619 16188 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:00.541100 16165 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:00.541740 16165 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:00.549276  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:00.550148  8217 raft_consensus.cc:2368] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
W20260709 12:25:00.548870  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 48633.9us
I20260709 12:25:00.550568  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "92362bf8983f4a71a3511e987a2c6578" is_pre_election: true
I20260709 12:25:00.544183 16165 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:00.575423  8730 leader_election.cc:400] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
I20260709 12:25:00.575893  8730 leader_election.cc:403] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:00.579521 16169 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Advancing to term 22
W20260709 12:25:00.587425  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:00.626413  7962 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "92362bf8983f4a71a3511e987a2c6578" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.676061 16169 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179) with higher term. Message: Invalid argument: T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1659f359000d40bda3fc864911b1c75c for earlier term 21. Current term is 22.
W20260709 12:25:00.682972  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.683708  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.728535  8731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:37085, user_credentials={real_user=slave}} blocked reactor thread for 92071.7us
W20260709 12:25:00.751282  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.851306  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.855314  8109 consensus_peers.cc:597] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:00.855919  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:00.925937  8217 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:25:00.927862 16188 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:25:00.940168  8761 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Refusing update from remote peer 92362bf8983f4a71a3511e987a2c6578: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:25:00.941932 16188 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:25:01.062036  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.096016  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:01.117591  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.145176  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.200656  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.228308  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.264880  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:01.287842  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.323555  8109 consensus_peers.cc:597] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.326979  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:01.332461  8730 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 49378.9us
W20260709 12:25:01.409875  8109 consensus_peers.cc:597] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.444842  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.465956  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:01.469851  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.496090  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.693990  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:01.717636  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.779927  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:01.810438  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:01.911942  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.036286  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:02.098248  8109 consensus_peers.cc:597] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:02.116525  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.125512  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.129143  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:02.178762  8109 consensus_peers.cc:597] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:02.267373  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
W20260709 12:25:02.372869  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.444768  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.453102  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.474821  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.497684  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:02.543234  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.564607  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.580214  8109 consensus_peers.cc:597] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:02.630460  8109 consensus_peers.cc:597] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.406997  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:25:03.433912  8728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.007s	sys 0.005s
W20260709 12:25:03.435791  8728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.007s	sys 0.005s
W20260709 12:25:03.441978  8111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.010s
W20260709 12:25:03.442488  8111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.004s	sys 0.010s
W20260709 12:25:03.465652  8186 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.466599  8186 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.468231  8186 consensus_peers.cc:597] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.480085  8186 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.481493  8186 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.495992  8186 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.499279  8186 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.507121  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:03.524912  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:03.515139  8186 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.526021  8186 consensus_peers.cc:597] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.526660  8186 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.545362  8186 consensus_peers.cc:597] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.558701  8186 consensus_peers.cc:597] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.577564  8186 consensus_peers.cc:597] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.582151  8186 consensus_peers.cc:597] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.591957  8186 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.597184  8186 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.646692  8186 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.660995  8731 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.689265  8731 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.691443  8731 consensus_peers.cc:597] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.697177  8731 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.697953  8731 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.698761  8731 consensus_peers.cc:597] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.699474  8731 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.701532  8731 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:03.713581 16221 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:25:03.714229  8731 consensus_peers.cc:597] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.716586  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:03.719908 16220 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.720945 16220 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.715335 16221 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.726737 16221 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.743042 16233 raft_consensus.cc:493] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:03.743717 16233 raft_consensus.cc:515] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.743044 16220 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.755296 16233 leader_election.cc:290] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.760188 16233 raft_consensus.cc:493] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.760969 16233 raft_consensus.cc:515] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.763674 16233 leader_election.cc:290] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:03.772132  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 52842.5us
I20260709 12:25:03.793205  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.796277 16223 raft_consensus.cc:493] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.797117  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.796959 16223 raft_consensus.cc:515] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.807614  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3e3220f9e94cdfb85d6632a64db657" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.808553 16242 raft_consensus.cc:493] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:03.809175 16242 raft_consensus.cc:515] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.810694 16223 leader_election.cc:290] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:03.815536 16230 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:03.816185 16230 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.819015 16230 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:03.822074 16221 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.833755 16221 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.838817  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2937575a0ea644128c0e2d4ba3aab05e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.841933  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.828272 16229 raft_consensus.cc:493] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.846370  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.846134 16229 raft_consensus.cc:515] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.848260 16223 raft_consensus.cc:493] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:03.848991 16223 raft_consensus.cc:515] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.849555 16229 leader_election.cc:290] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:03.851331 16223 leader_election.cc:290] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.836175 16221 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.830092 16242 leader_election.cc:290] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.858961 16229 raft_consensus.cc:493] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.858961 16223 raft_consensus.cc:493] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.859753 16229 raft_consensus.cc:515] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.860344 16223 raft_consensus.cc:515] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.862128 16229 leader_election.cc:290] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:03.862989 16223 leader_election.cc:290] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:03.872418  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 92681.3us
I20260709 12:25:03.875743  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd78a3bdb9948dd8d81b02f2028748e" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.879226 16242 raft_consensus.cc:493] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
W20260709 12:25:03.876602  8731 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:03.880013  8731 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:03.879980 16242 raft_consensus.cc:515] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.882905 16242 leader_election.cc:290] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.883496 16230 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:03.879688  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.886227  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.892930 16242 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.893589 16242 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.895973 16242 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.898443 16242 raft_consensus.cc:493] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:03.898993 16242 raft_consensus.cc:515] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:03.901539 16242 leader_election.cc:290] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:03.925217 16242 raft_consensus.cc:493] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:03.925843 16242 raft_consensus.cc:515] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:03.926744  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f036b82035545a1beb20d54efe5a550" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:03.928215 16242 leader_election.cc:290] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:03.932050  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badbfade73ce40f0a89515d01fe50bd6" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.933920  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e65d7e0170f493eaf2756b296fa073c" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:03.943084  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac2bed7a5004a9dbb30cda857b5ef6d" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:03.971390  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3a4527b584efbaf9d73ae4556e10f" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:03.988301  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0a66399b64e649f375238dc4cbcde" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:03.996177  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:03.999866  6874 tablet_replica.cc:333] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.001201  6874 raft_consensus.cc:2243] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.002678  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e200bb1befd04bcf9b902618b83b1f88" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.008296  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14c286147e549768b521ff92a61fec9" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.003119  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753bdf66ab9c48ceb9558028f4bcf7e1" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.006775  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.012071  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5d19ae7b44bd6bff5e8b59a820ffb" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.016839  6874 raft_consensus.cc:2272] T 61d6819393b345508f4a0ced5669567e P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.020004  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ed3b4d69eb4982923a37293db3b766" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:25:04.023363  8109 consensus_peers.cc:597] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:04.031670  8109 consensus_peers.cc:597] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:04.033494 16242 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.034102 16242 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.037945 16223 raft_consensus.cc:493] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:04.038468 16223 raft_consensus.cc:515] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.039346 16242 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.040766 16223 leader_election.cc:290] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.052271  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08eb4ae8cb45649565146d64ab2983" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.054898  8109 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.055779 16229 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:04.056588  8109 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.058380 16223 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:04.059144 16223 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.059681 16223 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.062206 16223 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.063127  8109 leader_election.cc:304] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.064000 16229 raft_consensus.cc:2749] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:04.064484  8109 leader_election.cc:304] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.065325 16229 raft_consensus.cc:2749] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:04.065781  8109 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.066617 16229 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:04.072965  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.074842  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72a3a306870b4fb1b1c3a1860a643731" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:25:04.078522  8109 consensus_peers.cc:597] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:04.079233  8109 leader_election.cc:336] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.079654  8109 leader_election.cc:304] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.080435 16229 raft_consensus.cc:2749] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:25:04.080650  8109 leader_election.cc:336] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.081199  8109 leader_election.cc:304] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.081976 16229 raft_consensus.cc:2749] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:25:04.082185  8109 leader_election.cc:336] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.082705  8109 leader_election.cc:304] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.083444 16229 raft_consensus.cc:2749] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:04.083664  8109 leader_election.cc:336] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.084412  8109 leader_election.cc:304] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.085166 16229 raft_consensus.cc:2749] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:04.087733  8109 leader_election.cc:336] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.088204  8109 leader_election.cc:304] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.088975 16229 raft_consensus.cc:2749] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:04.092871  8109 leader_election.cc:336] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.093380  8109 leader_election.cc:304] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.094151 16229 raft_consensus.cc:2749] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:04.095157  8109 leader_election.cc:336] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.095628  8109 leader_election.cc:304] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.096380 16229 raft_consensus.cc:2749] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:04.097388  8109 leader_election.cc:336] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.102210 16229 raft_consensus.cc:493] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:04.102564  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.102912 16229 raft_consensus.cc:515] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.103385 16223 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.103981 16223 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.105822 16229 leader_election.cc:290] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.106590 16229 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.097715  6874 tablet_replica.cc:333] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.107128 16229 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.109517 16229 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.106611 16223 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:04.118079  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.108357  6874 raft_consensus.cc:2243] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.118924  8757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.119403  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:04.122574 16223 raft_consensus.cc:493] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.123167 16223 raft_consensus.cc:515] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:04.123792 16229 raft_consensus.cc:493] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:04.124457 16229 raft_consensus.cc:515] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:04.125521 16223 leader_election.cc:290] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:04.127182 16229 leader_election.cc:290] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:04.130118  6874 raft_consensus.cc:2272] T a313281992bb42fbb55e3eb70444bb6f P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.136977  8109 leader_election.cc:336] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.137554  8109 leader_election.cc:304] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.138355 16223 raft_consensus.cc:2749] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:04.138691  8109 leader_election.cc:336] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.139199  8109 leader_election.cc:304] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.139961 16223 raft_consensus.cc:2749] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:04.140210  8109 consensus_peers.cc:597] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:04.149111  6874 tablet_replica.cc:333] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.160053  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273de299acf94214b44aab4591da9b3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.165289  8110 leader_election.cc:304] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.166652 16223 raft_consensus.cc:2749] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:04.171144  8110 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.171964 16223 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:04.173640  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2db314cd9b6453daa5d171b91113f3a" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.181126  6874 raft_consensus.cc:2243] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:04.185002 16242 raft_consensus.cc:670] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:25:04.194130 16221 raft_consensus.cc:493] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1659f359000d40bda3fc864911b1c75c)
I20260709 12:25:04.194737 16221 raft_consensus.cc:515] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.196950 16232 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:04.197633 16232 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:04.199944 16232 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:04.197639 16221 leader_election.cc:290] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:25:04.206456  8729 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:04.207670  8109 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.208230  8109 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 1659f359000d40bda3fc864911b1c75c, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.210695  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03e6a3f73454ce8a6a8e18e83852297" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.212984  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1037a99772cf4ae487cf4f6c27f6d4af" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.214898  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7fc19421924a9a9d7c350bf097e173" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.217998  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6e4aa49014b1fb0432076a5974c70" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.220254  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.220613  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cbf17a8c7e94e15b3279358c79cf509" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:04.225351 16221 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:04.226492  6874 raft_consensus.cc:2272] T b9927bbb5560416bbc804210e19bb0ce P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.245553  6874 tablet_replica.cc:333] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.246615  6874 raft_consensus.cc:2243] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.247352  6874 raft_consensus.cc:2272] T badbfade73ce40f0a89515d01fe50bd6 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.252319  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767edb8a304f440591a33aae36a36252" candidate_uuid: "92362bf8983f4a71a3511e987a2c6578" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:25:04.270466  8731 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:04.271020  8731 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:04.272415 16232 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:04.278661  8109 leader_election.cc:336] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:04.284340  8109 leader_election.cc:336] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:04.302070  8110 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.304741 16223 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:04.309514  8110 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.323037  6874 tablet_replica.cc:333] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.325563 16223 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:04.328145  6874 raft_consensus.cc:2243] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.328939  6874 raft_consensus.cc:2272] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.335110  8110 leader_election.cc:304] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.349139 16223 raft_consensus.cc:2749] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:04.390381  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:04.399268  8109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 57203.7us
W20260709 12:25:04.401090  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 60071.5us
W20260709 12:25:04.402117  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 67101.6us
I20260709 12:25:04.425529  8110 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.457751  6874 tablet_replica.cc:333] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.458747  6874 raft_consensus.cc:2243] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.460220 16223 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:04.475819  8109 consensus_peers.cc:597] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:04.477170  8110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41179, user_credentials={real_user=slave}} blocked reactor thread for 51739.3us
W20260709 12:25:04.489841  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08003e04c0 after lost signal to thread 6877
W20260709 12:25:04.493949  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08002e92e0 after lost signal to thread 8001
W20260709 12:25:04.495311  8787 debug-util.cc:398] Leaking SignalData structure 0x7b080037f9e0 after lost signal to thread 8170
W20260709 12:25:04.496425  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2ea0 after lost signal to thread 8244
W20260709 12:25:04.497761  8787 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0ea0 after lost signal to thread 8790
I20260709 12:25:04.501026  6874 raft_consensus.cc:2272] T fae0a66399b64e649f375238dc4cbcde P 92362bf8983f4a71a3511e987a2c6578 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.491601  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:04.510933  8110 leader_election.cc:304] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:04.532073 16229 raft_consensus.cc:2749] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:04.514353  6874 tablet_replica.cc:333] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.539135  6874 raft_consensus.cc:2243] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.540160  6874 raft_consensus.cc:2272] T dea9fb7818f049248d8577e73c087888 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.543565  6874 tablet_replica.cc:333] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.545118  6874 raft_consensus.cc:2243] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.545996  6874 raft_consensus.cc:2272] T dbbb2d697a734b0baef1073024333311 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.550981  6874 tablet_replica.cc:333] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.551972  6874 raft_consensus.cc:2243] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:04.555362  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:04.556368  6874 raft_consensus.cc:2272] T 4a08eb4ae8cb45649565146d64ab2983 P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.574338  6874 tablet_replica.cc:333] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
W20260709 12:25:04.557719  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:04.582898  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:04.586870  6874 raft_consensus.cc:2243] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.581954  8110 leader_election.cc:304] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c
I20260709 12:25:04.592585 16223 raft_consensus.cc:2749] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:04.594108  8110 leader_election.cc:304] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92362bf8983f4a71a3511e987a2c6578; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
W20260709 12:25:04.588932  8109 consensus_peers.cc:597] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:04.597697  8109 consensus_peers.cc:597] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:04.590539  6874 raft_consensus.cc:2272] T 90659c1daf854b0f9323204cf80f7aeb P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.598913  8110 raft_consensus.cc:2686] T 0cbf17a8c7e94e15b3279358c79cf509 P 92362bf8983f4a71a3511e987a2c6578: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:25:04.632014  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:04.641618  6874 tablet_replica.cc:333] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.642645  6874 raft_consensus.cc:2243] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:25:04.646450  8109 consensus_peers.cc:597] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:04.644196  6874 raft_consensus.cc:2272] T aa46cdee469046e0a85f4a03d2e03f92 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.664475  6874 tablet_replica.cc:333] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.757854  7956 maintenance_manager.cc:419] P d9f88eae4422483fae5be30b0540c616: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033344
W20260709 12:25:04.805739  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 107817us
I20260709 12:25:04.847184  6874 raft_consensus.cc:2243] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.848591  6874 raft_consensus.cc:2272] T b2db314cd9b6453daa5d171b91113f3a P 92362bf8983f4a71a3511e987a2c6578 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.856009  6874 tablet_replica.cc:333] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.857450  6874 raft_consensus.cc:2243] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.858825  6874 raft_consensus.cc:2272] T bcacb9654fe1491c9fa2dc488d15060a P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.903180  6874 tablet_replica.cc:333] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.904079  6874 raft_consensus.cc:2243] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:04.924180  8109 consensus_peers.cc:597] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:04.924801  8109 consensus_peers.cc:597] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:04.932699  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:04.952792  6874 raft_consensus.cc:2272] T 767edb8a304f440591a33aae36a36252 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.954093  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 146777us
I20260709 12:25:04.956060  6874 tablet_replica.cc:333] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.969182  6874 raft_consensus.cc:2243] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.970122  6874 raft_consensus.cc:2272] T 5f036b82035545a1beb20d54efe5a550 P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.989202  6874 tablet_replica.cc:333] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:04.990085  6874 raft_consensus.cc:2243] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.991056  6874 raft_consensus.cc:2272] T 72a3a306870b4fb1b1c3a1860a643731 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.993391  8109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111) [suppressed 466 similar messages]
I20260709 12:25:05.012197  6874 tablet_replica.cc:333] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.017434  6874 raft_consensus.cc:2243] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.018615  6874 raft_consensus.cc:2272] T 273de299acf94214b44aab4591da9b3a P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.035575  6874 tablet_replica.cc:333] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.036473  6874 raft_consensus.cc:2243] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.037618  6874 raft_consensus.cc:2272] T 20d361a1924b450abb7d5c5dee1414ab P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.040424  6874 tablet_replica.cc:333] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
W20260709 12:25:05.061178  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:05.065140  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:05.081503  6874 raft_consensus.cc:2243] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.082602  6874 raft_consensus.cc:2272] T 52f19ea14efe485bb7af9f0baee00fdb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.085228  6874 tablet_replica.cc:333] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
W20260709 12:25:05.090544  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:05.091164  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:05.092988  6874 raft_consensus.cc:2243] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.094169  6874 raft_consensus.cc:2272] T e23d9238fead43a79238d40702153004 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.097798  7955 maintenance_manager.cc:643] P d9f88eae4422483fae5be30b0540c616: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.284s	user 0.036s	sys 0.007s Metrics: {"bytes_written":7358,"delete_count":0,"lbm_write_time_us":5516,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":5,"reinsert_count":0,"thread_start_us":19647,"threads_started":1,"update_count":274,"wal-append.queue_time_us":17483}
I20260709 12:25:05.100214  7956 maintenance_manager.cc:419] P d9f88eae4422483fae5be30b0540c616: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.347786
W20260709 12:25:05.101002  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:05.120780  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:05.125401  6874 tablet_replica.cc:333] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.126330  6874 raft_consensus.cc:2243] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.138254  6874 raft_consensus.cc:2272] T 5a31800511c940e48a418a30b32976fd P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.143165  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:05.147992  6874 tablet_replica.cc:333] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.151895  6874 raft_consensus.cc:2243] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.155467  6874 raft_consensus.cc:2272] T 7fe588c3d3ed44709862cae072b8e205 P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.162376  6874 tablet_replica.cc:333] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.163210  6874 raft_consensus.cc:2243] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.170656  6874 raft_consensus.cc:2272] T a2f0fc39df96412f9cce0cd90f6f96e2 P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.188449  6874 tablet_replica.cc:333] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.189265  6874 raft_consensus.cc:2243] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.190615  6874 raft_consensus.cc:2272] T eef17f41a1d74cc39da4096cfd1d9edd P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.193205  6874 tablet_replica.cc:333] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.194015  6874 raft_consensus.cc:2243] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.195042  6874 raft_consensus.cc:2272] T 1037a99772cf4ae487cf4f6c27f6d4af P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.198118  6874 tablet_replica.cc:333] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.198860  6874 raft_consensus.cc:2243] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.199373  6874 raft_consensus.cc:2272] T c4ed3b4d69eb4982923a37293db3b766 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.201982  6874 tablet_replica.cc:333] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.206419  6874 raft_consensus.cc:2243] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.207036  6874 raft_consensus.cc:2272] T 4fd78a3bdb9948dd8d81b02f2028748e P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.212381  6874 tablet_replica.cc:333] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.213270  6874 raft_consensus.cc:2243] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.214644  6874 raft_consensus.cc:2272] T 9a48757da78d43b99132b4e9a4da86c5 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.217278  6874 tablet_replica.cc:333] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.218070  6874 raft_consensus.cc:2243] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.219113  6874 raft_consensus.cc:2272] T c0351f909341497abfdf11bbc6fd51e0 P 92362bf8983f4a71a3511e987a2c6578 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.221856  6874 tablet_replica.cc:333] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.222584  6874 raft_consensus.cc:2243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.223163  6874 raft_consensus.cc:2272] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.226294  6874 tablet_replica.cc:333] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.227277  6874 raft_consensus.cc:2243] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.228480  6874 raft_consensus.cc:2272] T 423b8f313a0947a3a2819068b1105a8e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.231606  6874 tablet_replica.cc:333] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.232386  6874 raft_consensus.cc:2243] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.233355  6874 raft_consensus.cc:2272] T d03e6a3f73454ce8a6a8e18e83852297 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.236120  6874 tablet_replica.cc:333] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.236891  6874 raft_consensus.cc:2243] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.237998  6874 raft_consensus.cc:2272] T d5979a1457c14f8297c9143773c4d85d P 92362bf8983f4a71a3511e987a2c6578 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.241315  6874 tablet_replica.cc:333] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.242233  6874 raft_consensus.cc:2243] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.242919  6874 raft_consensus.cc:2272] T 1f3e3220f9e94cdfb85d6632a64db657 P 92362bf8983f4a71a3511e987a2c6578 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.245765  6874 tablet_replica.cc:333] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.246658  6874 raft_consensus.cc:2243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.247349  6874 raft_consensus.cc:2272] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 92362bf8983f4a71a3511e987a2c6578 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.250308  6874 tablet_replica.cc:333] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.251061  6874 raft_consensus.cc:2243] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.251767  6874 raft_consensus.cc:2272] T c14c286147e549768b521ff92a61fec9 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.254387  6874 tablet_replica.cc:333] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.255079  6874 raft_consensus.cc:2243] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.256377  6874 raft_consensus.cc:2272] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.259045  6874 tablet_replica.cc:333] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.259711  6874 raft_consensus.cc:2243] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.260340  6874 raft_consensus.cc:2272] T e200bb1befd04bcf9b902618b83b1f88 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.262960  6874 tablet_replica.cc:333] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.263631  6874 raft_consensus.cc:2243] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.264201  6874 raft_consensus.cc:2272] T 0c7fc19421924a9a9d7c350bf097e173 P 92362bf8983f4a71a3511e987a2c6578 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.273063  6874 tablet_replica.cc:333] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.273775  6874 raft_consensus.cc:2243] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.274425  6874 raft_consensus.cc:2272] T 4e65d7e0170f493eaf2756b296fa073c P 92362bf8983f4a71a3511e987a2c6578 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.277122  6874 tablet_replica.cc:333] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.277858  6874 raft_consensus.cc:2243] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.278420  6874 raft_consensus.cc:2272] T dfc6e4aa49014b1fb0432076a5974c70 P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.290671  6874 tablet_replica.cc:333] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.291440  6874 raft_consensus.cc:2243] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.292590  6874 raft_consensus.cc:2272] T 2f18c688c54647cc96908c6b4eb6a80b P 92362bf8983f4a71a3511e987a2c6578 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.295436  6874 tablet_replica.cc:333] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.296734  6874 raft_consensus.cc:2243] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.297521  6874 raft_consensus.cc:2272] T bdd3a4527b584efbaf9d73ae4556e10f P 92362bf8983f4a71a3511e987a2c6578 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.300184  6874 tablet_replica.cc:333] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.314567  6874 raft_consensus.cc:2243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.315230  6874 raft_consensus.cc:2272] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 92362bf8983f4a71a3511e987a2c6578 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.317921  6874 tablet_replica.cc:333] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.318583  6874 raft_consensus.cc:2243] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.319480  6874 raft_consensus.cc:2272] T afe51432fd48472eb0166224a6ee8797 P 92362bf8983f4a71a3511e987a2c6578 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.322045  6874 tablet_replica.cc:333] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578: stopping tablet replica
I20260709 12:25:05.322631  6874 raft_consensus.cc:2243] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.323467  6874 raft_consensus.cc:2272] T 2937575a0ea644128c0e2d4ba3aab05e P 92362bf8983f4a71a3511e987a2c6578 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.342001  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.422659  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:05.521947  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.541373  8186 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.542608  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:05.553273  8108 connection.cc:466] server connection from 127.0.0.1:51468 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 4254) could send its response
I20260709 12:25:05.572427 16247 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:05.573644 16247 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:05.576122 16247 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:05.610610  7955 maintenance_manager.cc:643] P d9f88eae4422483fae5be30b0540c616: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.508s	user 0.105s	sys 0.014s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28394,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"lbm_read_time_us":2219,"lbm_reads_lt_1ms":25,"lbm_write_time_us":6402,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":301527,"reinsert_count":0,"thread_start_us":23124,"threads_started":2,"update_count":282}
I20260709 12:25:05.613102  7956 maintenance_manager.cc:419] P d9f88eae4422483fae5be30b0540c616: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:25:05.621219  7955 maintenance_manager.cc:643] P d9f88eae4422483fae5be30b0540c616: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 12:25:05.629559  8729 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:05.635756  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.650143  8731 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:05.650681  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:05.651506 16247 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:05.650779  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.659439  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.660679  8186 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:05.664129 16245 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:05.664914 16245 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:05.667181 16245 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:05.673620  8184 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:05.681083  8186 consensus_peers.cc:597] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.681638  8186 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.692895  8186 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:05.693459  8186 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:05.694300 16250 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:05.709609  7998 debug-util.cc:398] Leaking SignalData structure 0x7b0800375f60 after lost signal to thread 6877
W20260709 12:25:05.710827  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080013c1e0 after lost signal to thread 8001
W20260709 12:25:05.711457  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080003f820 after lost signal to thread 8170
W20260709 12:25:05.712611  7998 debug-util.cc:398] Leaking SignalData structure 0x7b08003b90c0 after lost signal to thread 8244
W20260709 12:25:05.713908  7998 debug-util.cc:398] Leaking SignalData structure 0x7b080033c760 after lost signal to thread 8790
W20260709 12:25:05.764019  8186 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.791451  8186 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.805238  8731 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.847527  8186 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.868330  8731 consensus_peers.cc:597] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.887867  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.913735  8186 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.922376  8186 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.921432  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:05.938735  8186 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.955224  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:05.987717  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:06.017628  8731 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.029026 16251 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.029892 16247 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.030007 16251 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.030659 16247 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.032512 16251 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.032843 16247 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.040225  8186 consensus_peers.cc:597] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.044246  8731 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.044890  8731 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.049784  8729 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.050299  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:06.051324  8729 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.051740  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:06.056387  8731 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.056970  8731 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.057660 16251 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:06.058408 16251 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:06.096843  8731 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.097383  8731 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.110954  8186 consensus_peers.cc:597] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.115298 16250 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.115881 16250 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.117470 16247 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.118109 16247 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.118677 16251 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.119057 16250 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.119259 16251 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.121284 16247 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:06.122495 16251 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.124437  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:06.128391 16250 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.128993 16250 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.131109 16250 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.133067  8731 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.133708  8731 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.135818  8186 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.137795 16250 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.138286 16250 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.138762  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.140398 16219 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:06.142580 16250 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
W20260709 12:25:06.144645  8186 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.150424  8184 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.150975  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.152429 16245 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:06.155995  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
W20260709 12:25:06.159631  8731 consensus_peers.cc:597] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.162225  8184 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.163091  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.163879 16245 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:06.166503  8729 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.167963  8729 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:06.167435  8186 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.173324  8184 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 1659f359000d40bda3fc864911b1c75c, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.174204 16245 raft_consensus.cc:2749] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:06.176002 16251 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:25:06.179880  8731 consensus_peers.cc:597] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.212718  8186 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.314734  8186 consensus_peers.cc:597] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.443750 16251 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.444311 16251 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.446590 16251 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:06.446614  8186 consensus_peers.cc:597] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.450016 16219 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.450639 16219 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.452776 16247 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.453374 16247 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.455578 16247 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.456082 16247 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.458654  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:06.459359  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 22.
I20260709 12:25:06.460923  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
I20260709 12:25:06.463310 16251 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:06.463730 16251 raft_consensus.cc:493] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.464099 16251 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:06.467206 16219 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:06.469163  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2" is_pre_election: true
I20260709 12:25:06.456552 16247 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.472574 16247 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.490417 16250 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.491084 16250 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.493040 16245 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.493738 16245 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.501742 16245 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.498294 16250 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:06.502576 16250 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.503188 16250 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.505615 16250 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:06.511914 16257 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.512688 16257 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:25:06.518425  8186 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.523188  8729 leader_election.cc:336] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:06.528136  8729 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.524776 16250 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.536381 16250 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.538823 16250 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.534147  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:06.542615  8761 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:25:06.520608 16257 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:06.548138  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c" is_pre_election: true
I20260709 12:25:06.548813  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 19.
I20260709 12:25:06.550210 16259 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.550832 16259 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.553102 16259 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.531741  8186 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.560778  8186 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.565210  8731 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.566298  8731 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.566730  8731 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.570163  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.573890  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.574826 16257 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:06.575323 16257 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.575780 16257 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:06.573608 16251 raft_consensus.cc:515] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:06.572526  8186 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.581385 16258 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:06.582954  8731 leader_election.cc:336] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.583478  8731 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:06.585041  8729 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.587641 16259 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:06.594200 16260 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:06.594782 16260 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.595276 16260 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:06.603199 16259 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.603878 16259 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:06.607748  8731 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.608187  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f19ea14efe485bb7af9f0baee00fdb" candidate_uuid: "1659f359000d40bda3fc864911b1c75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0c70d5020db543caa986f80b0adaa8d2"
I20260709 12:25:06.608930  8217 raft_consensus.cc:3060] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:06.611323 16259 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
W20260709 12:25:06.617575  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:06.616495  8217 raft_consensus.cc:2468] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1659f359000d40bda3fc864911b1c75c in term 23.
I20260709 12:25:06.608306  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.619611  8730 leader_election.cc:304] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 
W20260709 12:25:06.626067  8186 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.627800  8186 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.629619 16259 raft_consensus.cc:2804] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:06.628865 16258 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:06.627177 16251 leader_election.cc:290] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:06.631158  8731 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.631704  8731 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.633387 16258 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:06.636885 16259 raft_consensus.cc:697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Becoming Leader. State: Replica: 1659f359000d40bda3fc864911b1c75c, State: Running, Role: LEADER
I20260709 12:25:06.638036 16259 consensus_queue.cc:237] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:06.644748  8729 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.665812 16258 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.666472 16258 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.669080 16258 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.675346  8729 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:06.679415  8184 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.683434  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.684315 16250 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:06.685500  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:06.686062  8184 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.686460  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.687182 16250 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:06.688234  8184 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.688706  8184 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.689424 16250 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:06.680902  8731 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.676465 16257 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.691056  8731 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.691846 16259 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:25:06.678061 16260 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.694257 16260 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:06.696036 16257 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Requested vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 1659f359000d40bda3fc864911b1c75c (127.6.182.132:35761)
I20260709 12:25:06.695745  7962 catalog_manager.cc:5697] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c reported cstate change: term changed from 22 to 23, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 1659f359000d40bda3fc864911b1c75c (127.6.182.132). New cstate: current_term: 23 leader_uuid: "1659f359000d40bda3fc864911b1c75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:06.703912  8186 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.704784  8186 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.706462  8731 leader_election.cc:336] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.709769  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:06.710623 16257 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.711247 16257 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.713476 16257 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.716840  8731 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.717346  8731 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.718214 16260 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:06.720875 16259 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:06.720886 16260 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:06.723392 16260 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:06.735700  8186 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:06.739382  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f0fc39df96412f9cce0cd90f6f96e2" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:25:06.740047  8761 raft_consensus.cc:3060] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:06.749181  8761 raft_consensus.cc:2468] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
I20260709 12:25:06.750932  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5979a1457c14f8297c9143773c4d85d" candidate_uuid: "0c70d5020db543caa986f80b0adaa8d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1659f359000d40bda3fc864911b1c75c"
I20260709 12:25:06.753959  8760 raft_consensus.cc:3060] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:06.761404  8760 raft_consensus.cc:2468] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c70d5020db543caa986f80b0adaa8d2 in term 20.
W20260709 12:25:06.762705  8186 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:06.774142  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:06.779492  8186 consensus_peers.cc:597] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:06.781572  8184 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.783798 16260 raft_consensus.cc:2804] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:06.784300 16260 raft_consensus.cc:697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:25:06.785672 16260 consensus_queue.cc:237] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.791810  8184 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2, 1659f359000d40bda3fc864911b1c75c; no voters: 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.792618 16250 raft_consensus.cc:2804] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:06.793478 16250 raft_consensus.cc:697] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Becoming Leader. State: Replica: 0c70d5020db543caa986f80b0adaa8d2, State: Running, Role: LEADER
I20260709 12:25:06.796759 16250 consensus_queue.cc:237] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:06.817484  7962 catalog_manager.cc:5697] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 19 to 20, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 20 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:06.822242  8184 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.822777  8184 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.823447 16257 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:06.824575  8184 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:06.825016  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:06.825673 16257 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:06.838914  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:06.862596  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:06.866770  7962 catalog_manager.cc:5697] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 reported cstate change: term changed from 19 to 20, leader changed from 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130) to 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131). New cstate: current_term: 20 leader_uuid: "0c70d5020db543caa986f80b0adaa8d2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:06.946918  8184 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:07.142102  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:07.225612  8761 raft_consensus.cc:1275] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:25:07.229175 16250 consensus_queue.cc:1048] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:25:07.268122  8217 raft_consensus.cc:1275] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Refusing update from remote peer 1659f359000d40bda3fc864911b1c75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:25:07.270054 16259 consensus_queue.cc:1048] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:25:07.362812  8731 consensus_peers.cc:597] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:07.392217  8186 consensus_peers.cc:597] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:07.412681  8761 raft_consensus.cc:1275] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Refusing update from remote peer 0c70d5020db543caa986f80b0adaa8d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:25:07.429744  8184 consensus_peers.cc:597] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:07.449741  8186 consensus_peers.cc:597] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:07.450042  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:07.452042 16250 consensus_queue.cc:1048] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:25:07.489934  8184 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:07.591804  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:35761, user_credentials={real_user=slave}} blocked reactor thread for 46562.8us
I20260709 12:25:07.638382 16251 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:07.598239 16260 raft_consensus.cc:493] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:07.639602 16251 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:07.640726 16260 raft_consensus.cc:515] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:07.643790 16260 leader_election.cc:290] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:07.666961 16251 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:07.668373  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:07.668933  8729 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:07.689433  8184 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:07.694092  8186 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:07.697579  8731 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:07.705441  8729 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:07.705881  8729 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:07.707381 16279 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:07.761761  8184 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:07.762288  8184 leader_election.cc:336] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:07.762663  8184 leader_election.cc:304] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:07.791548 16277 raft_consensus.cc:2749] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:07.812754  8184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:34867, user_credentials={real_user=slave}} blocked reactor thread for 50475us
W20260709 12:25:07.877238  8729 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:07.899797  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
W20260709 12:25:07.902271  8184 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:07.903076  8184 consensus_peers.cc:597] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:07.903599 16279 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:07.904383 16279 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:07.918113  8729 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:07.920377 16279 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:07.926474  8184 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:07.928496  8731 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:07.929124  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:07.930810 16278 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:07.933298  8186 consensus_peers.cc:597] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:07.938670  8729 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:07.999079  8731 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.012763  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b2db314cd9b6453daa5d171b91113f3a: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.059520 16251 raft_consensus.cc:493] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.060369 16251 raft_consensus.cc:515] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:08.069943  8731 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.071254 16251 leader_election.cc:290] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.090305  8184 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:08.114480 16280 raft_consensus.cc:493] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.115249 16280 raft_consensus.cc:515] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:25:08.124138  8186 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.124981 16280 leader_election.cc:290] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.144142  8186 consensus_peers.cc:597] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.145776  8184 leader_election.cc:336] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.146314  8184 leader_election.cc:304] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.147207 16280 raft_consensus.cc:2749] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:08.163345 16250 raft_consensus.cc:493] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.164117 16250 raft_consensus.cc:515] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:08.167235 16250 leader_election.cc:290] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:08.178745 16251 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
W20260709 12:25:08.179738  8186 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.179546 16251 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:08.182996 16251 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.184676  8184 leader_election.cc:336] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.185648  8184 leader_election.cc:304] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.187510 16250 raft_consensus.cc:2749] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:08.189005  8731 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:08.214418  8186 consensus_peers.cc:597] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.223038  8186 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.281515  8186 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.287992 16279 raft_consensus.cc:493] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.288727 16279 raft_consensus.cc:515] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:08.291034 16279 leader_election.cc:290] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.299299  8731 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.311751 16251 raft_consensus.cc:493] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.312505 16251 raft_consensus.cc:515] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:08.314908 16251 leader_election.cc:290] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867)
W20260709 12:25:08.317775  8186 consensus_peers.cc:597] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.320657  8731 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.342818 16250 raft_consensus.cc:493] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.343564 16250 raft_consensus.cc:515] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:08.345649 16250 leader_election.cc:290] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.353119  8186 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:08.354226  8184 leader_election.cc:336] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.354795  8184 leader_election.cc:304] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.356362 16250 raft_consensus.cc:2749] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:08.429064  8186 consensus_peers.cc:597] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.432296  8184 consensus_peers.cc:597] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:08.439338  8186 consensus_peers.cc:597] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.444574 16280 raft_consensus.cc:493] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.445429 16280 raft_consensus.cc:515] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
I20260709 12:25:08.455096 16280 leader_election.cc:290] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.459635  8184 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.461449 16280 raft_consensus.cc:493] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.464848 16280 raft_consensus.cc:515] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:25:08.473582  8186 leader_election.cc:336] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.474148  8186 leader_election.cc:304] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.480018 16250 raft_consensus.cc:2749] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:08.482340  8184 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:08.483004  8184 consensus_peers.cc:597] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:08.492288 16280 leader_election.cc:290] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.512673  8186 leader_election.cc:336] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.513185  8186 leader_election.cc:304] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.514000 16280 raft_consensus.cc:2749] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:08.515177  8186 consensus_peers.cc:597] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.536459  8731 consensus_peers.cc:597] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.542162  8186 consensus_peers.cc:597] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.543015  8186 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.556820 16280 raft_consensus.cc:493] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.557736 16280 raft_consensus.cc:515] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:25:08.568019  8186 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.565920 16280 leader_election.cc:290] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.576846  8184 consensus_peers.cc:597] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:08.587170 16279 raft_consensus.cc:493] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.588068 16279 raft_consensus.cc:515] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:08.608860  8731 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.611905 16279 leader_election.cc:290] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.635448  8731 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.643749  8731 consensus_peers.cc:597] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.651595  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
I20260709 12:25:08.660128 16279 raft_consensus.cc:493] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.677099 16279 raft_consensus.cc:515] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
W20260709 12:25:08.681468  8186 consensus_peers.cc:597] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.685835  8184 leader_election.cc:336] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.686998  8184 leader_election.cc:304] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.688278 16279 leader_election.cc:290] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.690109  8184 consensus_peers.cc:597] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:08.690701 16250 raft_consensus.cc:2749] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:08.694130  8731 leader_election.cc:336] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:08.701717  8731 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.718832  8186 consensus_peers.cc:597] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.720732  8730 consensus_peers.cc:597] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.726924  8731 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.753039  8731 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.760982 16250 raft_consensus.cc:493] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.761801 16250 raft_consensus.cc:515] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } }
W20260709 12:25:08.771641  8186 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.785082 16250 leader_election.cc:290] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:08.790241  8731 consensus_peers.cc:597] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.811226  8731 consensus_peers.cc:597] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.831075  8184 leader_election.cc:336] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:08.831668  8184 leader_election.cc:304] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c70d5020db543caa986f80b0adaa8d2; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:08.834077 16280 raft_consensus.cc:2749] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:08.876277  8186 consensus_peers.cc:597] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.879285  8730 consensus_peers.cc:597] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.882550  8730 consensus_peers.cc:597] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.892042  8730 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.914979  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:08.916311  6874 tablet_replica.cc:333] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.917546  6874 raft_consensus.cc:2243] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:25:08.925880  8184 consensus_peers.cc:597] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:08.926674  6874 raft_consensus.cc:2272] T a76facb821d9488284580418cf9bbf22 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.930217  6874 tablet_replica.cc:333] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.931630  6874 raft_consensus.cc:2243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.933157  6874 raft_consensus.cc:2272] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.936558  6874 tablet_replica.cc:333] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.937614  6874 raft_consensus.cc:2243] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.939435  6874 raft_consensus.cc:2272] T 61d6819393b345508f4a0ced5669567e P 0c70d5020db543caa986f80b0adaa8d2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.942539  6874 tablet_replica.cc:333] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.943490  6874 raft_consensus.cc:2243] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.944303  6874 raft_consensus.cc:2272] T a313281992bb42fbb55e3eb70444bb6f P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.950003  8730 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.950589  6874 tablet_replica.cc:333] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.951562  6874 raft_consensus.cc:2243] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.952342  6874 raft_consensus.cc:2272] T b9927bbb5560416bbc804210e19bb0ce P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.955456  6874 tablet_replica.cc:333] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.956262  6874 raft_consensus.cc:2243] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.957667  6874 raft_consensus.cc:2272] T badbfade73ce40f0a89515d01fe50bd6 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.960532  6874 tablet_replica.cc:333] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.961699 16279 raft_consensus.cc:493] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:08.962240  6874 raft_consensus.cc:2243] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.962765 16279 raft_consensus.cc:515] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:08.963970  6874 raft_consensus.cc:2272] T 0cbf17a8c7e94e15b3279358c79cf509 P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.967525  6874 tablet_replica.cc:333] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.968397  6874 raft_consensus.cc:2243] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.969086 16279 leader_election.cc:290] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
I20260709 12:25:08.969429  6874 raft_consensus.cc:2272] T fae0a66399b64e649f375238dc4cbcde P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.973661  6874 tablet_replica.cc:333] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
W20260709 12:25:08.974079  8731 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:08.974632  6874 raft_consensus.cc:2243] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.975569  6874 raft_consensus.cc:2272] T dbbb2d697a734b0baef1073024333311 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.979034  6874 tablet_replica.cc:333] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.979892  6874 raft_consensus.cc:2243] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.980540  6874 raft_consensus.cc:2272] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.983903  6874 tablet_replica.cc:333] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.985144  6874 raft_consensus.cc:2243] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.987700  6874 raft_consensus.cc:2272] T 96d399d9899c495382a6ba72d8479a9d P 0c70d5020db543caa986f80b0adaa8d2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.987864  8186 consensus_peers.cc:597] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:08.991932  6874 tablet_replica.cc:333] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.993068  6874 raft_consensus.cc:2243] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.994613  6874 raft_consensus.cc:2272] T 273de299acf94214b44aab4591da9b3a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.995455  8730 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.998144  6874 tablet_replica.cc:333] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:08.999238  6874 raft_consensus.cc:2243] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.000033  6874 raft_consensus.cc:2272] T bcacb9654fe1491c9fa2dc488d15060a P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.003319  6874 tablet_replica.cc:333] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.004160  6874 raft_consensus.cc:2243] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.006300  6874 raft_consensus.cc:2272] T 767edb8a304f440591a33aae36a36252 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.009658  6874 tablet_replica.cc:333] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.010648  6874 raft_consensus.cc:2243] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.011934  6874 raft_consensus.cc:2272] T 5f036b82035545a1beb20d54efe5a550 P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.014923  6874 tablet_replica.cc:333] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.015807  6874 raft_consensus.cc:2243] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.017295  6874 raft_consensus.cc:2272] T b2db314cd9b6453daa5d171b91113f3a P 0c70d5020db543caa986f80b0adaa8d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.020221  6874 tablet_replica.cc:333] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.021183  6874 raft_consensus.cc:2243] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.023322  6874 raft_consensus.cc:2272] T 20d361a1924b450abb7d5c5dee1414ab P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.026525  6874 tablet_replica.cc:333] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.028117  6874 raft_consensus.cc:2243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.028991  6874 raft_consensus.cc:2272] T 9647a9c32fa748e4bc9548eb7a92bdfc P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.032877  6874 tablet_replica.cc:333] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.033890  6874 raft_consensus.cc:2243] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.034642  6874 raft_consensus.cc:2272] T 52f19ea14efe485bb7af9f0baee00fdb P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.037824  6874 tablet_replica.cc:333] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.038640  6874 raft_consensus.cc:2243] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.040086  6874 raft_consensus.cc:2272] T c4ed3b4d69eb4982923a37293db3b766 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.042866  6874 tablet_replica.cc:333] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.043829  6874 raft_consensus.cc:2243] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.045274  6874 raft_consensus.cc:2272] T 4fd78a3bdb9948dd8d81b02f2028748e P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.048442  6874 tablet_replica.cc:333] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.049364  6874 raft_consensus.cc:2243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.050097  6874 raft_consensus.cc:2272] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.053062  6874 tablet_replica.cc:333] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.053856  6874 raft_consensus.cc:2243] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.055179  6874 raft_consensus.cc:2272] T a2f0fc39df96412f9cce0cd90f6f96e2 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.058182  6874 tablet_replica.cc:333] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.059118  6874 raft_consensus.cc:2243] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.061163  6874 raft_consensus.cc:2272] T 1037a99772cf4ae487cf4f6c27f6d4af P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.064381  6874 tablet_replica.cc:333] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
W20260709 12:25:09.064492  8730 consensus_peers.cc:597] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.065331  6874 raft_consensus.cc:2243] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.066903  6874 raft_consensus.cc:2272] T 14112996240a40858e18c7a0d75b2a12 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.068768  8729 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.069701  8729 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.069887  6874 tablet_replica.cc:333] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.071105 16251 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:25:09.072415  8729 consensus_peers.cc:597] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:09.074596  8729 consensus_peers.cc:597] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:09.075116  8729 leader_election.cc:336] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.073450  6874 raft_consensus.cc:2243] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.078029  6874 raft_consensus.cc:2272] T 9a48757da78d43b99132b4e9a4da86c5 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.079105  8729 leader_election.cc:304] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:09.080080  8730 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.083163  6874 tablet_replica.cc:333] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.083731 16251 raft_consensus.cc:2749] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:09.084067  6874 raft_consensus.cc:2243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:25:09.085216  8729 leader_election.cc:336] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.085779  6874 raft_consensus.cc:2272] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.085747  8729 leader_election.cc:304] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.086705 16251 raft_consensus.cc:2749] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:25:09.088090  8729 leader_election.cc:336] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.088578  8729 leader_election.cc:304] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.089026  6874 tablet_replica.cc:333] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.090215  6874 raft_consensus.cc:2243] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.091423 16251 raft_consensus.cc:2749] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:09.092813  6874 raft_consensus.cc:2272] T ab203f6136b5456cacf2c4f8c664004b P 0c70d5020db543caa986f80b0adaa8d2 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.094813  8184 consensus_peers.cc:597] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:09.094571  8729 leader_election.cc:336] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.095969  8729 leader_election.cc:304] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.096889  6874 tablet_replica.cc:333] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.096989 16251 raft_consensus.cc:2749] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:09.097827  6874 raft_consensus.cc:2243] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:09.098466  8729 leader_election.cc:336] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.098796  6874 raft_consensus.cc:2272] T d03e6a3f73454ce8a6a8e18e83852297 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.099076  8729 leader_election.cc:304] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.100025 16251 raft_consensus.cc:2749] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:09.101876  6874 tablet_replica.cc:333] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.103130  6874 raft_consensus.cc:2243] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.105310  6874 raft_consensus.cc:2272] T d5979a1457c14f8297c9143773c4d85d P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.108038  6874 tablet_replica.cc:333] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.108952  6874 raft_consensus.cc:2243] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.109699  6874 raft_consensus.cc:2272] T df7583ede5b943628d7b1b33336c660a P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.111205  8729 leader_election.cc:336] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:09.111832  8729 leader_election.cc:304] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.112713 16251 raft_consensus.cc:2749] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:25:09.113015  6874 tablet_replica.cc:333] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.113903  6874 raft_consensus.cc:2243] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.115391  6874 raft_consensus.cc:2272] T c14c286147e549768b521ff92a61fec9 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.118333  6874 tablet_replica.cc:333] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.119170  6874 raft_consensus.cc:2243] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.120194  6874 raft_consensus.cc:2272] T e200bb1befd04bcf9b902618b83b1f88 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.123031  6874 tablet_replica.cc:333] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.123809  6874 raft_consensus.cc:2243] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.125099  6874 raft_consensus.cc:2272] T 1f3e3220f9e94cdfb85d6632a64db657 P 0c70d5020db543caa986f80b0adaa8d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.127772  6874 tablet_replica.cc:333] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.128592  6874 raft_consensus.cc:2243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.132577  6874 raft_consensus.cc:2272] T 627e9613a1ca4f19a4b790eac7fbbf2a P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.135212  8730 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.135607  6874 tablet_replica.cc:333] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.136555  6874 raft_consensus.cc:2243] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.138001  6874 raft_consensus.cc:2272] T 0c7fc19421924a9a9d7c350bf097e173 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.140856  6874 tablet_replica.cc:333] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.141713  6874 raft_consensus.cc:2243] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.143015  6874 raft_consensus.cc:2272] T c6f5552bf1b244738e961ee3f9a8554b P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.145866  6874 tablet_replica.cc:333] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.146665  6874 raft_consensus.cc:2243] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.147354  6874 raft_consensus.cc:2272] T afe51432fd48472eb0166224a6ee8797 P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.150087  6874 tablet_replica.cc:333] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.150897  6874 raft_consensus.cc:2243] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.152254  6874 raft_consensus.cc:2272] T 2937575a0ea644128c0e2d4ba3aab05e P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.154985  6874 tablet_replica.cc:333] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.155784  6874 raft_consensus.cc:2243] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.156538  6874 raft_consensus.cc:2272] T 5a31800511c940e48a418a30b32976fd P 0c70d5020db543caa986f80b0adaa8d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.159183  6874 tablet_replica.cc:333] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
W20260709 12:25:09.159732  8730 consensus_peers.cc:597] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.159929  6874 raft_consensus.cc:2243] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.162109  6874 raft_consensus.cc:2272] T e23d9238fead43a79238d40702153004 P 0c70d5020db543caa986f80b0adaa8d2 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.164453  8184 consensus_peers.cc:597] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:09.173075  6874 tablet_replica.cc:333] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.175966  6874 raft_consensus.cc:2243] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:25:09.177511  8730 consensus_peers.cc:597] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.179041  6874 raft_consensus.cc:2272] T 4cee9f5adec64ff983b1c5510d0979af P 0c70d5020db543caa986f80b0adaa8d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.180785  8186 consensus_peers.cc:597] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:09.182133  6874 tablet_replica.cc:333] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.182955  6874 raft_consensus.cc:2243] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.183981  6874 raft_consensus.cc:2272] T f7490a68a6eb4ff18f8111dadec3d794 P 0c70d5020db543caa986f80b0adaa8d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.187139  6874 tablet_replica.cc:333] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.188185  6874 raft_consensus.cc:2243] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.189550  6874 raft_consensus.cc:2272] T 4e65d7e0170f493eaf2756b296fa073c P 0c70d5020db543caa986f80b0adaa8d2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.192356  6874 tablet_replica.cc:333] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.193090  6874 raft_consensus.cc:2243] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:25:09.193717  8730 consensus_peers.cc:597] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.194500  6874 raft_consensus.cc:2272] T dfc6e4aa49014b1fb0432076a5974c70 P 0c70d5020db543caa986f80b0adaa8d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.197422  6874 tablet_replica.cc:333] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2: stopping tablet replica
I20260709 12:25:09.198132  6874 raft_consensus.cc:2243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:09.199548  6874 raft_consensus.cc:2272] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 0c70d5020db543caa986f80b0adaa8d2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:09.209647  8730 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c -> Peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Couldn't send request to peer 0c70d5020db543caa986f80b0adaa8d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:09.586315  8729 consensus_peers.cc:597] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:25:09.682837  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:09.734395  8729 consensus_peers.cc:597] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:09.849745 16251 raft_consensus.cc:493] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:09.850358 16251 raft_consensus.cc:515] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:09.852618 16251 leader_election.cc:290] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:09.857218  8729 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:09.859512  8731 leader_election.cc:336] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:09.859994  8731 leader_election.cc:304] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.861092 16286 raft_consensus.cc:2749] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:09.882072 16286 raft_consensus.cc:493] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:09.882651 16286 raft_consensus.cc:515] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:09.884980 16286 leader_election.cc:290] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:09.889532  8729 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:09.890357  8730 leader_election.cc:336] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:09.890774  8730 leader_election.cc:304] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:09.891558 16286 raft_consensus.cc:2749] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:09.925527 16286 raft_consensus.cc:493] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:09.926105 16286 raft_consensus.cc:515] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:09.928383 16286 leader_election.cc:290] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:09.932205  8729 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:09.934337  8731 leader_election.cc:336] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:09.934779  8731 leader_election.cc:304] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:09.936347 16286 raft_consensus.cc:2749] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:25:09.942201  8731 consensus_peers.cc:597] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:10.000697  8730 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111) [suppressed 599 similar messages]
W20260709 12:25:10.044368  8729 consensus_peers.cc:597] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:10.092463 16286 raft_consensus.cc:493] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.093084 16286 raft_consensus.cc:515] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.095336 16286 leader_election.cc:290] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.100497  8730 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.102700  8729 leader_election.cc:336] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:10.103133  8729 leader_election.cc:304] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.103869 16286 raft_consensus.cc:2749] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:25:10.165457 16251 raft_consensus.cc:493] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.166002 16251 raft_consensus.cc:515] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.168195 16251 leader_election.cc:290] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.175891  8731 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.176554  8730 leader_election.cc:336] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.176991  8730 leader_election.cc:304] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.177731 16251 raft_consensus.cc:2749] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.197228 16251 raft_consensus.cc:493] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.197871 16286 raft_consensus.cc:493] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.198009 16251 raft_consensus.cc:515] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.198571 16286 raft_consensus.cc:515] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.201256 16251 leader_election.cc:290] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:10.201741 16286 leader_election.cc:290] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.207031  8731 leader_election.cc:336] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.210670  8730 leader_election.cc:336] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.210719  8729 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:10.211198  8730 leader_election.cc:304] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
W20260709 12:25:10.211524  8729 consensus_peers.cc:597] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:10.212138 16286 raft_consensus.cc:2749] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:10.213232  8730 leader_election.cc:336] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.213645  8730 leader_election.cc:304] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.214285 16286 raft_consensus.cc:2749] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:10.224593 16286 raft_consensus.cc:493] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.225143 16286 raft_consensus.cc:515] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.227331 16286 leader_election.cc:290] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.231491  8731 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.237669  8730 leader_election.cc:336] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.238101  8730 leader_election.cc:304] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.238798 16286 raft_consensus.cc:2749] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:10.241015 16286 raft_consensus.cc:493] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.241550 16286 raft_consensus.cc:515] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.243659 16286 leader_election.cc:290] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.247598  8730 leader_election.cc:336] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.250469  8729 leader_election.cc:336] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:10.250898  8729 leader_election.cc:304] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.251626 16286 raft_consensus.cc:2749] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:10.255690 16286 raft_consensus.cc:493] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.256224 16286 raft_consensus.cc:515] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.258462 16286 leader_election.cc:290] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.263572  8730 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.264154  8729 leader_election.cc:336] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:10.264552  8729 leader_election.cc:304] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.265273 16286 raft_consensus.cc:2749] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:25:10.293732 16251 raft_consensus.cc:493] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.294260 16251 raft_consensus.cc:515] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.296581 16251 leader_election.cc:290] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:10.299409 16251 raft_consensus.cc:493] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.299896 16251 raft_consensus.cc:515] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.302075 16251 leader_election.cc:290] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.301996  8730 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.302726  8731 leader_election.cc:336] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:10.303186  8731 leader_election.cc:304] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.304944 16251 raft_consensus.cc:2749] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:10.308152  8731 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.308665  8730 leader_election.cc:336] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.309128  8730 leader_election.cc:304] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.309840 16251 raft_consensus.cc:2749] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:10.324687 16251 raft_consensus.cc:493] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.324826 16286 raft_consensus.cc:493] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.325241 16251 raft_consensus.cc:515] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } attrs { replace: true } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.325444 16286 raft_consensus.cc:515] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.327661 16286 leader_election.cc:290] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
I20260709 12:25:10.327915 16251 leader_election.cc:290] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.335026  8730 leader_election.cc:336] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.335495  8729 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:10.336305  8730 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.336807  8730 leader_election.cc:304] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.337855 16286 raft_consensus.cc:2749] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:10.338529 16286 raft_consensus.cc:493] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
W20260709 12:25:10.339172  8731 leader_election.cc:336] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:10.339012 16286 raft_consensus.cc:515] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.339634  8731 leader_election.cc:304] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.340337 16287 raft_consensus.cc:2749] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:10.341166 16286 leader_election.cc:290] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.341272  8731 leader_election.cc:336] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.347256  8731 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.347736  8730 leader_election.cc:336] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.348511  8730 leader_election.cc:304] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.349217 16251 raft_consensus.cc:2749] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:10.389521 16251 raft_consensus.cc:493] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.390044 16251 raft_consensus.cc:515] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.392022 16251 leader_election.cc:290] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.396869  8731 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.397382  8730 leader_election.cc:336] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.397814  8730 leader_election.cc:304] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.398509 16251 raft_consensus.cc:2749] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:10.417865  8729 consensus_peers.cc:597] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:10.431159  8731 consensus_peers.cc:597] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c -> Peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Couldn't send request to peer 92362bf8983f4a71a3511e987a2c6578. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:25:10.447665 16251 raft_consensus.cc:493] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.448426 16251 raft_consensus.cc:515] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.450783 16251 leader_election.cc:290] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.455862  8731 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
W20260709 12:25:10.456447  8730 leader_election.cc:336] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
I20260709 12:25:10.456934  8730 leader_election.cc:304] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.457716 16251 raft_consensus.cc:2749] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:10.501354  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:25:10.525857 16251 raft_consensus.cc:493] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c70d5020db543caa986f80b0adaa8d2)
I20260709 12:25:10.526539 16251 raft_consensus.cc:515] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "0c70d5020db543caa986f80b0adaa8d2" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41179 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.529585 16251 leader_election.cc:290] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179)
W20260709 12:25:10.535933  8730 leader_election.cc:336] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c70d5020db543caa986f80b0adaa8d2 (127.6.182.131:41179): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41179: connect: Connection refused (error 111)
W20260709 12:25:10.537736  8729 leader_election.cc:336] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:10.538206  8729 leader_election.cc:304] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 0c70d5020db543caa986f80b0adaa8d2, 3d67d00ae45b444cbe343726df1760e8
I20260709 12:25:10.538983 16251 raft_consensus.cc:2749] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:10.581139 16251 raft_consensus.cc:493] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 92362bf8983f4a71a3511e987a2c6578)
I20260709 12:25:10.581729 16251 raft_consensus.cc:515] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d67d00ae45b444cbe343726df1760e8" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 34867 } } peers { permanent_uuid: "92362bf8983f4a71a3511e987a2c6578" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 37085 } } peers { permanent_uuid: "1659f359000d40bda3fc864911b1c75c" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 35761 } attrs { promote: false } }
I20260709 12:25:10.583931 16251 leader_election.cc:290] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867), 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085)
W20260709 12:25:10.592696  8729 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:10.593242  8731 leader_election.cc:336] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 92362bf8983f4a71a3511e987a2c6578 (127.6.182.130:37085): Network error: Client connection negotiation failed: client connection to 127.6.182.130:37085: connect: Connection refused (error 111)
I20260709 12:25:10.593721  8731 leader_election.cc:304] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1659f359000d40bda3fc864911b1c75c; no voters: 3d67d00ae45b444cbe343726df1760e8, 92362bf8983f4a71a3511e987a2c6578
I20260709 12:25:10.594492 16251 raft_consensus.cc:2749] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:10.608592  6874 tablet_server.cc:179] TabletServer@127.6.182.132:0 shutting down...
W20260709 12:25:10.631188  8729 consensus_peers.cc:597] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c -> Peer 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): Couldn't send request to peer 3d67d00ae45b444cbe343726df1760e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:25:10.665659  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:10.666846  6874 tablet_replica.cc:333] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.668176  6874 raft_consensus.cc:2243] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.669210  6874 raft_consensus.cc:2272] T 1037a99772cf4ae487cf4f6c27f6d4af P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.672899  6874 tablet_replica.cc:333] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.674149  6874 raft_consensus.cc:2243] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.675173  6874 raft_consensus.cc:2272] T b2db314cd9b6453daa5d171b91113f3a P 1659f359000d40bda3fc864911b1c75c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.679029  6874 tablet_replica.cc:333] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.680115  6874 raft_consensus.cc:2243] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.680963  6874 raft_consensus.cc:2272] T a76facb821d9488284580418cf9bbf22 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.684665  6874 tablet_replica.cc:333] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.685729  6874 raft_consensus.cc:2243] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.686540  6874 raft_consensus.cc:2272] T 7fe588c3d3ed44709862cae072b8e205 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.690538  6874 tablet_replica.cc:333] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.691586  6874 raft_consensus.cc:2243] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.692566  6874 raft_consensus.cc:2272] T d5979a1457c14f8297c9143773c4d85d P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.695920  6874 tablet_replica.cc:333] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.696877  6874 raft_consensus.cc:2243] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.697713  6874 raft_consensus.cc:2272] T 627e9613a1ca4f19a4b790eac7fbbf2a P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.701350  6874 tablet_replica.cc:333] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.702353  6874 raft_consensus.cc:2243] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.703445  6874 raft_consensus.cc:2272] T 423b8f313a0947a3a2819068b1105a8e P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.707320  6874 tablet_replica.cc:333] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.708225  6874 raft_consensus.cc:2243] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.709350  6874 raft_consensus.cc:2272] T 273de299acf94214b44aab4591da9b3a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.712940  6874 tablet_replica.cc:333] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.713860  6874 raft_consensus.cc:2243] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.715241  6874 raft_consensus.cc:2272] T 4a08eb4ae8cb45649565146d64ab2983 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.719134  6874 tablet_replica.cc:333] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.720116  6874 raft_consensus.cc:2243] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.721715  6874 raft_consensus.cc:2272] T 96d399d9899c495382a6ba72d8479a9d P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.725432  6874 tablet_replica.cc:333] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.726392  6874 raft_consensus.cc:2243] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.727593  6874 raft_consensus.cc:2272] T e200bb1befd04bcf9b902618b83b1f88 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.730849  6874 tablet_replica.cc:333] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.731961  6874 raft_consensus.cc:2243] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.733413  6874 raft_consensus.cc:2272] T 767edb8a304f440591a33aae36a36252 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.736724  6874 tablet_replica.cc:333] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.737597  6874 raft_consensus.cc:2243] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.738910  6874 raft_consensus.cc:2272] T 72a3a306870b4fb1b1c3a1860a643731 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.742363  6874 tablet_replica.cc:333] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.743304  6874 raft_consensus.cc:2243] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.743954  6874 raft_consensus.cc:2272] T 0c7fc19421924a9a9d7c350bf097e173 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.747300  6874 tablet_replica.cc:333] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.748265  6874 raft_consensus.cc:2243] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.749195  6874 raft_consensus.cc:2272] T 753bdf66ab9c48ceb9558028f4bcf7e1 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.752615  6874 tablet_replica.cc:333] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.753473  6874 raft_consensus.cc:2243] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.754213  6874 raft_consensus.cc:2272] T ab203f6136b5456cacf2c4f8c664004b P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.757469  6874 tablet_replica.cc:333] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.758477  6874 raft_consensus.cc:2243] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.759209  6874 raft_consensus.cc:2272] T fc07fb1a83da4d4a9ab7b5ef8e9f7f10 P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.762502  6874 tablet_replica.cc:333] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.763335  6874 raft_consensus.cc:2243] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.764058  6874 raft_consensus.cc:2272] T 4cee9f5adec64ff983b1c5510d0979af P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.767215  6874 tablet_replica.cc:333] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.768049  6874 raft_consensus.cc:2243] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.768743  6874 raft_consensus.cc:2272] T eef17f41a1d74cc39da4096cfd1d9edd P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.771847  6874 tablet_replica.cc:333] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.772711  6874 raft_consensus.cc:2243] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.774104  6874 raft_consensus.cc:2272] T bdd3a4527b584efbaf9d73ae4556e10f P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.777249  6874 tablet_replica.cc:333] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.778072  6874 raft_consensus.cc:2243] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.778723  6874 raft_consensus.cc:2272] T 8ac2bed7a5004a9dbb30cda857b5ef6d P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.781827  6874 tablet_replica.cc:333] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.782601  6874 raft_consensus.cc:2243] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.783366  6874 raft_consensus.cc:2272] T d90f9cc1738e4ab29ea95fed6e4f6b94 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.786294  6874 tablet_replica.cc:333] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.787151  6874 raft_consensus.cc:2243] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.788151  6874 raft_consensus.cc:2272] T c0351f909341497abfdf11bbc6fd51e0 P 1659f359000d40bda3fc864911b1c75c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.791253  6874 tablet_replica.cc:333] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.792037  6874 raft_consensus.cc:2243] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.792656  6874 raft_consensus.cc:2272] T 2f18c688c54647cc96908c6b4eb6a80b P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.795670  6874 tablet_replica.cc:333] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.796546  6874 raft_consensus.cc:2243] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.797219  6874 raft_consensus.cc:2272] T aa46cdee469046e0a85f4a03d2e03f92 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.800376  6874 tablet_replica.cc:333] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.801231  6874 raft_consensus.cc:2243] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.801859  6874 raft_consensus.cc:2272] T a2f0fc39df96412f9cce0cd90f6f96e2 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.805096  6874 tablet_replica.cc:333] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.805907  6874 raft_consensus.cc:2243] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.807078  6874 raft_consensus.cc:2272] T 52f19ea14efe485bb7af9f0baee00fdb P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.809748  6874 tablet_replica.cc:333] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.810567  6874 raft_consensus.cc:2243] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.811702  6874 raft_consensus.cc:2272] T 9647a9c32fa748e4bc9548eb7a92bdfc P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.814337  6874 tablet_replica.cc:333] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.815160  6874 raft_consensus.cc:2243] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.816391  6874 raft_consensus.cc:2272] T fae0a66399b64e649f375238dc4cbcde P 1659f359000d40bda3fc864911b1c75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.819357  6874 tablet_replica.cc:333] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.820168  6874 raft_consensus.cc:2243] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.820935  6874 raft_consensus.cc:2272] T 5f036b82035545a1beb20d54efe5a550 P 1659f359000d40bda3fc864911b1c75c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.824157  6874 tablet_replica.cc:333] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.825029  6874 raft_consensus.cc:2243] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.826220  6874 raft_consensus.cc:2272] T b9927bbb5560416bbc804210e19bb0ce P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.829255  6874 tablet_replica.cc:333] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.830077  6874 raft_consensus.cc:2243] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.830714  6874 raft_consensus.cc:2272] T dea9fb7818f049248d8577e73c087888 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.833732  6874 tablet_replica.cc:333] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.834594  6874 raft_consensus.cc:2243] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.835273  6874 raft_consensus.cc:2272] T c4ed3b4d69eb4982923a37293db3b766 P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.838368  6874 tablet_replica.cc:333] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.839177  6874 raft_consensus.cc:2243] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.840314  6874 raft_consensus.cc:2272] T 3e7bfc6a04b14b94bfa1ea185d2d50d7 P 1659f359000d40bda3fc864911b1c75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.843374  6874 tablet_replica.cc:333] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.844172  6874 raft_consensus.cc:2243] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.844908  6874 raft_consensus.cc:2272] T c6f5552bf1b244738e961ee3f9a8554b P 1659f359000d40bda3fc864911b1c75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.848054  6874 tablet_replica.cc:333] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.848974  6874 raft_consensus.cc:2243] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.850222  6874 raft_consensus.cc:2272] T 14112996240a40858e18c7a0d75b2a12 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.853252  6874 tablet_replica.cc:333] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.854030  6874 raft_consensus.cc:2243] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.855262  6874 raft_consensus.cc:2272] T 5bc5d19ae7b44bd6bff5e8b59a820ffb P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.858151  6874 tablet_replica.cc:333] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.858949  6874 raft_consensus.cc:2243] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.860085  6874 raft_consensus.cc:2272] T 6ac329aaff89417f8e5eeb5f5f3e9a17 P 1659f359000d40bda3fc864911b1c75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.863080  6874 tablet_replica.cc:333] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.863822  6874 raft_consensus.cc:2243] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:10.864491  6874 raft_consensus.cc:2272] T 90659c1daf854b0f9323204cf80f7aeb P 1659f359000d40bda3fc864911b1c75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.867348  6874 tablet_replica.cc:333] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.868111  6874 raft_consensus.cc:2243] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.869364  6874 raft_consensus.cc:2272] T f7490a68a6eb4ff18f8111dadec3d794 P 1659f359000d40bda3fc864911b1c75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.872403  6874 tablet_replica.cc:333] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.873193  6874 raft_consensus.cc:2243] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.874439  6874 raft_consensus.cc:2272] T d03e6a3f73454ce8a6a8e18e83852297 P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:10.877434  6874 tablet_replica.cc:333] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c: stopping tablet replica
I20260709 12:25:10.878125  6874 raft_consensus.cc:2243] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:10.879267  6874 raft_consensus.cc:2272] T df7583ede5b943628d7b1b33336c660a P 1659f359000d40bda3fc864911b1c75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:11.272343  6874 tablet_server.cc:196] TabletServer@127.6.182.132:0 shutdown complete.
I20260709 12:25:11.349211  6874 master.cc:562] Master@127.6.182.190:33539 shutting down...
W20260709 12:25:11.389158  8015 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:25:11.389508  8015 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:11.389739  8015 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:25:24.451933  7952 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111) [suppressed 85 similar messages]
W20260709 12:25:24.455907  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b2db314cd9b6453daa5d171b91113f3a: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
W20260709 12:25:26.103082  7952 catalog_manager.cc:4755] TS 3d67d00ae45b444cbe343726df1760e8 (127.6.182.129:34867): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d5979a1457c14f8297c9143773c4d85d: Network error: Client connection negotiation failed: client connection to 127.6.182.129:34867: connect: Connection refused (error 111)
I20260709 12:25:28.401137  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.402395  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.402853  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P d9f88eae4422483fae5be30b0540c616: stopping tablet replica
I20260709 12:25:28.599975  6874 master.cc:584] Master@127.6.182.190:33539 shutdown complete.
I20260709 12:25:28.656672  6874 test_util.cc:182] -----------------------------------------------
I20260709 12:25:28.656936  6874 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599585808757-6874-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (282434 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:25:28.663776  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:41909
I20260709 12:25:28.665745  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.672942 16297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.673097 16298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.674103 16300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.675932  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:28.679345  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:28.679545  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.679739  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599928679708 us; error 0 us; skew 500 ppm
I20260709 12:25:28.680269  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.682963  6874 webserver.cc:533] Webserver started at http://127.6.182.190:34159/ using document root <none> and password file <none>
I20260709 12:25:28.683516  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.683707  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.684021  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.685405  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "8a79cacc982a4a45b440e7b2dca25e43"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-lgtn"
I20260709 12:25:28.690330  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:25:28.694192 16305 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.695189  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:28.695546  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "8a79cacc982a4a45b440e7b2dca25e43"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-lgtn"
I20260709 12:25:28.695911  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:28.714493  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:28.715973  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:28.761982  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:41909
I20260709 12:25:28.762097 16356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:41909 every 8 connection(s)
I20260709 12:25:28.766626 16357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:28.779210 16357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43: Bootstrap starting.
I20260709 12:25:28.784328 16357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.789331 16357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43: No bootstrap required, opened a new log
I20260709 12:25:28.791923 16357 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER }
I20260709 12:25:28.792441 16357 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.792732 16357 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a79cacc982a4a45b440e7b2dca25e43, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.793367 16357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER }
I20260709 12:25:28.793887 16357 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:28.794133 16357 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:28.794395 16357 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.800282 16357 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER }
I20260709 12:25:28.800946 16357 leader_election.cc:304] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a79cacc982a4a45b440e7b2dca25e43; no voters: 
I20260709 12:25:28.802222 16357 leader_election.cc:290] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:28.802683 16360 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:28.804234 16360 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 1 LEADER]: Becoming Leader. State: Replica: 8a79cacc982a4a45b440e7b2dca25e43, State: Running, Role: LEADER
I20260709 12:25:28.805042 16360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER }
I20260709 12:25:28.805859 16357 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:28.812270 16361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a79cacc982a4a45b440e7b2dca25e43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER } }
I20260709 12:25:28.813066 16361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:28.812964 16362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a79cacc982a4a45b440e7b2dca25e43. Latest consensus state: current_term: 1 leader_uuid: "8a79cacc982a4a45b440e7b2dca25e43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a79cacc982a4a45b440e7b2dca25e43" member_type: VOTER } }
I20260709 12:25:28.813747 16362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:28.815634 16368 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:28.824321 16368 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:28.825454  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:28.834374 16368 catalog_manager.cc:1383] Generated new cluster ID: c5046e76d1224f5ea90d09f539fb022a
I20260709 12:25:28.834728 16368 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:28.886310 16368 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:28.887737 16368 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:28.909070 16368 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43: Generated new TSK 0
I20260709 12:25:28.909789 16368 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:28.957072  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.964071 16379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.965453 16380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.967689 16382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.968006  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:28.971459  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:28.971705  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.971843  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599928971830 us; error 0 us; skew 500 ppm
I20260709 12:25:28.972426  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.975051  6874 webserver.cc:533] Webserver started at http://127.6.182.129:42693/ using document root <none> and password file <none>
I20260709 12:25:28.975557  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.975729  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.975981  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.977445  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "a8133a8f49724a8897d8bc4f718d802d"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-lgtn"
I20260709 12:25:28.982628  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:28.986729 16387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.987768  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:28.988174  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "a8133a8f49724a8897d8bc4f718d802d"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-lgtn"
I20260709 12:25:28.988562  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:29.021291  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:29.022704  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:29.024415  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:29.027077  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:29.027310  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.027601  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:29.027794  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.074927  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:35115
I20260709 12:25:29.075146 16449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:35115 every 8 connection(s)
I20260709 12:25:29.081060  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:29.091109 16454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.092923 16455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.095286 16457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:29.095610  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:29.098783  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:29.099145  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:29.099418  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599929099396 us; error 0 us; skew 500 ppm
I20260709 12:25:29.100296  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:29.102236 16450 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41909
I20260709 12:25:29.102706 16450 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:29.103859  6874 webserver.cc:533] Webserver started at http://127.6.182.130:35477/ using document root <none> and password file <none>
I20260709 12:25:29.104005 16450 heartbeater.cc:507] Master 127.6.182.190:41909 requested a full tablet report, sending...
I20260709 12:25:29.104770  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:29.105088  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:29.105461  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:29.107133  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "57226fc89069472b9311be6e596aa8ee"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.107036 16322 ts_manager.cc:194] Registered new tserver with Master: a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:29.109659 16322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44632
I20260709 12:25:29.113374  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 12:25:29.117911 16462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.118928  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:29.119303  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "57226fc89069472b9311be6e596aa8ee"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.119599  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:29.148478  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:29.150089  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:29.151851  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:29.154488  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:29.154695  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.155032  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:29.155189  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.205900  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:34585
I20260709 12:25:29.206013 16525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:34585 every 8 connection(s)
I20260709 12:25:29.211912  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:29.223104 16530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.223907 16529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.227713 16532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:29.227749 16526 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41909
I20260709 12:25:29.228363  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:29.228652 16526 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:29.229663  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:29.229799 16526 heartbeater.cc:507] Master 127.6.182.190:41909 requested a full tablet report, sending...
W20260709 12:25:29.230111  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:29.230381  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599929230357 us; error 0 us; skew 500 ppm
I20260709 12:25:29.231218  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:29.232738 16322 ts_manager.cc:194] Registered new tserver with Master: 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:29.234318  6874 webserver.cc:533] Webserver started at http://127.6.182.131:42749/ using document root <none> and password file <none>
I20260709 12:25:29.234706 16322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44642
I20260709 12:25:29.234906  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:29.235242  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:29.235518  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:29.237046  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "9579e506d72842a9a847d0498878c3fd"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.242254  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:25:29.246383 16537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.247568  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:29.247985  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "9579e506d72842a9a847d0498878c3fd"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.248346  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:29.278811  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:29.280180  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:29.281877  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:29.284339  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:29.284577  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.284886  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:29.285064  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.332082  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:41973
I20260709 12:25:29.332204 16599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:41973 every 8 connection(s)
I20260709 12:25:29.337459  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:29.345810 16603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.347932 16604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:29.351126 16606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:29.351429 16600 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41909
I20260709 12:25:29.352043 16600 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:29.352468  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:29.353298 16600 heartbeater.cc:507] Master 127.6.182.190:41909 requested a full tablet report, sending...
I20260709 12:25:29.353510  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:29.353859  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:29.354056  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599929354039 us; error 0 us; skew 500 ppm
I20260709 12:25:29.354781  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:29.355825 16322 ts_manager.cc:194] Registered new tserver with Master: 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:29.357766  6874 webserver.cc:533] Webserver started at http://127.6.182.132:46593/ using document root <none> and password file <none>
I20260709 12:25:29.357841 16322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44648
I20260709 12:25:29.358513  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:29.358765  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:29.359126  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:29.360476  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-3-root/instance:
uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.365558  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:29.369422 16611 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.370520  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:29.371065  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
format_stamp: "Formatted at 2026-07-09 12:25:29 on dist-test-slave-lgtn"
I20260709 12:25:29.371428  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:29.383630  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:29.384976  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:29.386555  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:29.389091  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:29.389328  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.389571  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:29.389744  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.438468  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.132:43917
I20260709 12:25:29.438575 16673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.132:43917 every 8 connection(s)
I20260709 12:25:29.454268 16674 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41909
I20260709 12:25:29.454754 16674 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:29.455705 16674 heartbeater.cc:507] Master 127.6.182.190:41909 requested a full tablet report, sending...
I20260709 12:25:29.458027 16322 ts_manager.cc:194] Registered new tserver with Master: 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:29.458356  6874 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016607031s
I20260709 12:25:29.459636 16322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44664
I20260709 12:25:29.488523 16322 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44666:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:25:29.758876 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 96e703662cca4f18a580ec34362c26ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:29.760979 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e703662cca4f18a580ec34362c26ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.778703 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 96e703662cca4f18a580ec34362c26ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:29.780514 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e703662cca4f18a580ec34362c26ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.786835 16564 tablet_service.cc:1511] Processing CreateTablet for tablet a10685b118db4ae794b1ecf232267bb8 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:29.790660 16414 tablet_service.cc:1511] Processing CreateTablet for tablet a10685b118db4ae794b1ecf232267bb8 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:29.808138 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 09a476f9e5784529a3f8e75fed90d096 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:29.792713 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd8dd213a384928ad8674ef30844b45 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:29.810751 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10685b118db4ae794b1ecf232267bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.811931 16694 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:29.814047 16406 tablet_service.cc:1511] Processing CreateTablet for tablet 2abf5d33e7a744ab8a191960f961bdcd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:29.815858 16406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abf5d33e7a744ab8a191960f961bdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.816155 16695 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
W20260709 12:25:29.820948 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:29.794062 16638 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd8dd213a384928ad8674ef30844b45 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:29.796571 16411 tablet_service.cc:1511] Processing CreateTablet for tablet c753e3027c7b414c9b0eb823b6c2893e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:29.824265 16638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8dd213a384928ad8674ef30844b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.824900 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c753e3027c7b414c9b0eb823b6c2893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.795419 16637 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0af858657e45a992b1c1c0883e888f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:29.826167 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8dd213a384928ad8674ef30844b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.798241 16635 tablet_service.cc:1511] Processing CreateTablet for tablet 020b055b364646c9b177588ef98ec412 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:29.828601 16695 tablet_bootstrap.cc:654] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.798445 16410 tablet_service.cc:1511] Processing CreateTablet for tablet 020b055b364646c9b177588ef98ec412 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:29.830104 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a476f9e5784529a3f8e75fed90d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.800277 16409 tablet_service.cc:1511] Processing CreateTablet for tablet e2f105035b4f4eda8c0fb001d571ddaa (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:29.831096 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020b055b364646c9b177588ef98ec412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.788615 16564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10685b118db4ae794b1ecf232267bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.831915 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f105035b4f4eda8c0fb001d571ddaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.802491 16408 tablet_service.cc:1511] Processing CreateTablet for tablet f1fcca6ce8824a0884716942fc18ff9a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:29.806236 16560 tablet_service.cc:1511] Processing CreateTablet for tablet 0a637f29bcd04712ae40966d9b293303 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:29.838635 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fcca6ce8824a0884716942fc18ff9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.839588 16560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a637f29bcd04712ae40966d9b293303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.794735 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 25341f99080e43ab92f1b8ffdd24bd2b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:29.844312 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25341f99080e43ab92f1b8ffdd24bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.845856 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 729d22f5fdb4470dbb68890b960a8395 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:29.847532 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729d22f5fdb4470dbb68890b960a8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.802493 16639 tablet_service.cc:1511] Processing CreateTablet for tablet 96e703662cca4f18a580ec34362c26ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:29.852085 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0af858657e45a992b1c1c0883e888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.802037 16563 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0af858657e45a992b1c1c0883e888f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:29.796864 16636 tablet_service.cc:1511] Processing CreateTablet for tablet c753e3027c7b414c9b0eb823b6c2893e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:29.854264 16636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c753e3027c7b414c9b0eb823b6c2893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.807565 16561 tablet_service.cc:1511] Processing CreateTablet for tablet 020b055b364646c9b177588ef98ec412 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:29.856104 16639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e703662cca4f18a580ec34362c26ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.857141 16563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0af858657e45a992b1c1c0883e888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.804912 16562 tablet_service.cc:1511] Processing CreateTablet for tablet 25341f99080e43ab92f1b8ffdd24bd2b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:29.858515 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25341f99080e43ab92f1b8ffdd24bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.799610 16634 tablet_service.cc:1511] Processing CreateTablet for tablet 0a637f29bcd04712ae40966d9b293303 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:29.861076 16634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a637f29bcd04712ae40966d9b293303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.868212 16694 tablet_bootstrap.cc:654] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.868508 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020b055b364646c9b177588ef98ec412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.871013 16490 tablet_service.cc:1511] Processing CreateTablet for tablet a10685b118db4ae794b1ecf232267bb8 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:29.873754 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10685b118db4ae794b1ecf232267bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.877146 16635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020b055b364646c9b177588ef98ec412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.898890 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd8dd213a384928ad8674ef30844b45 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:29.900000 16486 tablet_service.cc:1511] Processing CreateTablet for tablet c753e3027c7b414c9b0eb823b6c2893e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:29.901217 16415 tablet_service.cc:1511] Processing CreateTablet for tablet a8ad60577d0e48709e6040873bb43f0c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:29.901983 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0af858657e45a992b1c1c0883e888f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:29.902819 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ad60577d0e48709e6040873bb43f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.903192 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8dd213a384928ad8674ef30844b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.905077 16486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c753e3027c7b414c9b0eb823b6c2893e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.906807 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 0a637f29bcd04712ae40966d9b293303 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:29.910277 16484 tablet_service.cc:1511] Processing CreateTablet for tablet e2f105035b4f4eda8c0fb001d571ddaa (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:29.913448 16483 tablet_service.cc:1511] Processing CreateTablet for tablet f1fcca6ce8824a0884716942fc18ff9a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:29.916529 16482 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed76da550ea4f6690eb02f71843397a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:29.904709 16487 tablet_service.cc:1511] Processing CreateTablet for tablet 25341f99080e43ab92f1b8ffdd24bd2b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:29.908537 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a637f29bcd04712ae40966d9b293303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.917610 16565 tablet_service.cc:1511] Processing CreateTablet for tablet e2f105035b4f4eda8c0fb001d571ddaa (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:29.925195 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0af858657e45a992b1c1c0883e888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.926235 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f105035b4f4eda8c0fb001d571ddaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.938155 16481 tablet_service.cc:1511] Processing CreateTablet for tablet 2abf5d33e7a744ab8a191960f961bdcd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:29.939682 16487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25341f99080e43ab92f1b8ffdd24bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.943447 16484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f105035b4f4eda8c0fb001d571ddaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.950875 16633 tablet_service.cc:1511] Processing CreateTablet for tablet f1fcca6ce8824a0884716942fc18ff9a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:29.952068 16632 tablet_service.cc:1511] Processing CreateTablet for tablet 09a476f9e5784529a3f8e75fed90d096 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:29.952602 16633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fcca6ce8824a0884716942fc18ff9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.957412 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 729d22f5fdb4470dbb68890b960a8395 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:29.958892 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed76da550ea4f6690eb02f71843397a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:29.960294 16631 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed76da550ea4f6690eb02f71843397a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:29.962222 16632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a476f9e5784529a3f8e75fed90d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.962116 16557 tablet_service.cc:1511] Processing CreateTablet for tablet 2abf5d33e7a744ab8a191960f961bdcd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:29.963202 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed76da550ea4f6690eb02f71843397a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.964946 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729d22f5fdb4470dbb68890b960a8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.968416 16482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed76da550ea4f6690eb02f71843397a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.969326 16483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fcca6ce8824a0884716942fc18ff9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.973935 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abf5d33e7a744ab8a191960f961bdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.981416 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed76da550ea4f6690eb02f71843397a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.964185 16559 tablet_service.cc:1511] Processing CreateTablet for tablet 09a476f9e5784529a3f8e75fed90d096 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:29.994710 16695 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:29.995437 16695 ts_tablet_manager.cc:1403] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.000s
I20260709 12:25:30.005138 16559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a476f9e5784529a3f8e75fed90d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.026403 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abf5d33e7a744ab8a191960f961bdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.021306 16556 tablet_service.cc:1511] Processing CreateTablet for tablet a8ad60577d0e48709e6040873bb43f0c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:30.034296 16411 tablet_service.cc:1511] Processing CreateTablet for tablet bb9f76a3c6784d0f97f736edeb104e6b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:30.054452 16694 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:30.055173 16694 ts_tablet_manager.cc:1403] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.244s	user 0.010s	sys 0.011s
I20260709 12:25:30.055795 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ad60577d0e48709e6040873bb43f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.064836 16698 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:30.071341 16563 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a412331894ae5b4797dbc5cdba9ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:30.049624 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9f76a3c6784d0f97f736edeb104e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.076805 16639 tablet_service.cc:1511] Processing CreateTablet for tablet a8ad60577d0e48709e6040873bb43f0c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:30.122439 16639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ad60577d0e48709e6040873bb43f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.077386 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 52cfc56c2e6b47dca2c52bfe83853728 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:30.080302 16486 tablet_service.cc:1511] Processing CreateTablet for tablet 729d22f5fdb4470dbb68890b960a8395 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:30.126192 16486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729d22f5fdb4470dbb68890b960a8395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.129060 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52cfc56c2e6b47dca2c52bfe83853728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.130010 16562 tablet_service.cc:1511] Processing CreateTablet for tablet af5dd7018976414e8ed99fd67565655d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:30.132324 16634 tablet_service.cc:1511] Processing CreateTablet for tablet cafc96e5f9404fd4be84ec37525a1b25 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:30.133349 16557 tablet_service.cc:1511] Processing CreateTablet for tablet bb9f76a3c6784d0f97f736edeb104e6b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:30.085289 16408 tablet_service.cc:1511] Processing CreateTablet for tablet cafc96e5f9404fd4be84ec37525a1b25 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:30.085623 16695 raft_consensus.cc:359] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.141553 16695 raft_consensus.cc:385] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.141983 16695 raft_consensus.cc:740] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.142642 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafc96e5f9404fd4be84ec37525a1b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.142980 16695 consensus_queue.cc:260] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.146966 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 229e66771a884b868626f2c5c0f7ce0e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:30.148782 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229e66771a884b868626f2c5c0f7ce0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.091396 16563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a412331894ae5b4797dbc5cdba9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.095465 16560 tablet_service.cc:1511] Processing CreateTablet for tablet 52cfc56c2e6b47dca2c52bfe83853728 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:30.097391 16415 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8cd99199d478e8112f6890e152dd7 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:30.102837 16489 tablet_service.cc:1511] Processing CreateTablet for tablet af5dd7018976414e8ed99fd67565655d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:30.190647 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dd7018976414e8ed99fd67565655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.104940 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 52cfc56c2e6b47dca2c52bfe83853728 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:30.193001 16699 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:30.193553 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52cfc56c2e6b47dca2c52bfe83853728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.109711 16698 tablet_bootstrap.cc:654] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.111228 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 39b59162ae2d417092181b3f9198701e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:30.113312 16450 heartbeater.cc:499] Master 127.6.182.190:41909 was elected leader, sending a full tablet report...
I20260709 12:25:30.188194 16638 tablet_service.cc:1511] Processing CreateTablet for tablet 459c4e3e74104556b0fdc8dbf900c78b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:30.203537 16565 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8cd99199d478e8112f6890e152dd7 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:30.134016 16634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafc96e5f9404fd4be84ec37525a1b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.080190 16637 tablet_service.cc:1511] Processing CreateTablet for tablet af5dd7018976414e8ed99fd67565655d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:30.210623 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dd7018976414e8ed99fd67565655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.137503 16406 tablet_service.cc:1511] Processing CreateTablet for tablet 6271255b6fb24144ae8515a99a98297a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:30.087080 16410 tablet_service.cc:1511] Processing CreateTablet for tablet 459c4e3e74104556b0fdc8dbf900c78b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:30.150858 16488 tablet_service.cc:1511] Processing CreateTablet for tablet bb9f76a3c6784d0f97f736edeb104e6b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:30.154846 16635 tablet_service.cc:1511] Processing CreateTablet for tablet 6271255b6fb24144ae8515a99a98297a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:30.157899 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 55bce0408d844486ae486633aad4bc7e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:30.158720 16636 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a412331894ae5b4797dbc5cdba9ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:30.166090 16561 tablet_service.cc:1511] Processing CreateTablet for tablet 6271255b6fb24144ae8515a99a98297a (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:30.058995 16694 raft_consensus.cc:359] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.169999 16414 tablet_service.cc:1511] Processing CreateTablet for tablet 98012d4197b649e6be7f7df5d46b6218 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:30.189131 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9f76a3c6784d0f97f736edeb104e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.233139 16694 raft_consensus.cc:385] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.234249 16631 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8cd99199d478e8112f6890e152dd7 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:30.238557 16526 heartbeater.cc:499] Master 127.6.182.190:41909 was elected leader, sending a full tablet report...
I20260709 12:25:30.242935 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b59162ae2d417092181b3f9198701e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.244777 16487 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6a412331894ae5b4797dbc5cdba9ba (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:30.234192 16482 tablet_service.cc:1511] Processing CreateTablet for tablet cafc96e5f9404fd4be84ec37525a1b25 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:30.249111 16694 raft_consensus.cc:740] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.254498 16638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c4e3e74104556b0fdc8dbf900c78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.259262 16560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52cfc56c2e6b47dca2c52bfe83853728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.262454 16694 consensus_queue.cc:260] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.269068 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6271255b6fb24144ae8515a99a98297a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.271072 16406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6271255b6fb24144ae8515a99a98297a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.260599 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9f76a3c6784d0f97f736edeb104e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.252967 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 39b59162ae2d417092181b3f9198701e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:30.280412 16410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c4e3e74104556b0fdc8dbf900c78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.248562 16483 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:30.284672 16482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafc96e5f9404fd4be84ec37525a1b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.285938 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8cd99199d478e8112f6890e152dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.298238 16635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6271255b6fb24144ae8515a99a98297a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.298938 16698 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:30.299517 16698 ts_tablet_manager.cc:1403] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.235s	user 0.024s	sys 0.000s
I20260709 12:25:30.301146 16487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a412331894ae5b4797dbc5cdba9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.300880 16633 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:30.302395 16633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.310658 16632 tablet_service.cc:1511] Processing CreateTablet for tablet 229e66771a884b868626f2c5c0f7ce0e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:30.312155 16632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229e66771a884b868626f2c5c0f7ce0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.279628 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:30.321555 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8cd99199d478e8112f6890e152dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.321969 16486 tablet_service.cc:1511] Processing CreateTablet for tablet 459c4e3e74104556b0fdc8dbf900c78b (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:30.293668 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8cd99199d478e8112f6890e152dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.322907 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bce0408d844486ae486633aad4bc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.324986 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.325316 16698 raft_consensus.cc:359] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.326102 16698 raft_consensus.cc:385] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.326439 16698 raft_consensus.cc:740] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.327235 16698 consensus_queue.cc:260] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.329013 16636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6a412331894ae5b4797dbc5cdba9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.334156 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b59162ae2d417092181b3f9198701e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.337567 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98012d4197b649e6be7f7df5d46b6218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.344704 16695 ts_tablet_manager.cc:1434] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.349s	user 0.027s	sys 0.006s
I20260709 12:25:30.346171 16695 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:30.349236 16564 tablet_service.cc:1511] Processing CreateTablet for tablet 39b59162ae2d417092181b3f9198701e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:30.351234 16564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b59162ae2d417092181b3f9198701e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.351433 16407 tablet_service.cc:1511] Processing CreateTablet for tablet b875e4a6504b43ef98139d098839a56c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:30.354087 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b875e4a6504b43ef98139d098839a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.357324 16484 tablet_service.cc:1511] Processing CreateTablet for tablet 229e66771a884b868626f2c5c0f7ce0e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:30.358232 16694 ts_tablet_manager.cc:1434] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.303s	user 0.018s	sys 0.009s
I20260709 12:25:30.348521 16639 tablet_service.cc:1511] Processing CreateTablet for tablet 55bce0408d844486ae486633aad4bc7e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:30.359958 16600 heartbeater.cc:499] Master 127.6.182.190:41909 was elected leader, sending a full tablet report...
I20260709 12:25:30.360961 16639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bce0408d844486ae486633aad4bc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.361675 16481 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab89972ea7341a79be8a760a43ccfcb (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:30.369720 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5dd7018976414e8ed99fd67565655d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.375172 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 55bce0408d844486ae486633aad4bc7e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:30.376775 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bce0408d844486ae486633aad4bc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.378453 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab89972ea7341a79be8a760a43ccfcb (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:30.379892 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab89972ea7341a79be8a760a43ccfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.392936 16694 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:30.402211 16702 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.403791 16702 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.408280 16698 ts_tablet_manager.cc:1434] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.011s
I20260709 12:25:30.409330 16674 heartbeater.cc:499] Master 127.6.182.190:41909 was elected leader, sending a full tablet report...
I20260709 12:25:30.415179 16698 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:30.415815 16699 tablet_bootstrap.cc:654] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.416942 16408 tablet_service.cc:1511] Processing CreateTablet for tablet 06cf958045274e6f8c8b60508d68cf26 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:30.418526 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cf958045274e6f8c8b60508d68cf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.431597 16695 tablet_bootstrap.cc:654] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.420987 16483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab5fdb3eb3e45b2a3b1acf9288fc9c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:30.447206 16675 tablet.cc:2406] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:30.452020 16694 tablet_bootstrap.cc:654] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.451753 16638 tablet_service.cc:1511] Processing CreateTablet for tablet b875e4a6504b43ef98139d098839a56c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:30.453965 16409 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad58928df6e4de09d9efac2b2da0a2e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:30.456352 16698 tablet_bootstrap.cc:654] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.457573 16409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad58928df6e4de09d9efac2b2da0a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.481266 16700 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.481884 16700 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.482841 16559 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab89972ea7341a79be8a760a43ccfcb (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:30.483640 16481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab89972ea7341a79be8a760a43ccfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.484375 16559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab89972ea7341a79be8a760a43ccfcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.494618 16635 tablet_service.cc:1511] Processing CreateTablet for tablet 06cf958045274e6f8c8b60508d68cf26 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:30.470304 16638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b875e4a6504b43ef98139d098839a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.487187 16700 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:30.489416 16564 tablet_service.cc:1511] Processing CreateTablet for tablet 98012d4197b649e6be7f7df5d46b6218 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:30.497289 16486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c4e3e74104556b0fdc8dbf900c78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.497756 16564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98012d4197b649e6be7f7df5d46b6218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.492353 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 06cf958045274e6f8c8b60508d68cf26 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:30.500459 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cf958045274e6f8c8b60508d68cf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.501536 16484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229e66771a884b868626f2c5c0f7ce0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.491708 16482 tablet_service.cc:1511] Processing CreateTablet for tablet 98012d4197b649e6be7f7df5d46b6218 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:30.505160 16482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98012d4197b649e6be7f7df5d46b6218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.509863 16489 tablet_service.cc:1511] Processing CreateTablet for tablet b875e4a6504b43ef98139d098839a56c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:30.511602 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b875e4a6504b43ef98139d098839a56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.517859 16702 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:30.550156 16635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cf958045274e6f8c8b60508d68cf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.508394 16637 tablet_service.cc:1511] Processing CreateTablet for tablet b17303c99a9d4e87b2d1903bff808994 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:30.610651 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17303c99a9d4e87b2d1903bff808994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.614984 16695 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:30.615638 16695 ts_tablet_manager.cc:1403] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.270s	user 0.035s	sys 0.005s
I20260709 12:25:30.616921 16490 tablet_service.cc:1511] Processing CreateTablet for tablet b17303c99a9d4e87b2d1903bff808994 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:30.618597 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17303c99a9d4e87b2d1903bff808994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.619419 16695 raft_consensus.cc:359] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:30.620234 16695 raft_consensus.cc:385] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.620543 16695 raft_consensus.cc:740] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.621430 16695 consensus_queue.cc:260] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:30.637985 16695 ts_tablet_manager.cc:1434] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 12:25:30.638046 16639 tablet_service.cc:1511] Processing CreateTablet for tablet bb5374aa54af41848399d9477ec0fccf (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:30.639930 16639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5374aa54af41848399d9477ec0fccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.640267 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad58928df6e4de09d9efac2b2da0a2e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:30.641722 16699 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:30.642295 16699 ts_tablet_manager.cc:1403] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.450s	user 0.007s	sys 0.015s
I20260709 12:25:30.645762 16699 raft_consensus.cc:359] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:30.646497 16699 raft_consensus.cc:385] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.646783 16699 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.647845 16411 tablet_service.cc:1511] Processing CreateTablet for tablet bb5374aa54af41848399d9477ec0fccf (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:30.641710 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad58928df6e4de09d9efac2b2da0a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.651609 16487 tablet_service.cc:1511] Processing CreateTablet for tablet bb5374aa54af41848399d9477ec0fccf (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:30.653213 16487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5374aa54af41848399d9477ec0fccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.654913 16698 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:30.655476 16698 ts_tablet_manager.cc:1403] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.004s
I20260709 12:25:30.658556 16636 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7e81a4e4bb44878fc114bec5022722 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:30.658732 16698 raft_consensus.cc:359] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:30.659483 16698 raft_consensus.cc:385] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.659795 16698 raft_consensus.cc:740] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.647789 16699 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:30.575652 16557 tablet_service.cc:1511] Processing CreateTablet for tablet b17303c99a9d4e87b2d1903bff808994 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:30.686132 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5374aa54af41848399d9477ec0fccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.686484 16694 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:30.688040 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7e81a4e4bb44878fc114bec5022722 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:30.689270 16695 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:30.700443 16703 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.731034 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7e81a4e4bb44878fc114bec5022722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.731292 16703 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:30.734187 16703 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:30.701030 16636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7e81a4e4bb44878fc114bec5022722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.707979 16698 consensus_queue.cc:260] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:30.750619 16694 ts_tablet_manager.cc:1403] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.380s	user 0.032s	sys 0.007s
I20260709 12:25:30.763262 16698 ts_tablet_manager.cc:1434] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 12:25:30.780565 16698 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:30.769254 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 2855310d11c545378f19afd1715ebb47 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:30.770888 16632 tablet_service.cc:1511] Processing CreateTablet for tablet bddb5ffc80c04064b4a3b894023118d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:30.789223 16632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb5ffc80c04064b4a3b894023118d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.770869 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 2855310d11c545378f19afd1715ebb47 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:30.791976 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2855310d11c545378f19afd1715ebb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.776110 16413 tablet_service.cc:1511] Processing CreateTablet for tablet 419069393a644530ac323793012d5f9c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:30.777680 16631 tablet_service.cc:1511] Processing CreateTablet for tablet 419069393a644530ac323793012d5f9c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:30.800737 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419069393a644530ac323793012d5f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.802170 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2855310d11c545378f19afd1715ebb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.806232 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419069393a644530ac323793012d5f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.805984 16694 raft_consensus.cc:359] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:30.807015 16694 raft_consensus.cc:385] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.807395 16694 raft_consensus.cc:740] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.814843 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 419069393a644530ac323793012d5f9c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:30.816577 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419069393a644530ac323793012d5f9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:30.824049 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:30.814868 16483 tablet_service.cc:1511] Processing CreateTablet for tablet bddb5ffc80c04064b4a3b894023118d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:30.834460 16483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb5ffc80c04064b4a3b894023118d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.834890 16408 tablet_service.cc:1511] Processing CreateTablet for tablet 12bffdfc1b45484c9452392f860318fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:30.833341 16695 tablet_bootstrap.cc:654] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.808490 16694 consensus_queue.cc:260] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:30.836440 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bffdfc1b45484c9452392f860318fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.849864 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17303c99a9d4e87b2d1903bff808994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.871771 16559 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad58928df6e4de09d9efac2b2da0a2e (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:30.873522 16559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad58928df6e4de09d9efac2b2da0a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.878153 16561 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7e81a4e4bb44878fc114bec5022722 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:30.881873 16562 tablet_service.cc:1511] Processing CreateTablet for tablet bddb5ffc80c04064b4a3b894023118d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:30.883069 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7e81a4e4bb44878fc114bec5022722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.884959 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddb5ffc80c04064b4a3b894023118d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.878216 16694 ts_tablet_manager.cc:1434] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.003s
I20260709 12:25:30.886204 16694 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:30.889083 16482 tablet_service.cc:1511] Processing CreateTablet for tablet 957637a18e91481fb00d24ee6684e679 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:30.891836 16482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957637a18e91481fb00d24ee6684e679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.901531 16698 tablet_bootstrap.cc:654] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.903631 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 2855310d11c545378f19afd1715ebb47 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:30.906628 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2855310d11c545378f19afd1715ebb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.915834 16560 tablet_service.cc:1511] Processing CreateTablet for tablet 957637a18e91481fb00d24ee6684e679 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:30.916157 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 912f04f17584451592c26c403070693c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:30.917398 16560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957637a18e91481fb00d24ee6684e679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.917703 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912f04f17584451592c26c403070693c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.922634 16633 tablet_service.cc:1511] Processing CreateTablet for tablet 12bffdfc1b45484c9452392f860318fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:30.922991 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 12bffdfc1b45484c9452392f860318fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:30.924347 16633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bffdfc1b45484c9452392f860318fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.924522 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bffdfc1b45484c9452392f860318fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.933902 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 912f04f17584451592c26c403070693c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:30.925792 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:30.946960 16649 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:30.959913 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:30.960861 16575 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:30.962677 16615 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:30.945770 16637 tablet_service.cc:1511] Processing CreateTablet for tablet 957637a18e91481fb00d24ee6684e679 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:30.962756 16391 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:30.927877 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 912f04f17584451592c26c403070693c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:30.963723 16703 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.974223 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912f04f17584451592c26c403070693c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.974946 16723 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.975795 16723 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:30.994107 16695 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:30.993685 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 71519fa014734fe68b4df3cea03ca766 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:30.972169 16703 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.006219 16700 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.006403 16703 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.006783 16700 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.007220 16700 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.016865 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:30.996270 16695 ts_tablet_manager.cc:1403] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.307s	user 0.021s	sys 0.028s
I20260709 12:25:31.004734 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 71519fa014734fe68b4df3cea03ca766 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:31.030139 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957637a18e91481fb00d24ee6684e679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.034308 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71519fa014734fe68b4df3cea03ca766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.040277 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:31.040563 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.049211 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912f04f17584451592c26c403070693c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.050648 16638 tablet_service.cc:1511] Processing CreateTablet for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:31.054153 16638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.053807 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 71519fa014734fe68b4df3cea03ca766 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:31.054891 16694 tablet_bootstrap.cc:654] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.055922 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:31.056703 16575 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:31.055227 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71519fa014734fe68b4df3cea03ca766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.064673 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71519fa014734fe68b4df3cea03ca766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.065235 16727 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.065819 16727 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.047667 16411 tablet_service.cc:1511] Processing CreateTablet for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:31.072130 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.079368 16695 raft_consensus.cc:359] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.085680 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 89c18e43c84047efb66015470a2254ab (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:31.101586 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c18e43c84047efb66015470a2254ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.106527 16723 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:31.090692 16703 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.093788 16636 tablet_service.cc:1511] Processing CreateTablet for tablet 89c18e43c84047efb66015470a2254ab (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:31.111312 16649 raft_consensus.cc:2393] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:31.098091 16728 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.114727 16728 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.113730 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:31.113853 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:31.116928 16575 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.118239 16699 ts_tablet_manager.cc:1434] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.466s	user 0.022s	sys 0.019s
I20260709 12:25:31.118788 16636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c18e43c84047efb66015470a2254ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.119860 16704 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.120503 16704 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.122083 16728 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:31.122685 16698 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:31.123330 16698 ts_tablet_manager.cc:1403] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.343s	user 0.017s	sys 0.020s
I20260709 12:25:31.125490 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.126839 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.127733 16648 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
W20260709 12:25:31.128463 16391 leader_election.cc:343] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.129519 16541 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:31.130026 16727 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:31.129737 16562 tablet_service.cc:1511] Processing CreateTablet for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:31.096081 16695 raft_consensus.cc:385] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.150749 16695 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.152388 16632 tablet_service.cc:1511] Processing CreateTablet for tablet 440906c79bf64ae3bd7a7b15c6abba82 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:31.152791 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 56252914f95a4889a4f744beb66359d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:31.135839 16704 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:31.148283 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 56252914f95a4889a4f744beb66359d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:31.149149 16699 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:31.160879 16632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440906c79bf64ae3bd7a7b15c6abba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.162302 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:31.163081 16574 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:31.164515 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56252914f95a4889a4f744beb66359d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.164882 16704 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.164569 16615 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:31.152024 16695 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.165320 16704 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.165750 16704 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.167233 16727 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.167659 16727 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.167994 16727 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.168978 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.170526 16695 ts_tablet_manager.cc:1434] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.147s	user 0.008s	sys 0.000s
W20260709 12:25:31.170843 16466 leader_election.cc:343] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.171887 16575 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:31.174270 16698 raft_consensus.cc:359] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.175196 16698 raft_consensus.cc:385] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.175045 16615 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:31.175590 16698 raft_consensus.cc:740] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.135715 16703 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:31.176818 16703 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.177397 16703 raft_consensus.cc:697] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:31.178391 16703 consensus_queue.cc:237] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.160928 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56252914f95a4889a4f744beb66359d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.178767 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 56252914f95a4889a4f744beb66359d2 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:31.180401 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56252914f95a4889a4f744beb66359d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.180660 16700 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.198170 16698 consensus_queue.cc:260] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.199784 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 89c18e43c84047efb66015470a2254ab (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:31.171933 16695 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:31.218186 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ab7bf5977d4d7e9033989e7f6ddc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.234290 16408 tablet_service.cc:1511] Processing CreateTablet for tablet 440906c79bf64ae3bd7a7b15c6abba82 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:31.251477 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:31.252255 16424 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:31.231204 16425 raft_consensus.cc:2393] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
W20260709 12:25:31.222133 16541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 92894us
I20260709 12:25:31.234699 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 440906c79bf64ae3bd7a7b15c6abba82 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:31.261648 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440906c79bf64ae3bd7a7b15c6abba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.266076 16540 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:31.267668 16694 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:31.268381 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:31.269740 16575 raft_consensus.cc:2393] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:31.263891 16557 tablet_service.cc:1511] Processing CreateTablet for tablet 35263f5174d84840b741879f4ba4e980 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:31.268453 16694 ts_tablet_manager.cc:1403] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.383s	user 0.017s	sys 0.013s
I20260709 12:25:31.263921 16704 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.280148 16631 tablet_service.cc:1511] Processing CreateTablet for tablet 35263f5174d84840b741879f4ba4e980 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:31.282447 16732 raft_consensus.cc:2749] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.282909 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440906c79bf64ae3bd7a7b15c6abba82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.283631 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35263f5174d84840b741879f4ba4e980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.290884 16465 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:31.291738 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:31.291935 16723 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.292822 16723 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.293337 16723 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.294164 16695 tablet_bootstrap.cc:654] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.294657 16391 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:31.299163 16728 raft_consensus.cc:2749] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.300216 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.302060 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:31.295221 16704 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:31.290279 16700 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:31.286175 16727 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.304157 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c18e43c84047efb66015470a2254ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.316211 16699 tablet_bootstrap.cc:654] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.316998 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35263f5174d84840b741879f4ba4e980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.322940 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 35263f5174d84840b741879f4ba4e980 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:31.327304 16489 tablet_service.cc:1511] Processing CreateTablet for tablet aea1365c62bb457f95eb3d1f583a6d7d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:31.327829 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35263f5174d84840b741879f4ba4e980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.328892 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea1365c62bb457f95eb3d1f583a6d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.329943 16637 tablet_service.cc:1511] Processing CreateTablet for tablet aea1365c62bb457f95eb3d1f583a6d7d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:31.331357 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea1365c62bb457f95eb3d1f583a6d7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:31.232669 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 57730.1us
I20260709 12:25:31.339097 16727 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:31.276396 16694 raft_consensus.cc:359] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.354651 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:31.355792 16648 raft_consensus.cc:2393] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:31.349476 16319 catalog_manager.cc:5697] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.361310 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:31.362296 16575 raft_consensus.cc:2393] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:31.351344 16694 raft_consensus.cc:385] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.364251 16727 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.365867 16727 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.366843 16698 ts_tablet_manager.cc:1434] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.243s	user 0.027s	sys 0.012s
I20260709 12:25:31.367985 16727 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:31.368757 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.370045 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:25:31.371872 16614 leader_election.cc:343] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.372658 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:31.373869 16614 leader_election.cc:343] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.374280 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:31.374306 16614 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:31.368121 16698 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:31.376757 16727 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:25:31.376965 16614 leader_election.cc:343] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.377501 16615 leader_election.cc:343] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.377991 16615 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:31.378716 16727 raft_consensus.cc:2749] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:31.345219 16540 leader_election.cc:343] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.388942 16695 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:31.389576 16695 ts_tablet_manager.cc:1403] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.017s
I20260709 12:25:31.392343 16723 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.362841 16694 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.394083 16408 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef6c0d79aee443896c5b4c0cc5ea863 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:25:31.397818 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 60297.1us
W20260709 12:25:31.410617 16540 leader_election.cc:343] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.411149 16540 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:31.411451 16558 tablet_service.cc:1511] Processing CreateTablet for tablet aea1365c62bb457f95eb3d1f583a6d7d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:31.412961 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea1365c62bb457f95eb3d1f583a6d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.412412 16694 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.413424 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef6c0d79aee443896c5b4c0cc5ea863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.413622 16704 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.420253 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef6c0d79aee443896c5b4c0cc5ea863 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:31.421710 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef6c0d79aee443896c5b4c0cc5ea863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.406069 16698 tablet_bootstrap.cc:654] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.426227 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.426456 16695 raft_consensus.cc:359] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.427140 16695 raft_consensus.cc:385] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:31.428005 16390 leader_election.cc:343] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.427682 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef6c0d79aee443896c5b4c0cc5ea863 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:31.428535 16390 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:31.429564 16700 raft_consensus.cc:2749] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.427470 16695 raft_consensus.cc:740] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.429598 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef6c0d79aee443896c5b4c0cc5ea863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.431025 16695 consensus_queue.cc:260] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.433965 16694 ts_tablet_manager.cc:1434] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.000s
I20260709 12:25:31.435091 16694 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:31.436177 16695 ts_tablet_manager.cc:1434] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 12:25:31.437511 16695 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:31.444021 16632 tablet_service.cc:1511] Processing CreateTablet for tablet f6439a65987543bbb05819426afdf56f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:31.446312 16632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6439a65987543bbb05819426afdf56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.446892 16695 tablet_bootstrap.cc:654] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.459525 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:31.461303 16466 leader_election.cc:343] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.465305 16699 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:31.465947 16699 ts_tablet_manager.cc:1403] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.317s	user 0.016s	sys 0.024s
I20260709 12:25:31.471537 16407 tablet_service.cc:1511] Processing CreateTablet for tablet f6439a65987543bbb05819426afdf56f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:31.476871 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6439a65987543bbb05819426afdf56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.481649 16699 raft_consensus.cc:359] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.482282 16488 tablet_service.cc:1511] Processing CreateTablet for tablet f6439a65987543bbb05819426afdf56f (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:31.484683 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6439a65987543bbb05819426afdf56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.482640 16699 raft_consensus.cc:385] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.487097 16699 raft_consensus.cc:740] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.488152 16699 consensus_queue.cc:260] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.495909 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 002181790b60483db2f0b175ffa46e97 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:31.498515 16631 tablet_service.cc:1511] Processing CreateTablet for tablet 002181790b60483db2f0b175ffa46e97 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:31.499389 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002181790b60483db2f0b175ffa46e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.500139 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002181790b60483db2f0b175ffa46e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.500710 16723 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:31.503189 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:31.503876 16425 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.509734 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:31.510789 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:31.512332 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.512902 16699 ts_tablet_manager.cc:1434] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:25:31.514176 16699 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:31.514602 16425 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:31.516803 16465 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:31.516681 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 002181790b60483db2f0b175ffa46e97 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:31.518253 16698 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:31.519119 16698 ts_tablet_manager.cc:1403] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.010s
I20260709 12:25:31.511363 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.518252 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002181790b60483db2f0b175ffa46e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.523981 16694 tablet_bootstrap.cc:654] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.525080 16723 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.526865 16723 raft_consensus.cc:697] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:31.527770 16723 consensus_queue.cc:237] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.530695 16698 raft_consensus.cc:359] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.531615 16698 raft_consensus.cc:385] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.531972 16698 raft_consensus.cc:740] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.536588 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:31.540184 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6f61d9e2dc485baa469c1bcf3f9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.548995 16408 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2d3f30f6a6496fa42959f3adc78ff9 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:31.552023 16408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2d3f30f6a6496fa42959f3adc78ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.549044 16695 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:31.553674 16695 ts_tablet_manager.cc:1403] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.009s
I20260709 12:25:31.556130 16723 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.556814 16723 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.558797 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2d3f30f6a6496fa42959f3adc78ff9 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:31.560218 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2d3f30f6a6496fa42959f3adc78ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.561441 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2d3f30f6a6496fa42959f3adc78ff9 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:31.563005 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2d3f30f6a6496fa42959f3adc78ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.564519 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:31.566133 16465 leader_election.cc:343] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.576680 16637 tablet_service.cc:1511] Processing CreateTablet for tablet 6b09eddf44e747eb9bc7886771ea40fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:31.578306 16637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b09eddf44e747eb9bc7886771ea40fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.580332 16695 raft_consensus.cc:359] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.582442 16695 raft_consensus.cc:385] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.585022 16695 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.573202 16698 consensus_queue.cc:260] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.586030 16695 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.588044 16698 ts_tablet_manager.cc:1434] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:25:31.588337 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 6b09eddf44e747eb9bc7886771ea40fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:31.589694 16698 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:31.590130 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b09eddf44e747eb9bc7886771ea40fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.590595 16723 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:31.614117 16695 ts_tablet_manager.cc:1434] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:25:31.615262 16727 consensus_queue.cc:1048] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.620132 16485 tablet_service.cc:1511] Processing CreateTablet for tablet 6b09eddf44e747eb9bc7886771ea40fd (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:31.622861 16485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b09eddf44e747eb9bc7886771ea40fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.626750 16695 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:31.627642 16562 tablet_service.cc:1511] Processing CreateTablet for tablet 607f98fb104d4e60bb399f4e52414dff (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:31.635859 16699 tablet_bootstrap.cc:654] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.649065 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607f98fb104d4e60bb399f4e52414dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.655102 16694 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:31.655799 16694 ts_tablet_manager.cc:1403] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.007s
I20260709 12:25:31.659749 16694 raft_consensus.cc:359] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.660768 16694 raft_consensus.cc:385] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.661131 16694 raft_consensus.cc:740] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.664402 16557 tablet_service.cc:1511] Processing CreateTablet for tablet ee31b43a234a4568866bc7b687e42337 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:31.662026 16694 consensus_queue.cc:260] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.668193 16557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee31b43a234a4568866bc7b687e42337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.669588 16695 tablet_bootstrap.cc:654] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.670153 16694 ts_tablet_manager.cc:1434] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:25:31.671518 16694 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:31.675417 16488 tablet_service.cc:1511] Processing CreateTablet for tablet ee31b43a234a4568866bc7b687e42337 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:31.621147 16320 catalog_manager.cc:5697] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.680506 16727 consensus_queue.cc:1048] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.681612 16631 tablet_service.cc:1511] Processing CreateTablet for tablet 607f98fb104d4e60bb399f4e52414dff (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:31.681736 16407 tablet_service.cc:1511] Processing CreateTablet for tablet 607f98fb104d4e60bb399f4e52414dff (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:31.667274 16698 tablet_bootstrap.cc:654] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.694000 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6984bac3db42cca9c8fb4969479f32 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:31.702558 16638 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d37de09ac428a9151d21ca953d08c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:31.703545 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607f98fb104d4e60bb399f4e52414dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.704276 16638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d37de09ac428a9151d21ca953d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.704684 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d37de09ac428a9151d21ca953d08c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:31.694005 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607f98fb104d4e60bb399f4e52414dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.717377 16704 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.718001 16704 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.718082 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 4a4d37de09ac428a9151d21ca953d08c (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:31.718943 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:31.719497 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d37de09ac428a9151d21ca953d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.720305 16704 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:31.722424 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.733850 16648 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:31.735181 16699 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:31.735656 16541 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:31.735929 16699 ts_tablet_manager.cc:1403] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.003s
I20260709 12:25:31.736824 16704 raft_consensus.cc:2804] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.737385 16704 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.737932 16704 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.719058 16558 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6984bac3db42cca9c8fb4969479f32 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:31.740571 16558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6984bac3db42cca9c8fb4969479f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.725739 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6984bac3db42cca9c8fb4969479f32 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:25:31.725797 16466 leader_election.cc:343] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.743182 16466 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:31.744326 16723 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.727524 16630 tablet_service.cc:1511] Processing CreateTablet for tablet ee31b43a234a4568866bc7b687e42337 (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:31.731657 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.743943 16699 raft_consensus.cc:359] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.746063 16699 raft_consensus.cc:385] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.746409 16699 raft_consensus.cc:740] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
W20260709 12:25:31.746932 16540 leader_election.cc:343] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.747778 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee31b43a234a4568866bc7b687e42337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.757097 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee31b43a234a4568866bc7b687e42337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.757287 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6984bac3db42cca9c8fb4969479f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.777720 16556 tablet_service.cc:1511] Processing CreateTablet for tablet 30c6323485424469a3be43cd3a647cad (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:31.779250 16556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c6323485424469a3be43cd3a647cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.765367 16699 consensus_queue.cc:260] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.787209 16699 ts_tablet_manager.cc:1434] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 12:25:31.793305 16704 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.801723 16700 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.805141 16694 tablet_bootstrap.cc:654] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.810103 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a4d37de09ac428a9151d21ca953d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.810732 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6984bac3db42cca9c8fb4969479f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.842417 16411 tablet_service.cc:1511] Processing CreateTablet for tablet 30c6323485424469a3be43cd3a647cad (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:31.843868 16411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c6323485424469a3be43cd3a647cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.846673 16695 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:31.847285 16695 ts_tablet_manager.cc:1403] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.002s
I20260709 12:25:31.850529 16695 raft_consensus.cc:359] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.851311 16695 raft_consensus.cc:385] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.819772 16700 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:31.851953 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:31.852963 16630 tablet_service.cc:1511] Processing CreateTablet for tablet 30c6323485424469a3be43cd3a647cad (DEFAULT_TABLE table=test-workload [id=9a65214b8f154d88a08c4b3401d89197]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:31.855803 16630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c6323485424469a3be43cd3a647cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.857091 16700 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:31.857659 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:31.859856 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:31.859872 16391 leader_election.cc:343] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.862849 16390 leader_election.cc:343] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.863519 16390 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:31.864383 16700 raft_consensus.cc:2749] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.868019 16732 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.851606 16695 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.868659 16732 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.871306 16732 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:31.871994 16695 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.872052 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:31.875664 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.874915 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:31.876368 16424 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:31.875311 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:31.878247 16648 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.874212 16704 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:31.877709 16540 leader_election.cc:343] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.881069 16540 leader_election.cc:343] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.881824 16540 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:31.883002 16704 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.883435 16704 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.883847 16704 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.888497 16699 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:31.904366 16698 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:31.905089 16698 ts_tablet_manager.cc:1403] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.316s	user 0.010s	sys 0.022s
I20260709 12:25:31.908241 16698 raft_consensus.cc:359] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.910008 16700 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.915854 16700 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.918617 16700 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:31.919828 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:31.921557 16390 leader_election.cc:343] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.914330 16648 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:31.914312 16698 raft_consensus.cc:385] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.924182 16698 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.925627 16541 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:31.926357 16698 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.927098 16732 raft_consensus.cc:2804] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.928993 16698 ts_tablet_manager.cc:1434] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:25:31.929919 16703 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.930418 16703 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:31.932699 16703 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:31.935065 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:31.935832 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:31.938268 16425 raft_consensus.cc:2393] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 1: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:31.929955 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:31.927235 16695 ts_tablet_manager.cc:1434] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.080s	user 0.001s	sys 0.010s
I20260709 12:25:31.940593 16614 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:31.941780 16703 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.947322 16699 tablet_bootstrap.cc:654] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:31.942483 16391 leader_election.cc:343] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.948913 16695 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:31.948858 16391 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:31.949747 16700 raft_consensus.cc:2749] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.951006 16698 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:31.954896 16704 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.957307 16732 raft_consensus.cc:697] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:31.952728 16694 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:31.958892 16694 ts_tablet_manager.cc:1403] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.003s
I20260709 12:25:31.959575 16695 tablet_bootstrap.cc:654] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.959304 16732 consensus_queue.cc:237] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.953076 16703 raft_consensus.cc:2749] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.962532 16694 raft_consensus.cc:359] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.964102 16694 raft_consensus.cc:385] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.964792 16694 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.965858 16699 tablet_bootstrap.cc:492] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:31.966450 16699 ts_tablet_manager.cc:1403] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.004s
I20260709 12:25:31.966085 16694 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:31.968482 16704 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:31.970261 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:31.970613 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:31.970996 16425 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.971671 16698 tablet_bootstrap.cc:654] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:31.972366 16540 leader_election.cc:343] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.975260 16694 ts_tablet_manager.cc:1434] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:25:31.970217 16699 raft_consensus.cc:359] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.976066 16699 raft_consensus.cc:385] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.981999 16699 raft_consensus.cc:740] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.983662 16695 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:31.983347 16699 consensus_queue.cc:260] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:31.984413 16695 ts_tablet_manager.cc:1403] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 12:25:31.980547 16425 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:31.987025 16540 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:31.981421 16723 consensus_queue.cc:1048] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:31.988451 16699 ts_tablet_manager.cc:1434] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:25:31.976994 16694 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:31.992090 16695 raft_consensus.cc:359] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.992899 16695 raft_consensus.cc:385] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.993013 16732 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.993254 16695 raft_consensus.cc:740] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.993973 16732 raft_consensus.cc:697] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:31.994235 16695 consensus_queue.cc:260] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:31.994940 16732 consensus_queue.cc:237] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.002636 16695 ts_tablet_manager.cc:1434] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:32.004295 16695 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.013631 16703 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.014540 16703 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.023460 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.025985 16703 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:31.999570 16694 tablet_bootstrap.cc:654] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.027223 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:31.994586 16319 catalog_manager.cc:5697] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:32.026795 16615 leader_election.cc:343] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.030823 16614 leader_election.cc:343] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.033437 16614 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:32.048787 16695 tablet_bootstrap.cc:654] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.048203 16723 consensus_queue.cc:1048] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.049439 16694 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:32.050134 16694 ts_tablet_manager.cc:1403] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.003s
I20260709 12:25:32.054584 16694 raft_consensus.cc:359] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.055423 16694 raft_consensus.cc:385] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.055898 16694 raft_consensus.cc:740] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.057653 16703 raft_consensus.cc:2749] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.057263 16694 consensus_queue.cc:260] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.063277 16694 ts_tablet_manager.cc:1434] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:25:32.065315 16694 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.068291 16695 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.068868 16695 ts_tablet_manager.cc:1403] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.013s
I20260709 12:25:32.072080 16695 raft_consensus.cc:359] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.072928 16695 raft_consensus.cc:385] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.073312 16695 raft_consensus.cc:740] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.073936 16694 tablet_bootstrap.cc:654] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.074183 16695 consensus_queue.cc:260] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.075570 16723 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.076109 16723 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.078768 16723 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.080490 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.080972 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:32.082883 16465 leader_election.cc:343] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.083935 16466 leader_election.cc:343] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.084555 16695 ts_tablet_manager.cc:1434] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:32.085745 16695 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.085906 16466 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:32.086510 16694 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
W20260709 12:25:32.074625 16761 log.cc:927] Time spent T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:32.087081 16694 ts_tablet_manager.cc:1403] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 12:25:32.087188 16723 raft_consensus.cc:2749] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.091307 16694 raft_consensus.cc:359] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.092111 16694 raft_consensus.cc:385] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.092407 16694 raft_consensus.cc:740] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.093673 16695 tablet_bootstrap.cc:654] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.093297 16694 consensus_queue.cc:260] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.094641 16699 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.096109 16694 ts_tablet_manager.cc:1434] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:32.103974 16694 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.099014 16695 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.113659 16695 ts_tablet_manager.cc:1403] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:25:32.115022 16694 tablet_bootstrap.cc:654] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.116595 16695 raft_consensus.cc:359] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.117372 16695 raft_consensus.cc:385] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.116451 16699 tablet_bootstrap.cc:654] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.117678 16695 raft_consensus.cc:740] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.119050 16698 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.118716 16695 consensus_queue.cc:260] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.119602 16698 ts_tablet_manager.cc:1403] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.169s	user 0.047s	sys 0.086s
I20260709 12:25:32.121013 16695 ts_tablet_manager.cc:1434] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:32.122417 16695 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.122895 16698 raft_consensus.cc:359] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.123679 16698 raft_consensus.cc:385] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.123993 16698 raft_consensus.cc:740] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.124933 16698 consensus_queue.cc:260] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.125123 16321 catalog_manager.cc:5697] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.127257 16698 ts_tablet_manager.cc:1434] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:25:32.128332 16698 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.129778 16695 tablet_bootstrap.cc:654] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.133507 16700 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.134402 16700 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.136642 16700 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.137866 16698 tablet_bootstrap.cc:654] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.138010 16694 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:32.138684 16694 ts_tablet_manager.cc:1403] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.008s
I20260709 12:25:32.139113 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.140458 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:32.143026 16391 leader_election.cc:343] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.144099 16391 leader_election.cc:343] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.144686 16391 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.146242 16699 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:32.146803 16699 ts_tablet_manager.cc:1403] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.004s
I20260709 12:25:32.146729 16700 raft_consensus.cc:2749] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.142758 16694 raft_consensus.cc:359] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.161456 16732 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.174384 16732 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.175813 16694 raft_consensus.cc:385] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.176383 16694 raft_consensus.cc:740] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.181118 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.182113 16648 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:32.182192 16699 raft_consensus.cc:359] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.183390 16699 raft_consensus.cc:385] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.183821 16699 raft_consensus.cc:740] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.184391 16541 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:32.184973 16699 consensus_queue.cc:260] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.185875 16758 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.186432 16758 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.186782 16758 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.180274 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.189471 16425 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:32.196781 16732 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.200505 16699 ts_tablet_manager.cc:1434] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 12:25:32.200520 16698 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.200659 16695 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.201422 16698 ts_tablet_manager.cc:1403] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.037s
I20260709 12:25:32.201515 16695 ts_tablet_manager.cc:1403] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.079s	user 0.052s	sys 0.020s
I20260709 12:25:32.202013 16758 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.204699 16695 raft_consensus.cc:359] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.205394 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:32.205753 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.206103 16648 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.205848 16698 raft_consensus.cc:359] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.206480 16425 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.206697 16698 raft_consensus.cc:385] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.207090 16698 raft_consensus.cc:740] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.208069 16698 consensus_queue.cc:260] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.210717 16698 ts_tablet_manager.cc:1434] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:32.214277 16425 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:32.214505 16732 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.214831 16758 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.214797 16698 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.215189 16732 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.215883 16540 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.205387 16695 raft_consensus.cc:385] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.217300 16695 raft_consensus.cc:740] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.217419 16732 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.218029 16732 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.218551 16732 raft_consensus.cc:697] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:32.218932 16695 consensus_queue.cc:260] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.219414 16732 consensus_queue.cc:237] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.221354 16695 ts_tablet_manager.cc:1434] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:32.222227 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.222600 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.222895 16425 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:32.223119 16698 tablet_bootstrap.cc:654] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.224570 16695 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.226922 16699 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.227433 16540 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.228973 16704 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.229390 16704 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.229760 16704 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:32.228464 16540 leader_election.cc:343] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.233264 16695 tablet_bootstrap.cc:654] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.234462 16698 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.234599 16699 tablet_bootstrap.cc:654] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.235071 16698 ts_tablet_manager.cc:1403] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 12:25:32.238654 16698 raft_consensus.cc:359] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.239593 16698 raft_consensus.cc:385] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.239936 16698 raft_consensus.cc:740] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.240877 16698 consensus_queue.cc:260] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.243904 16698 ts_tablet_manager.cc:1434] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:25:32.244938 16698 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.245592 16695 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.246162 16695 ts_tablet_manager.cc:1403] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:25:32.246626 16699 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:32.247201 16699 ts_tablet_manager.cc:1403] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.001s
I20260709 12:25:32.249430 16695 raft_consensus.cc:359] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.250490 16695 raft_consensus.cc:385] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.250840 16695 raft_consensus.cc:740] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.251622 16695 consensus_queue.cc:260] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.251910 16724 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.252602 16724 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.253494 16698 tablet_bootstrap.cc:654] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.181133 16694 consensus_queue.cc:260] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.254999 16724 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.256032 16694 ts_tablet_manager.cc:1434] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 12:25:32.255867 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.256994 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.252950 16648 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
W20260709 12:25:32.257555 16466 leader_election.cc:343] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.257687 16425 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:32.257695 16695 ts_tablet_manager.cc:1434] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:32.259429 16695 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.259347 16465 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:32.259351 16704 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.260682 16724 raft_consensus.cc:2804] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.261081 16724 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.261449 16724 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.263638 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.264525 16425 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.268011 16695 tablet_bootstrap.cc:654] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.268152 16698 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.268675 16698 ts_tablet_manager.cc:1403] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:25:32.272104 16698 raft_consensus.cc:359] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.273087 16698 raft_consensus.cc:385] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.273442 16698 raft_consensus.cc:740] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.274667 16698 consensus_queue.cc:260] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.277318 16425 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:32.278093 16698 ts_tablet_manager.cc:1434] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:32.278807 16540 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.279520 16698 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.280256 16766 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.280790 16766 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.282986 16766 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.284989 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.285863 16575 raft_consensus.cc:2393] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:32.288508 16703 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.288437 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.289501 16648 raft_consensus.cc:2393] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:32.290077 16698 tablet_bootstrap.cc:654] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.289157 16703 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.291391 16695 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.291918 16695 ts_tablet_manager.cc:1403] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.011s
I20260709 12:25:32.292585 16703 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.294461 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.295671 16695 raft_consensus.cc:359] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.296689 16695 raft_consensus.cc:385] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.296761 16466 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.297187 16695 raft_consensus.cc:740] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.298640 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.298367 16695 consensus_queue.cc:260] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:32.298861 16614 leader_election.cc:343] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.300935 16615 leader_election.cc:343] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.301328 16695 ts_tablet_manager.cc:1434] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:25:32.301409 16615 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.301769 16698 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.302351 16698 ts_tablet_manager.cc:1403] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:25:32.302407 16695 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.303243 16766 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.303131 16724 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.304545 16703 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.305338 16698 raft_consensus.cc:359] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.306102 16698 raft_consensus.cc:385] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.306392 16698 raft_consensus.cc:740] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.306558 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.307317 16424 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.301414 16699 raft_consensus.cc:359] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.307334 16698 consensus_queue.cc:260] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.308355 16724 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.309324 16695 tablet_bootstrap.cc:654] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.309748 16698 ts_tablet_manager.cc:1434] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:32.310843 16698 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.306558 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:32.314481 16466 leader_election.cc:343] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.308017 16699 raft_consensus.cc:385] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.316793 16699 raft_consensus.cc:740] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.317749 16699 consensus_queue.cc:260] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.320148 16699 ts_tablet_manager.cc:1434] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.003s
I20260709 12:25:32.321205 16699 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.327872 16698 tablet_bootstrap.cc:654] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.329535 16699 tablet_bootstrap.cc:654] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.279881 16758 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.337474 16695 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.338162 16695 ts_tablet_manager.cc:1403] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.008s
I20260709 12:25:32.340718 16694 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.348552 16704 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.349900 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.351591 16424 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
W20260709 12:25:32.352376 16540 leader_election.cc:343] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.355227 16703 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.341743 16732 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.357402 16319 catalog_manager.cc:5697] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.361222 16465 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:32.368580 16766 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.362901 16732 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.364346 16724 raft_consensus.cc:2804] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.370587 16724 raft_consensus.cc:697] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:32.371567 16724 consensus_queue.cc:237] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.371997 16732 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.362243 16703 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.375928 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.376150 16703 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.360010 16758 raft_consensus.cc:697] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:32.377346 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:32.377671 16615 leader_election.cc:343] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.377321 16758 consensus_queue.cc:237] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.377806 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.378257 16425 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:32.378760 16648 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:32.379964 16694 tablet_bootstrap.cc:654] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.380082 16614 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.381814 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.382570 16424 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:32.382854 16541 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:32.378688 16695 raft_consensus.cc:359] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.383893 16695 raft_consensus.cc:385] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.384202 16695 raft_consensus.cc:740] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.385860 16732 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.386262 16732 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.386670 16732 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.386427 16695 consensus_queue.cc:260] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.389505 16695 ts_tablet_manager.cc:1434] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 12:25:32.390796 16695 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.385527 16703 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.391448 16703 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.392587 16703 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.393187 16784 raft_consensus.cc:493] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.393221 16704 consensus_queue.cc:1048] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.395167 16784 raft_consensus.cc:515] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.394596 16699 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:32.400667 16699 ts_tablet_manager.cc:1403] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.006s
I20260709 12:25:32.402794 16732 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.405036 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.405174 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.405843 16424 raft_consensus.cc:2468] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
W20260709 12:25:32.406701 16540 leader_election.cc:343] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.412657 16699 raft_consensus.cc:359] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.413038 16540 leader_election.cc:304] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:32.413481 16699 raft_consensus.cc:385] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.413818 16699 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.414795 16704 raft_consensus.cc:2804] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.414664 16699 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.411759 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:32.416263 16649 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.417695 16694 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:32.418205 16694 ts_tablet_manager.cc:1403] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.005s
I20260709 12:25:32.415184 16704 raft_consensus.cc:493] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.413067 16698 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.423833 16698 ts_tablet_manager.cc:1403] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.015s
I20260709 12:25:32.410866 16732 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.417973 16320 catalog_manager.cc:5697] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.424428 16704 raft_consensus.cc:3060] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.435006 16699 ts_tablet_manager.cc:1434] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:25:32.436096 16699 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.439778 16695 tablet_bootstrap.cc:654] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.428575 16322 catalog_manager.cc:5697] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.424331 16784 leader_election.cc:290] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.431731 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.431701 16732 consensus_queue.cc:1048] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:25:32.449326 16424 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.450088 16703 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.429258 16698 raft_consensus.cc:359] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.448866 16694 raft_consensus.cc:359] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.451581 16698 raft_consensus.cc:385] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.451807 16694 raft_consensus.cc:385] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.445592 16649 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:32.452113 16698 raft_consensus.cc:740] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.453702 16698 consensus_queue.cc:260] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.452216 16694 raft_consensus.cc:740] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.461064 16724 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.461615 16724 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.463792 16724 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.465759 16694 consensus_queue.cc:260] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.468919 16703 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.471016 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.468860 16541 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:32.471951 16423 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.473539 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.474185 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:25:32.475026 16466 leader_election.cc:343] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.475649 16615 leader_election.cc:343] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.475767 16732 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.476682 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.477335 16649 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:32.478571 16466 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.479417 16724 raft_consensus.cc:2804] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.479797 16724 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.480206 16724 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.479929 16732 raft_consensus.cc:697] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:32.493784 16700 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.494516 16424 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:32.504365 16700 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.506534 16700 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.508232 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.509011 16574 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:32.509814 16694 ts_tablet_manager.cc:1434] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 12:25:32.510035 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.510648 16499 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:32.510905 16694 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.512058 16390 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.512889 16700 raft_consensus.cc:2804] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.513293 16700 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.513645 16700 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.500388 16423 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.514955 16614 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.516304 16793 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.458381 16704 raft_consensus.cc:515] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.516830 16793 raft_consensus.cc:697] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:32.517727 16793 consensus_queue.cc:237] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.518543 16704 leader_election.cc:290] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.523722 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.496778 16703 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.508046 16732 consensus_queue.cc:237] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.503367 16724 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:32.536515 16540 leader_election.cc:343] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.536892 16695 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.537492 16695 ts_tablet_manager.cc:1403] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.002s
I20260709 12:25:32.540266 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.540940 16424 raft_consensus.cc:3060] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.532796 16700 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.547019 16798 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.547487 16798 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.548144 16695 raft_consensus.cc:359] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.549131 16700 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.549202 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.548874 16695 raft_consensus.cc:385] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.549815 16700 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.550206 16798 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.550463 16700 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.550964 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.549350 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:32.552191 16699 tablet_bootstrap.cc:654] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.551508 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.552480 16574 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.553000 16500 raft_consensus.cc:2468] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:32.550117 16499 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.537525 16792 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.554754 16390 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.554615 16792 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.558005 16792 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.532335 16703 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.559453 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.560738 16649 raft_consensus.cc:2468] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:32.562579 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:25:32.563287 16614 leader_election.cc:343] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.564661 16466 leader_election.cc:343] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.565359 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.565819 16703 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.566114 16423 raft_consensus.cc:2468] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:32.567149 16724 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.568347 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:32.569017 16649 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.569484 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.570168 16423 raft_consensus.cc:2468] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:32.571130 16614 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:32.568396 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.550235 16695 raft_consensus.cc:740] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.573843 16695 consensus_queue.cc:260] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.577555 16798 raft_consensus.cc:2804] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.578006 16798 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.576982 16703 raft_consensus.cc:2804] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:32.591483 16540 consensus_peers.cc:597] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.590561 16574 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:32.577067 16500 raft_consensus.cc:2468] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:32.596698 16614 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.598116 16695 ts_tablet_manager.cc:1434] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:25:32.601204 16694 tablet_bootstrap.cc:654] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.601666 16695 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.605553 16792 raft_consensus.cc:2804] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.605999 16792 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.599202 16703 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.606350 16792 raft_consensus.cc:3060] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.606711 16703 raft_consensus.cc:3060] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.598877 16798 raft_consensus.cc:3060] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.614140 16698 ts_tablet_manager.cc:1434] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.190s	user 0.017s	sys 0.031s
I20260709 12:25:32.615186 16698 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.614454 16649 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:32.613709 16391 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:32.624933 16466 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.625778 16724 raft_consensus.cc:2804] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.626322 16724 raft_consensus.cc:697] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:32.626485 16700 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.627188 16724 consensus_queue.cc:237] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.630067 16792 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.625403 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.631340 16498 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:32.631691 16390 leader_election.cc:343] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.633241 16698 tablet_bootstrap.cc:654] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.619228 16499 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:32.632273 16792 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:32.636801 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.637470 16499 raft_consensus.cc:3060] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.640620 16700 raft_consensus.cc:2804] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.647241 16424 raft_consensus.cc:2468] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:32.648124 16704 consensus_queue.cc:1048] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.650367 16695 tablet_bootstrap.cc:654] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.650723 16758 consensus_queue.cc:1048] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.649551 16699 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:32.652437 16699 ts_tablet_manager.cc:1403] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.217s	user 0.028s	sys 0.010s
I20260709 12:25:32.652824 16540 leader_election.cc:304] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:32.654546 16758 raft_consensus.cc:2804] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.655061 16758 raft_consensus.cc:697] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:32.655966 16758 consensus_queue.cc:237] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.675091 16322 catalog_manager.cc:5697] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.668890 16724 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.679419 16800 raft_consensus.cc:493] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.680095 16800 raft_consensus.cc:515] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.657701 16700 raft_consensus.cc:697] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:32.683276 16699 raft_consensus.cc:359] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.685635 16699 raft_consensus.cc:385] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.686003 16699 raft_consensus.cc:740] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.691345 16699 consensus_queue.cc:260] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:32.693815 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 82712.8us
I20260709 12:25:32.695029 16700 consensus_queue.cc:237] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.695696 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.688746 16319 catalog_manager.cc:5697] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.702543 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:32.677764 16724 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:32.707154 16699 ts_tablet_manager.cc:1434] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 12:25:32.709375 16699 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.711598 16320 catalog_manager.cc:5697] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.714193 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.705245 16800 leader_election.cc:290] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
W20260709 12:25:32.717733 16390 leader_election.cc:343] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.735304 16694 tablet_bootstrap.cc:492] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:32.735954 16694 ts_tablet_manager.cc:1403] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.225s	user 0.032s	sys 0.016s
I20260709 12:25:32.756142 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.767379 16699 tablet_bootstrap.cc:654] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.769923 16724 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.771749 16499 raft_consensus.cc:2468] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.772125 16758 consensus_queue.cc:1048] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.773036 16614 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:32.774097 16799 raft_consensus.cc:2804] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.774596 16799 raft_consensus.cc:697] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:32.774627 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.774966 16703 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.775625 16799 consensus_queue.cc:237] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.776968 16694 raft_consensus.cc:359] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.777691 16694 raft_consensus.cc:385] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.777944 16694 raft_consensus.cc:740] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.778311 16698 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:32.778832 16698 ts_tablet_manager.cc:1403] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.016s
I20260709 12:25:32.778955 16694 consensus_queue.cc:260] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:32.758348 16391 leader_election.cc:343] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.763181 16798 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.790494 16798 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:32.793040 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.794234 16499 raft_consensus.cc:2393] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:32.795457 16423 raft_consensus.cc:2393] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
I20260709 12:25:32.801433 16391 leader_election.cc:304] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
W20260709 12:25:32.802795 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 45420us
W20260709 12:25:32.804041 16391 leader_election.cc:343] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.806213 16798 raft_consensus.cc:2749] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.809033 16694 ts_tablet_manager.cc:1434] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.002s
I20260709 12:25:32.810554 16694 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.822389 16698 raft_consensus.cc:359] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.827234 16698 raft_consensus.cc:385] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.828187 16698 raft_consensus.cc:740] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.835139 16695 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:32.835901 16695 ts_tablet_manager.cc:1403] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.234s	user 0.012s	sys 0.019s
I20260709 12:25:32.805089 16391 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:32.838274 16698 consensus_queue.cc:260] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.843310 16700 raft_consensus.cc:2749] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.850247 16792 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.851886 16792 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.854482 16792 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.855089 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.855789 16499 raft_consensus.cc:3060] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:32.855948 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:32.856812 16698 ts_tablet_manager.cc:1434] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.003s
I20260709 12:25:32.857811 16695 raft_consensus.cc:359] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.858644 16695 raft_consensus.cc:385] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.861147 16695 raft_consensus.cc:740] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.861976 16695 consensus_queue.cc:260] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.863579 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.860426 16694 tablet_bootstrap.cc:654] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.869100 16699 tablet_bootstrap.cc:492] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:32.869860 16699 ts_tablet_manager.cc:1403] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.161s	user 0.017s	sys 0.052s
W20260709 12:25:32.850301 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 46080.1us
I20260709 12:25:32.871614 16322 catalog_manager.cc:5697] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.874148 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:32.875150 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.885854 16424 raft_consensus.cc:2393] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 1: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:32.876420 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:32.887790 16698 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:32.848912 16703 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:32.880014 16695 ts_tablet_manager.cc:1434] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:25:32.873929 16699 raft_consensus.cc:359] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.894690 16699 raft_consensus.cc:385] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.895107 16699 raft_consensus.cc:740] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.881024 16499 raft_consensus.cc:2468] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.882488 16758 consensus_queue.cc:1048] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.883049 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:32.895179 16695 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:32.896175 16699 consensus_queue.cc:260] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.898303 16423 raft_consensus.cc:3060] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.900079 16614 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:32.901101 16465 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:32.902103 16391 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:32.903635 16724 raft_consensus.cc:2749] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:32.904273 16703 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.904593 16798 raft_consensus.cc:2749] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.904960 16614 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:32.909713 16799 raft_consensus.cc:2804] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:32.910128 16540 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.910444 16799 raft_consensus.cc:697] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:32.911674 16799 consensus_queue.cc:237] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:32.909678 16699 ts_tablet_manager.cc:1434] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 12:25:32.917914 16699 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:32.907574 16698 tablet_bootstrap.cc:654] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.907382 16321 catalog_manager.cc:5697] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.907950 16724 consensus_queue.cc:1048] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.931871 16703 raft_consensus.cc:2749] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.924880 16423 raft_consensus.cc:2468] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.934742 16695 tablet_bootstrap.cc:654] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.934531 16724 consensus_queue.cc:1048] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.937722 16792 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.938248 16792 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.941759 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:32.941910 16792 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:32.942654 16500 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.944226 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:32.944334 16614 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:32.945228 16574 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:32.950678 16792 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:32.951367 16792 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.951877 16792 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.952368 16694 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:32.952859 16694 ts_tablet_manager.cc:1403] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.143s	user 0.035s	sys 0.028s
I20260709 12:25:32.955009 16694 raft_consensus.cc:359] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.955518 16694 raft_consensus.cc:385] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.955740 16694 raft_consensus.cc:740] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.956329 16694 consensus_queue.cc:260] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:32.957996 16694 ts_tablet_manager.cc:1434] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:32.958381 16574 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.958779 16694 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:32.961166 16699 tablet_bootstrap.cc:654] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.974323 16694 tablet_bootstrap.cc:654] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.975436 16320 catalog_manager.cc:5697] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.985037 16500 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.994350 16792 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:32.998622 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:32.999608 16497 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.006830 16799 consensus_queue.cc:1048] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.015059 16703 consensus_queue.cc:1048] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.017016 16698 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.017617 16698 ts_tablet_manager.cc:1403] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.009s
I20260709 12:25:33.019596 16704 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.020136 16704 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.020586 16698 raft_consensus.cc:359] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.021450 16698 raft_consensus.cc:385] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.021736 16698 raft_consensus.cc:740] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.022361 16704 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:33.025550 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:33.026429 16648 raft_consensus.cc:2393] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:33.025617 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.027539 16695 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.028012 16695 ts_tablet_manager.cc:1403] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.017s
I20260709 12:25:33.031323 16695 raft_consensus.cc:359] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.032240 16695 raft_consensus.cc:385] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.032596 16695 raft_consensus.cc:740] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.039541 16695 consensus_queue.cc:260] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.041213 16698 consensus_queue.cc:260] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.033869 16497 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:33.040614 16540 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:33.045433 16614 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:33.048169 16704 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.049198 16703 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.049824 16703 raft_consensus.cc:697] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:33.048942 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.050709 16698 ts_tablet_manager.cc:1434] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:25:33.052116 16575 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.049707 16792 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.053597 16698 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.055303 16694 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:33.055958 16694 ts_tablet_manager.cc:1403] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 12:25:33.059852 16703 consensus_queue.cc:237] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.071509 16784 consensus_queue.cc:1048] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.076210 16695 ts_tablet_manager.cc:1434] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.005s
I20260709 12:25:33.078334 16695 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.081496 16694 raft_consensus.cc:359] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.082531 16694 raft_consensus.cc:385] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.083010 16694 raft_consensus.cc:740] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.086344 16694 consensus_queue.cc:260] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.088436 16694 ts_tablet_manager.cc:1434] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
I20260709 12:25:33.089696 16694 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:33.092016 16321 catalog_manager.cc:5697] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.105003 16699 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.105551 16699 ts_tablet_manager.cc:1403] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.188s	user 0.028s	sys 0.027s
W20260709 12:25:33.106797 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:33.110183 16575 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:33.111099 16698 tablet_bootstrap.cc:654] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.108364 16699 raft_consensus.cc:359] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.112879 16699 raft_consensus.cc:385] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.113212 16699 raft_consensus.cc:740] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.114499 16699 consensus_queue.cc:260] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.116555 16699 ts_tablet_manager.cc:1434] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:25:33.120271 16732 raft_consensus.cc:493] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.120890 16699 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.121322 16732 raft_consensus.cc:515] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.140260 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:33.141166 16422 raft_consensus.cc:2468] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:33.142100 16699 tablet_bootstrap.cc:654] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.145428 16540 leader_election.cc:304] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:33.146845 16758 raft_consensus.cc:2804] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.147269 16758 raft_consensus.cc:493] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.147625 16758 raft_consensus.cc:3060] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.151010 16704 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.157626 16784 consensus_queue.cc:1048] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.159723 16695 tablet_bootstrap.cc:654] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.162384 16723 consensus_queue.cc:1048] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.169858 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.171284 16732 leader_election.cc:290] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
W20260709 12:25:33.174536 16540 leader_election.cc:343] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.180478 16699 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.176548 16758 raft_consensus.cc:515] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.182403 16699 ts_tablet_manager.cc:1403] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.008s
I20260709 12:25:33.185180 16698 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.185724 16698 ts_tablet_manager.cc:1403] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.017s
I20260709 12:25:33.185583 16699 raft_consensus.cc:359] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.186338 16699 raft_consensus.cc:385] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.186655 16699 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.187350 16699 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.189492 16699 ts_tablet_manager.cc:1434] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:33.190541 16699 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.190762 16698 raft_consensus.cc:359] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.191529 16698 raft_consensus.cc:385] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.191800 16698 raft_consensus.cc:740] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.192658 16698 consensus_queue.cc:260] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.195075 16698 ts_tablet_manager.cc:1434] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:33.197305 16699 tablet_bootstrap.cc:654] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.202440 16831 consensus_queue.cc:1048] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.211512 16698 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.211097 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:33.212656 16423 raft_consensus.cc:3060] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.211570 16322 catalog_manager.cc:5697] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.215044 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:33.178843 16694 tablet_bootstrap.cc:654] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:33.217494 16540 leader_election.cc:343] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.216895 16831 raft_consensus.cc:493] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.223757 16695 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.233798 16831 raft_consensus.cc:515] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.237061 16831 leader_election.cc:290] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.237461 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:33.238408 16424 raft_consensus.cc:2393] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:33.224174 16758 leader_election.cc:290] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:33.233031 16423 raft_consensus.cc:2468] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:33.238758 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:33.239874 16699 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.234359 16695 ts_tablet_manager.cc:1403] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.003s
I20260709 12:25:33.240437 16699 ts_tablet_manager.cc:1403] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:25:33.240882 16540 leader_election.cc:304] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.241786 16466 leader_election.cc:304] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:33.242146 16758 raft_consensus.cc:2804] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.242867 16758 raft_consensus.cc:697] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:33.243742 16758 consensus_queue.cc:237] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.245056 16724 raft_consensus.cc:3060] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.245124 16695 raft_consensus.cc:359] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.246130 16695 raft_consensus.cc:385] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.247715 16695 raft_consensus.cc:740] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.250008 16694 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:33.250576 16694 ts_tablet_manager.cc:1403] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.000s
I20260709 12:25:33.252331 16798 consensus_queue.cc:1048] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.253391 16694 raft_consensus.cc:359] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.254115 16694 raft_consensus.cc:385] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.254398 16694 raft_consensus.cc:740] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.255231 16695 consensus_queue.cc:260] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.257051 16798 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.257390 16698 tablet_bootstrap.cc:654] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.257460 16798 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.257966 16695 ts_tablet_manager.cc:1434] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:25:33.259160 16695 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.260821 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.259869 16798 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:33.261179 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:33.263926 16390 leader_election.cc:343] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.264379 16648 raft_consensus.cc:2468] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:33.266390 16391 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.267616 16798 raft_consensus.cc:2804] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.268002 16798 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.268321 16798 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.272508 16695 tablet_bootstrap.cc:654] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.261627 16694 consensus_queue.cc:260] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.275847 16694 ts_tablet_manager.cc:1434] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:25:33.276890 16694 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:33.277812 16758 consensus_queue.cc:1048] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.278177 16724 raft_consensus.cc:2749] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.280896 16699 raft_consensus.cc:359] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.282264 16699 raft_consensus.cc:385] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.282930 16699 raft_consensus.cc:740] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.285259 16798 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.283886 16699 consensus_queue.cc:260] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.288311 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:33.290472 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:33.292196 16648 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.294591 16699 ts_tablet_manager.cc:1434] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
W20260709 12:25:33.295075 16390 leader_election.cc:343] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.296002 16699 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.296573 16698 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.297120 16698 ts_tablet_manager.cc:1403] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.004s
I20260709 12:25:33.302343 16700 consensus_queue.cc:1048] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.302560 16698 raft_consensus.cc:359] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.303315 16698 raft_consensus.cc:385] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.303591 16698 raft_consensus.cc:740] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.303817 16699 tablet_bootstrap.cc:654] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.304281 16698 consensus_queue.cc:260] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.308365 16698 ts_tablet_manager.cc:1434] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:25:33.311430 16698 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.291014 16798 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:33.312548 16703 raft_consensus.cc:493] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.314920 16703 raft_consensus.cc:515] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.320205 16703 leader_election.cc:290] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:33.320670 16694 tablet_bootstrap.cc:654] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.321430 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:33.322350 16424 raft_consensus.cc:2468] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:33.329541 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.330291 16497 raft_consensus.cc:2468] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:33.330206 16614 leader_election.cc:304] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:33.332841 16695 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.333289 16695 ts_tablet_manager.cc:1403] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.002s
I20260709 12:25:33.337301 16321 catalog_manager.cc:5697] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.331874 16703 consensus_queue.cc:1048] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:25:33.345924 16703 raft_consensus.cc:2804] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.346323 16703 raft_consensus.cc:493] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.346661 16703 raft_consensus.cc:3060] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.351315 16695 raft_consensus.cc:359] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.352157 16695 raft_consensus.cc:385] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.356575 16648 raft_consensus.cc:2468] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:33.357199 16699 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.357765 16699 ts_tablet_manager.cc:1403] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.011s
I20260709 12:25:33.352412 16695 raft_consensus.cc:740] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.363386 16699 raft_consensus.cc:359] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.363619 16391 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.364169 16699 raft_consensus.cc:385] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.364588 16699 raft_consensus.cc:740] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.372457 16699 consensus_queue.cc:260] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.375656 16695 consensus_queue.cc:260] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.380980 16695 ts_tablet_manager.cc:1434] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:25:33.382779 16698 tablet_bootstrap.cc:654] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.389987 16699 ts_tablet_manager.cc:1434] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:25:33.393698 16699 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.396317 16695 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.409700 16793 consensus_queue.cc:1048] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:33.416656 16700 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.417372 16700 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.426052 16497 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.410956 16798 raft_consensus.cc:2804] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.427728 16798 raft_consensus.cc:697] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:33.429183 16694 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:33.428785 16798 consensus_queue.cc:237] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.429720 16694 ts_tablet_manager.cc:1403] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.012s
I20260709 12:25:33.434908 16694 raft_consensus.cc:359] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.435467 16694 raft_consensus.cc:385] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.435725 16694 raft_consensus.cc:740] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.436334 16694 consensus_queue.cc:260] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.434229 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.439854 16699 tablet_bootstrap.cc:654] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.439179 16703 raft_consensus.cc:515] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.443117 16698 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.443876 16698 ts_tablet_manager.cc:1403] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.134s	user 0.019s	sys 0.008s
I20260709 12:25:33.451505 16694 ts_tablet_manager.cc:1434] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
W20260709 12:25:33.455931 16390 leader_election.cc:343] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.456835 16694 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:33.444213 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 74765.7us
I20260709 12:25:33.469683 16695 tablet_bootstrap.cc:654] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.466228 16700 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.475266 16694 tablet_bootstrap.cc:654] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.479183 16498 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:33.479800 16793 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.480289 16793 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.482095 16792 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.482450 16793 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:33.484395 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:33.485703 16615 leader_election.cc:343] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.493685 16698 raft_consensus.cc:359] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.494501 16698 raft_consensus.cc:385] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.494784 16698 raft_consensus.cc:740] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.498147 16698 consensus_queue.cc:260] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.499799 16698 ts_tablet_manager.cc:1434] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:25:33.500463 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:33.501721 16698 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.511672 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:33.512979 16698 tablet_bootstrap.cc:654] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.513790 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:33.508225 16574 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:33.514424 16423 raft_consensus.cc:3060] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.518891 16793 raft_consensus.cc:493] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.521487 16793 raft_consensus.cc:515] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.523739 16793 leader_election.cc:290] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.520084 16792 consensus_queue.cc:1048] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:33.526664 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.527472 16500 raft_consensus.cc:2468] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:33.527369 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:33.533479 16614 leader_election.cc:343] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.534040 16614 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:33.534837 16615 leader_election.cc:343] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.535435 16614 leader_election.cc:304] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:33.531886 16320 catalog_manager.cc:5697] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.536769 16792 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.537547 16792 raft_consensus.cc:2804] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.537921 16792 raft_consensus.cc:493] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.538295 16792 raft_consensus.cc:3060] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.540729 16703 leader_election.cc:290] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:33.549510 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:33.553118 16784 raft_consensus.cc:493] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.554207 16784 raft_consensus.cc:515] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.557129 16784 leader_election.cc:290] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:33.557992 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.551494 16850 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.559490 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:33.560027 16540 leader_election.cc:343] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.559458 16850 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.551548 16499 raft_consensus.cc:3060] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.556394 16694 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:33.561923 16694 ts_tablet_manager.cc:1403] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.004s
I20260709 12:25:33.550765 16703 consensus_queue.cc:1048] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 12:25:33.564318 16541 leader_election.cc:343] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.567922 16541 leader_election.cc:304] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:33.551530 16423 raft_consensus.cc:2468] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:33.570554 16704 raft_consensus.cc:2749] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.571874 16850 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:33.573568 16391 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.575551 16850 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.575948 16850 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.576315 16850 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.606712 16614 leader_election.cc:304] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:33.608469 16793 raft_consensus.cc:2804] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.609042 16793 raft_consensus.cc:697] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:33.609947 16793 consensus_queue.cc:237] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.625602 16694 raft_consensus.cc:359] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.629788 16694 raft_consensus.cc:385] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.630151 16694 raft_consensus.cc:740] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.632220 16694 consensus_queue.cc:260] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.634745 16698 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.660514 16499 raft_consensus.cc:2468] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:33.660760 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:33.638500 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:33.660060 16695 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.635674 16694 ts_tablet_manager.cc:1434] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 12:25:33.671692 16695 ts_tablet_manager.cc:1403] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.278s	user 0.011s	sys 0.036s
I20260709 12:25:33.669613 16698 ts_tablet_manager.cc:1403] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.168s	user 0.003s	sys 0.054s
I20260709 12:25:33.655612 16699 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.672652 16694 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:33.673327 16699 ts_tablet_manager.cc:1403] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.282s	user 0.008s	sys 0.010s
I20260709 12:25:33.670975 16648 raft_consensus.cc:2468] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:33.680537 16699 raft_consensus.cc:359] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.681555 16699 raft_consensus.cc:385] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.681790 16699 raft_consensus.cc:740] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.684482 16699 consensus_queue.cc:260] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.628386 16792 raft_consensus.cc:515] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.693392 16698 raft_consensus.cc:359] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.694191 16698 raft_consensus.cc:385] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.694460 16698 raft_consensus.cc:740] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.699776 16699 ts_tablet_manager.cc:1434] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:25:33.701426 16699 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.702710 16698 consensus_queue.cc:260] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.706830 16698 ts_tablet_manager.cc:1434] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:25:33.708428 16698 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.708197 16695 raft_consensus.cc:359] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:33.687780 16391 leader_election.cc:343] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.708948 16695 raft_consensus.cc:385] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.712908 16695 raft_consensus.cc:740] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.687027 16850 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.716364 16695 consensus_queue.cc:260] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.719010 16574 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:33.720594 16695 ts_tablet_manager.cc:1434] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:25:33.721761 16695 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.722313 16391 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:33.723263 16854 raft_consensus.cc:2804] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.723644 16854 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.724014 16854 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.727499 16694 tablet_bootstrap.cc:654] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.727789 16695 tablet_bootstrap.cc:654] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.735423 16792 leader_election.cc:290] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.736244 16799 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.736824 16799 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.743717 16850 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.745003 16799 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.747674 16321 catalog_manager.cc:5697] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.741451 16792 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:25:33.754587 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.755393 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:33.755542 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:33.767189 16390 leader_election.cc:343] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:33.759189 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:33.768311 16615 leader_election.cc:343] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.770347 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:33.777411 16500 raft_consensus.cc:3060] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.766592 16573 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:33.773399 16698 tablet_bootstrap.cc:654] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.773200 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:33.758373 16699 tablet_bootstrap.cc:654] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.764669 16854 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.786870 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.787501 16573 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.791024 16854 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:33.797896 16695 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.798708 16695 ts_tablet_manager.cc:1403] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.033s
I20260709 12:25:33.807677 16615 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:33.808619 16799 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.809038 16799 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.809388 16799 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.814560 16854 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.816529 16854 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.813597 16500 raft_consensus.cc:2468] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:33.822806 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.817836 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:33.824074 16649 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.824337 16854 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:33.835777 16698 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:33.836002 16649 raft_consensus.cc:2468] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:33.836441 16698 ts_tablet_manager.cc:1403] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.003s
W20260709 12:25:33.820333 16614 leader_election.cc:343] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.839442 16698 raft_consensus.cc:359] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:33.839820 16391 leader_election.cc:343] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.840075 16695 raft_consensus.cc:359] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.847254 16695 raft_consensus.cc:385] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.847530 16695 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.848989 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:33.849749 16648 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:33.850565 16695 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.852890 16695 ts_tablet_manager.cc:1434] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
I20260709 12:25:33.853868 16695 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.854668 16799 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.857121 16573 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:33.841640 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:33.846489 16614 leader_election.cc:304] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:33.859046 16694 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:33.859652 16694 ts_tablet_manager.cc:1403] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.005s
I20260709 12:25:33.860891 16391 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:33.843827 16732 consensus_queue.cc:1048] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:25:33.864936 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:25:33.866240 16614 leader_election.cc:343] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.868557 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.869185 16575 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.871243 16799 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:33.861922 16695 tablet_bootstrap.cc:654] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.840173 16698 raft_consensus.cc:385] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.874493 16698 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.862150 16792 raft_consensus.cc:2804] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.862679 16694 raft_consensus.cc:359] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.863286 16391 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:33.863983 16854 raft_consensus.cc:2804] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.876734 16850 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.877133 16850 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.877466 16850 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.878398 16575 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:33.879637 16615 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.880822 16799 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.882094 16391 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:33.883147 16851 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.880769 16854 raft_consensus.cc:697] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:33.881551 16799 raft_consensus.cc:697] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:33.875464 16792 raft_consensus.cc:697] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
W20260709 12:25:33.883358 16391 leader_election.cc:343] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.883759 16851 raft_consensus.cc:697] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:33.884370 16854 consensus_queue.cc:237] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.888825 16851 consensus_queue.cc:237] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:33.885133 16799 consensus_queue.cc:237] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.892803 16700 consensus_queue.cc:1048] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.886350 16699 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:33.893705 16699 ts_tablet_manager.cc:1403] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.001s
W20260709 12:25:33.894285 16390 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:33.875466 16698 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.896590 16699 raft_consensus.cc:359] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.900461 16699 raft_consensus.cc:385] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.900892 16699 raft_consensus.cc:740] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.901288 16698 ts_tablet_manager.cc:1434] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 12:25:33.902381 16699 consensus_queue.cc:260] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.887697 16792 consensus_queue.cc:237] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:33.887169 16850 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.905222 16694 raft_consensus.cc:385] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.907966 16694 raft_consensus.cc:740] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.906113 16695 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:33.909031 16695 ts_tablet_manager.cc:1403] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.001s
I20260709 12:25:33.909612 16694 consensus_queue.cc:260] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:33.911770 16699 ts_tablet_manager.cc:1434] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:33.919709 16699 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:33.913235 16695 raft_consensus.cc:359] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.915390 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:33.927750 16649 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.927994 16695 raft_consensus.cc:385] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.928534 16695 raft_consensus.cc:740] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.929808 16695 consensus_queue.cc:260] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.934756 16698 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:33.918085 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:33.913501 16850 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:33.938191 16391 leader_election.cc:343] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.939433 16649 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:33.940080 16695 ts_tablet_manager.cc:1434] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:25:33.942271 16695 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:33.946411 16698 tablet_bootstrap.cc:654] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.953683 16699 tablet_bootstrap.cc:654] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.954226 16320 catalog_manager.cc:5697] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.953897 16321 catalog_manager.cc:5697] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.957340 16391 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:33.958328 16854 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.956550 16320 catalog_manager.cc:5697] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.962239 16724 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.962787 16724 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:33.940212 16694 ts_tablet_manager.cc:1434] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 12:25:33.964668 16694 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:33.965670 16724 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:33.967490 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:33.969276 16466 leader_election.cc:343] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.971678 16695 tablet_bootstrap.cc:654] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.971988 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:33.973963 16465 leader_election.cc:343] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.974675 16465 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:33.976468 16724 raft_consensus.cc:2749] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.978034 16694 tablet_bootstrap.cc:654] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.979050 16854 raft_consensus.cc:697] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:33.980003 16854 consensus_queue.cc:237] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:33.981223 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:34.000067 16698 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.000828 16698 ts_tablet_manager.cc:1403] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.008s
I20260709 12:25:34.010015 16698 raft_consensus.cc:359] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.011042 16698 raft_consensus.cc:385] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.011394 16698 raft_consensus.cc:740] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.012359 16698 consensus_queue.cc:260] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.015352 16698 ts_tablet_manager.cc:1434] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:34.021117 16698 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:34.035416 16321 catalog_manager.cc:5697] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.037096 16698 tablet_bootstrap.cc:654] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.079525 16695 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:34.080116 16695 ts_tablet_manager.cc:1403] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.138s	user 0.029s	sys 0.043s
I20260709 12:25:34.080335 16698 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.080881 16698 ts_tablet_manager.cc:1403] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.001s
I20260709 12:25:34.083189 16695 raft_consensus.cc:359] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.083585 16698 raft_consensus.cc:359] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.084061 16695 raft_consensus.cc:385] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.084268 16698 raft_consensus.cc:385] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.084546 16695 raft_consensus.cc:740] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.084580 16698 raft_consensus.cc:740] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.085500 16695 consensus_queue.cc:260] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.087816 16695 ts_tablet_manager.cc:1434] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:25:34.089213 16695 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:34.085510 16698 consensus_queue.cc:260] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.097632 16320 catalog_manager.cc:5697] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.100489 16698 ts_tablet_manager.cc:1434] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:25:34.101900 16698 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:34.108179 16694 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:34.108842 16694 ts_tablet_manager.cc:1403] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.144s	user 0.024s	sys 0.030s
I20260709 12:25:34.108166 16699 tablet_bootstrap.cc:492] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:34.109511 16695 tablet_bootstrap.cc:654] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.109687 16699 ts_tablet_manager.cc:1403] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.190s	user 0.043s	sys 0.023s
I20260709 12:25:34.112030 16694 raft_consensus.cc:359] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.112872 16694 raft_consensus.cc:385] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.113220 16694 raft_consensus.cc:740] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.113497 16698 tablet_bootstrap.cc:654] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.114009 16694 consensus_queue.cc:260] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.115787 16784 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.115877 16699 raft_consensus.cc:359] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.116829 16699 raft_consensus.cc:385] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.117157 16699 raft_consensus.cc:740] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.116293 16694 ts_tablet_manager.cc:1434] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:34.108392 16799 consensus_queue.cc:1048] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.120287 16724 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.123503 16724 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.116431 16784 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.129617 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:34.130584 16422 raft_consensus.cc:2468] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:34.129664 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:34.133476 16649 raft_consensus.cc:2393] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
I20260709 12:25:34.135974 16465 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:34.137354 16723 raft_consensus.cc:2804] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.135381 16784 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:34.138105 16798 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.138737 16798 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.137869 16723 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.140471 16723 raft_consensus.cc:3060] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.142593 16798 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:34.145119 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.146016 16499 raft_consensus.cc:2468] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:34.147673 16390 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:34.150071 16698 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.149991 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:34.150710 16698 ts_tablet_manager.cc:1403] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.011s
I20260709 12:25:34.151664 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:34.151911 16540 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:34.153738 16391 leader_election.cc:343] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.154042 16784 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.157029 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.158000 16575 raft_consensus.cc:2468] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:34.153820 16698 raft_consensus.cc:359] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.159682 16698 raft_consensus.cc:385] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.160005 16698 raft_consensus.cc:740] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.160362 16724 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.160938 16798 raft_consensus.cc:2804] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.161935 16798 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.162365 16798 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.164503 16698 consensus_queue.cc:260] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.168087 16698 ts_tablet_manager.cc:1434] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:25:34.169165 16698 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:34.170143 16784 raft_consensus.cc:2749] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.180565 16698 tablet_bootstrap.cc:654] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.118304 16699 consensus_queue.cc:260] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.184499 16699 ts_tablet_manager.cc:1434] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:25:34.187812 16699 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:34.192039 16694 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:34.198103 16695 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:34.203706 16695 ts_tablet_manager.cc:1403] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.115s	user 0.030s	sys 0.020s
I20260709 12:25:34.206631 16695 raft_consensus.cc:359] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.207463 16695 raft_consensus.cc:385] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.207744 16695 raft_consensus.cc:740] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.208581 16695 consensus_queue.cc:260] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.210872 16695 ts_tablet_manager.cc:1434] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:34.211863 16695 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:34.212356 16854 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.212903 16854 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.215097 16854 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.218173 16699 tablet_bootstrap.cc:654] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.219556 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.223131 16695 tablet_bootstrap.cc:654] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:34.223771 16391 leader_election.cc:343] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.227176 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.227370 16792 consensus_queue.cc:1048] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:34.229472 16390 leader_election.cc:343] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.230247 16390 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:34.231600 16700 raft_consensus.cc:2749] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.205924 16723 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.246428 16798 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.248142 16723 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.257000 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:34.257771 16575 raft_consensus.cc:3060] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.259372 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:34.265620 16422 raft_consensus.cc:3060] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.269804 16694 tablet_bootstrap.cc:654] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.283121 16699 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:34.283713 16699 ts_tablet_manager.cc:1403] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.004s
I20260709 12:25:34.286734 16695 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:34.287308 16695 ts_tablet_manager.cc:1403] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.005s
I20260709 12:25:34.289851 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:34.290242 16695 raft_consensus.cc:359] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.291049 16695 raft_consensus.cc:385] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.291328 16695 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.292034 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:34.293123 16499 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.294301 16575 raft_consensus.cc:2468] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:34.294474 16699 raft_consensus.cc:359] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.295164 16699 raft_consensus.cc:385] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.295457 16699 raft_consensus.cc:740] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.295593 16466 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:34.296173 16699 consensus_queue.cc:260] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.296475 16798 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:34.296973 16723 raft_consensus.cc:2804] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.297765 16723 raft_consensus.cc:697] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:34.298851 16699 ts_tablet_manager.cc:1434] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:34.298770 16723 consensus_queue.cc:237] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.299921 16699 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:34.300102 16422 raft_consensus.cc:2468] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:34.292021 16695 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:34.300983 16391 leader_election.cc:343] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.304015 16724 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.305356 16695 ts_tablet_manager.cc:1434] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:25:34.306313 16695 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:34.304495 16724 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.309608 16724 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:34.314107 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:34.315249 16499 raft_consensus.cc:2468] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:34.317036 16390 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:34.318964 16700 raft_consensus.cc:2804] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.319562 16700 raft_consensus.cc:697] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
W20260709 12:25:34.321322 16390 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:34.320530 16700 consensus_queue.cc:237] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.322536 16699 tablet_bootstrap.cc:654] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.320819 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.325835 16575 raft_consensus.cc:2393] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:34.327471 16466 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:34.329175 16724 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.335227 16698 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.335834 16698 ts_tablet_manager.cc:1403] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.167s	user 0.025s	sys 0.025s
I20260709 12:25:34.337715 16694 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:34.338551 16694 ts_tablet_manager.cc:1403] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.000s
I20260709 12:25:34.341912 16698 raft_consensus.cc:359] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.342775 16698 raft_consensus.cc:385] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.343084 16698 raft_consensus.cc:740] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.344027 16698 consensus_queue.cc:260] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.348719 16798 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.349325 16798 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.353904 16861 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.354544 16861 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.357151 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.359465 16694 raft_consensus.cc:359] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.360287 16694 raft_consensus.cc:385] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.361212 16861 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:34.361258 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.365731 16724 raft_consensus.cc:2749] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.366050 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:34.360575 16694 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.367296 16694 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:34.367751 16614 leader_election.cc:343] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.369691 16694 ts_tablet_manager.cc:1434] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:25:34.370850 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.371750 16574 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:34.373260 16615 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:34.373652 16390 leader_election.cc:343] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.374606 16861 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.374821 16854 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.375077 16861 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.375584 16861 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.375597 16854 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.379204 16854 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:34.380322 16724 raft_consensus.cc:493] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.384712 16724 raft_consensus.cc:515] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:25:34.385264 16615 consensus_peers.cc:597] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:34.386384 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.387132 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:34.386415 16792 raft_consensus.cc:493] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.387893 16649 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:34.387992 16792 raft_consensus.cc:515] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.389091 16724 leader_election.cc:290] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.392851 16792 leader_election.cc:290] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.393018 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.395632 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.396489 16574 raft_consensus.cc:2468] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
W20260709 12:25:34.397105 16390 leader_election.cc:343] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.405889 16694 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:34.407243 16698 ts_tablet_manager.cc:1434] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.003s
I20260709 12:25:34.411748 16698 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:34.406970 16870 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:34.405710 16391 leader_election.cc:343] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.405944 16798 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.413295 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.414086 16615 leader_election.cc:304] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:34.427518 16861 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.429751 16799 raft_consensus.cc:2804] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.430292 16699 tablet_bootstrap.cc:492] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:34.430912 16699 ts_tablet_manager.cc:1403] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.131s	user 0.046s	sys 0.028s
I20260709 12:25:34.431031 16861 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:34.430233 16799 raft_consensus.cc:493] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.433226 16799 raft_consensus.cc:3060] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.423044 16870 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.424022 16391 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:34.438431 16854 raft_consensus.cc:2749] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.439985 16694 tablet_bootstrap.cc:654] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.440997 16320 catalog_manager.cc:5697] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.445508 16699 raft_consensus.cc:359] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.446316 16699 raft_consensus.cc:385] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.446619 16699 raft_consensus.cc:740] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.447466 16699 consensus_queue.cc:260] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:34.444005 16614 leader_election.cc:343] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.449945 16699 ts_tablet_manager.cc:1434] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:25:34.451064 16699 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
W20260709 12:25:34.444276 16896 log.cc:927] Time spent T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:25:34.460726 16792 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.462088 16321 catalog_manager.cc:5697] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.464097 16695 tablet_bootstrap.cc:654] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.465831 16870 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.466557 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.467803 16699 tablet_bootstrap.cc:654] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:34.468791 16614 leader_election.cc:343] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.474299 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:34.477694 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:34.502812 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 93422.2us
I20260709 12:25:34.505721 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:34.506356 16574 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.500999 16391 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:34.519331 16574 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:34.526523 16700 consensus_queue.cc:1048] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:34.527442 16614 leader_election.cc:343] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.525434 16854 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.529505 16854 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.529202 16465 leader_election.cc:304] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:34.529947 16854 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.530993 16723 raft_consensus.cc:2749] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.533522 16861 consensus_queue.cc:1048] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.548115 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.548568 16901 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.549404 16700 consensus_queue.cc:1048] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.550495 16615 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:34.551580 16698 tablet_bootstrap.cc:654] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.552533 16901 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.552484 16700 consensus_queue.cc:1048] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.552692 16854 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.553532 16901 raft_consensus.cc:697] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:34.554649 16901 consensus_queue.cc:237] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.556711 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:25:34.558514 16390 leader_election.cc:343] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.559998 16699 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:34.560750 16699 ts_tablet_manager.cc:1403] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.110s	user 0.027s	sys 0.055s
I20260709 12:25:34.561162 16854 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
W20260709 12:25:34.574542 16615 leader_election.cc:343] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.589025 16615 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:34.596812 16792 raft_consensus.cc:2749] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.596484 16699 raft_consensus.cc:359] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.597430 16699 raft_consensus.cc:385] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.597784 16699 raft_consensus.cc:740] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.600852 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:34.601208 16699 consensus_queue.cc:260] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.603018 16699 ts_tablet_manager.cc:1434] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:25:34.609354 16699 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:34.610397 16647 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.615432 16724 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.619680 16724 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.621479 16700 consensus_queue.cc:1048] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.622356 16694 tablet_bootstrap.cc:492] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:34.623054 16694 ts_tablet_manager.cc:1403] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.010s
I20260709 12:25:34.626600 16694 raft_consensus.cc:359] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.627482 16694 raft_consensus.cc:385] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.627835 16694 raft_consensus.cc:740] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.628387 16699 tablet_bootstrap.cc:654] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.565591 16799 raft_consensus.cc:515] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.630319 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:34.631841 16694 consensus_queue.cc:260] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.635216 16694 ts_tablet_manager.cc:1434] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:25:34.636803 16694 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:34.639642 16724 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.665143 16799 leader_election.cc:290] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:34.666503 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:34.667337 16575 raft_consensus.cc:3060] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.671625 16498 raft_consensus.cc:3060] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.672854 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:34.673774 16500 raft_consensus.cc:3060] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.678300 16694 tablet_bootstrap.cc:654] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.679158 16575 raft_consensus.cc:2468] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:34.682322 16615 leader_election.cc:304] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:34.683326 16799 raft_consensus.cc:2804] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.683866 16799 raft_consensus.cc:697] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:34.684768 16799 consensus_queue.cc:237] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.690975 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:34.699117 16500 raft_consensus.cc:2468] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:34.704008 16698 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.705396 16695 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:34.706087 16695 ts_tablet_manager.cc:1403] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.400s	user 0.019s	sys 0.024s
I20260709 12:25:34.707890 16698 ts_tablet_manager.cc:1403] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.296s	user 0.008s	sys 0.020s
I20260709 12:25:34.709318 16695 raft_consensus.cc:359] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.710234 16695 raft_consensus.cc:385] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.710528 16695 raft_consensus.cc:740] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.711082 16698 raft_consensus.cc:359] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.711896 16698 raft_consensus.cc:385] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.711504 16695 consensus_queue.cc:260] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.712270 16698 raft_consensus.cc:740] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.715543 16465 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:34.716401 16724 raft_consensus.cc:2749] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.722688 16698 consensus_queue.cc:260] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:34.723528 16695 ts_tablet_manager.cc:1434] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:25:34.724485 16695 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:34.728258 16647 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:34.732975 16901 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.733582 16901 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.735898 16901 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:34.745281 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:34.745311 16700 consensus_queue.cc:1048] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.746490 16499 raft_consensus.cc:2393] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
I20260709 12:25:34.745862 16391 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:34.748940 16854 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.749500 16854 raft_consensus.cc:697] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
W20260709 12:25:34.749794 16391 consensus_peers.cc:597] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:34.750523 16854 consensus_queue.cc:237] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:34.771463 16698 ts_tablet_manager.cc:1434] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:25:34.773471 16698 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:34.791169 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:34.796221 16614 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:34.797240 16792 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.797240 16724 consensus_queue.cc:1048] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.776214 16700 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.822553 16694 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:34.823387 16694 ts_tablet_manager.cc:1403] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.187s	user 0.007s	sys 0.008s
I20260709 12:25:34.805392 16700 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.855764 16574 raft_consensus.cc:3060] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.868081 16320 catalog_manager.cc:5697] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.871589 16700 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:34.872299 16724 consensus_queue.cc:1048] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.882705 16695 tablet_bootstrap.cc:654] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.883749 16694 raft_consensus.cc:359] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.887351 16699 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:34.887952 16699 ts_tablet_manager.cc:1403] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.284s	user 0.013s	sys 0.018s
I20260709 12:25:34.888005 16694 raft_consensus.cc:385] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.889307 16320 catalog_manager.cc:5697] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:34.891840 16912 log.cc:927] Time spent T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:34.899407 16792 raft_consensus.cc:2749] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:34.901305 16915 log.cc:927] Time spent T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:25:34.902285 16698 tablet_bootstrap.cc:654] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.913700 16699 raft_consensus.cc:359] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.914525 16699 raft_consensus.cc:385] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.914824 16699 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
W20260709 12:25:34.914960 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 44341us
I20260709 12:25:34.915583 16699 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:34.889328 16694 raft_consensus.cc:740] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
W20260709 12:25:34.923084 16919 log.cc:927] Time spent T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:25:34.934744 16694 consensus_queue.cc:260] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.951470 16699 ts_tablet_manager.cc:1434] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:25:34.955143 16694 ts_tablet_manager.cc:1434] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.002s
I20260709 12:25:34.956532 16694 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:34.959843 16321 catalog_manager.cc:5697] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.962343 16699 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:34.967530 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:34.959898 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 70559.5us
I20260709 12:25:34.995579 16698 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:34.996040 16698 ts_tablet_manager.cc:1403] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.223s	user 0.029s	sys 0.004s
I20260709 12:25:34.999111 16698 raft_consensus.cc:359] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:34.999811 16698 raft_consensus.cc:385] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.000248 16698 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.002190 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.002936 16496 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.999711 16853 raft_consensus.cc:493] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.009156 16853 raft_consensus.cc:515] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.010813 16853 leader_election.cc:290] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.012084 16698 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.025504 16698 ts_tablet_manager.cc:1434] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:25:35.026968 16698 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.032526 16699 tablet_bootstrap.cc:654] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.031931 16704 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:35.023432 16391 leader_election.cc:343] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.037250 16704 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:35.038726 16391 leader_election.cc:343] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.038627 16700 consensus_queue.cc:1048] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.039198 16391 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.039474 16704 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.040524 16925 raft_consensus.cc:2749] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.041115 16861 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.042667 16861 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.051556 16861 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:35.052807 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.053412 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:35.054031 16698 tablet_bootstrap.cc:654] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:35.054497 16615 leader_election.cc:343] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:35.056885 16614 leader_election.cc:343] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.063292 16614 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.074010 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.076486 16695 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:35.076761 16792 raft_consensus.cc:2749] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.077069 16695 ts_tablet_manager.cc:1403] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.353s	user 0.007s	sys 0.018s
I20260709 12:25:35.077857 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.080010 16695 raft_consensus.cc:359] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.081068 16695 raft_consensus.cc:385] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.081287 16695 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.082770 16695 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.085989 16792 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.086565 16792 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.086817 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.089489 16695 ts_tablet_manager.cc:1434] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:25:35.090945 16695 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:35.093061 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:35.094861 16615 leader_election.cc:343] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.095350 16792 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.098481 16540 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:35.099932 16704 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.103036 16694 tablet_bootstrap.cc:654] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.106348 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:35.108762 16391 leader_election.cc:343] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.116822 16572 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:35.114140 16932 log.cc:927] Time spent T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:25:35.123615 16698 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:35.124404 16698 ts_tablet_manager.cc:1403] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.007s
I20260709 12:25:35.127689 16425 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.127921 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.128715 16423 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
W20260709 12:25:35.130079 16391 leader_election.cc:343] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.130338 16792 consensus_queue.cc:1048] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.132912 16614 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.135229 16792 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.122296 16724 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.135695 16792 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.136066 16792 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.136010 16724 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.138522 16698 raft_consensus.cc:359] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.139580 16698 raft_consensus.cc:385] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.139963 16698 raft_consensus.cc:740] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.141106 16698 consensus_queue.cc:260] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.141855 16724 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:35.130620 16391 leader_election.cc:304] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.143122 16700 raft_consensus.cc:2749] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.143035 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.143949 16698 ts_tablet_manager.cc:1434] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
W20260709 12:25:35.145035 16466 leader_election.cc:343] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.145328 16698 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.152110 16792 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.168838 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.169620 16423 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:35.172299 16699 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:35.172856 16699 ts_tablet_manager.cc:1403] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.220s	user 0.029s	sys 0.025s
I20260709 12:25:35.176858 16698 tablet_bootstrap.cc:654] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.187021 16861 consensus_queue.cc:1048] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.195129 16695 tablet_bootstrap.cc:654] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.201200 16699 raft_consensus.cc:359] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.206775 16699 raft_consensus.cc:385] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.207208 16699 raft_consensus.cc:740] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.220496 16699 consensus_queue.cc:260] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.236837 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:35.244457 16465 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.245685 16831 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.246063 16831 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.246428 16831 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.248792 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:35.249509 16422 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.253630 16724 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.254184 16724 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.254832 16870 consensus_queue.cc:1048] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:35.259613 16694 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:35.256490 16724 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:35.260321 16694 ts_tablet_manager.cc:1403] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.304s	user 0.014s	sys 0.006s
W20260709 12:25:35.261005 16390 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:35.261600 16615 leader_election.cc:343] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.259696 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:35.263302 16466 leader_election.cc:343] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.266086 16799 consensus_queue.cc:1048] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.264281 16694 raft_consensus.cc:359] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.279083 16694 raft_consensus.cc:385] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.279479 16694 raft_consensus.cc:740] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.283303 16699 ts_tablet_manager.cc:1434] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 12:25:35.284495 16699 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:35.280360 16694 consensus_queue.cc:260] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.286868 16700 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.291694 16700 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.294080 16700 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.268685 16831 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.301903 16422 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:35.230644 16792 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.302814 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:25:35.304422 16466 leader_election.cc:343] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.305827 16694 ts_tablet_manager.cc:1434] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:25:35.302702 16831 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:35.306903 16694 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:35.312613 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:35.313694 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.314055 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:35.325891 16423 raft_consensus.cc:2468] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:35.328311 16425 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.343400 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.345285 16698 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:35.345844 16698 ts_tablet_manager.cc:1403] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.008s
I20260709 12:25:35.348793 16698 raft_consensus.cc:359] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.349450 16698 raft_consensus.cc:385] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.349691 16698 raft_consensus.cc:740] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.350333 16698 consensus_queue.cc:260] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:35.351722 16941 log.cc:927] Time spent T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:25:35.351965 16792 raft_consensus.cc:493] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.352680 16792 raft_consensus.cc:515] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.351735 16425 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:35.354157 16698 ts_tablet_manager.cc:1434] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:35.354871 16792 leader_election.cc:290] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.355252 16698 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.356385 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:35.359161 16615 leader_election.cc:343] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.361943 16694 tablet_bootstrap.cc:654] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.363633 16465 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.365155 16465 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.366322 16831 raft_consensus.cc:2804] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.366688 16831 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.367025 16831 raft_consensus.cc:3060] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.368804 16724 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.369335 16724 raft_consensus.cc:697] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:35.370326 16699 tablet_bootstrap.cc:654] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.370146 16724 consensus_queue.cc:237] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.384871 16614 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.385780 16695 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:35.386319 16695 ts_tablet_manager.cc:1403] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.296s	user 0.013s	sys 0.013s
I20260709 12:25:35.387202 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.387567 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.388226 16423 raft_consensus.cc:2468] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:35.386439 16792 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.389233 16792 raft_consensus.cc:697] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:35.389256 16695 raft_consensus.cc:359] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.391036 16695 raft_consensus.cc:385] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.391275 16695 raft_consensus.cc:740] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.402644 16614 leader_election.cc:304] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.403400 16694 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:35.403554 16901 raft_consensus.cc:2804] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.404002 16694 ts_tablet_manager.cc:1403] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 12:25:35.403954 16901 raft_consensus.cc:493] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.404312 16698 tablet_bootstrap.cc:654] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.404515 16901 raft_consensus.cc:3060] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.407202 16792 consensus_queue.cc:237] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.399375 16391 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.410100 16854 raft_consensus.cc:2749] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:35.411142 16700 consensus_queue.cc:1048] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:35.412966 16694 raft_consensus.cc:359] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.413700 16694 raft_consensus.cc:385] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.413985 16694 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.414670 16694 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.415947 16901 raft_consensus.cc:515] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.418145 16901 leader_election.cc:290] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.419097 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:35.423130 16694 ts_tablet_manager.cc:1434] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:25:35.423970 16694 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:35.426818 16615 leader_election.cc:343] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.426553 16319 catalog_manager.cc:5697] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.429858 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:35.430540 16423 raft_consensus.cc:3060] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.430948 16694 tablet_bootstrap.cc:654] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.417451 16831 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.442195 16695 consensus_queue.cc:260] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.444581 16695 ts_tablet_manager.cc:1434] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 12:25:35.445578 16695 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:35.447835 16928 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.448392 16928 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.450567 16928 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.451491 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:35.453833 16540 leader_election.cc:343] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.454193 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.454911 16648 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:35.456696 16541 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:35.458496 16928 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.458927 16928 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.459466 16928 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.469138 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:25:35.470989 16466 leader_election.cc:343] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.471211 16928 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.472414 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:35.474170 16425 raft_consensus.cc:3060] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.475724 16831 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:35.479692 16423 raft_consensus.cc:2468] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:35.481827 16614 leader_election.cc:304] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.482795 16799 raft_consensus.cc:2804] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.483312 16799 raft_consensus.cc:697] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:35.484181 16799 consensus_queue.cc:237] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.494131 16425 raft_consensus.cc:2468] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:35.496965 16465 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.498442 16699 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:35.499056 16699 ts_tablet_manager.cc:1403] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.215s	user 0.018s	sys 0.003s
I20260709 12:25:35.499374 16831 raft_consensus.cc:2804] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.500170 16831 raft_consensus.cc:697] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:35.502348 16699 raft_consensus.cc:359] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.502799 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:35.498452 16698 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:35.503623 16928 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.505424 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:35.506219 16540 leader_election.cc:343] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.507884 16647 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.504175 16831 consensus_queue.cc:237] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.506959 16695 tablet_bootstrap.cc:654] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.506938 16698 ts_tablet_manager.cc:1403] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.010s
I20260709 12:25:35.506330 16699 raft_consensus.cc:385] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.511984 16699 raft_consensus.cc:740] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.512770 16699 consensus_queue.cc:260] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.515492 16925 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.515902 16647 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:35.516222 16925 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.517127 16699 ts_tablet_manager.cc:1434] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:35.517373 16541 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:35.518183 16928 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.518925 16928 raft_consensus.cc:697] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:35.519806 16928 consensus_queue.cc:237] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.521375 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:35.522981 16390 leader_election.cc:343] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.523113 16925 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:35.523870 16699 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:35.526932 16698 raft_consensus.cc:359] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.530252 16695 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:35.530865 16695 ts_tablet_manager.cc:1403] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.006s
I20260709 12:25:35.533664 16695 raft_consensus.cc:359] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.534381 16695 raft_consensus.cc:385] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.534716 16695 raft_consensus.cc:740] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.535419 16695 consensus_queue.cc:260] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.537273 16319 catalog_manager.cc:5697] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.540827 16695 ts_tablet_manager.cc:1434] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:35.542987 16695 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:35.543699 16699 tablet_bootstrap.cc:654] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:35.552204 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 45981.4us
I20260709 12:25:35.527999 16698 raft_consensus.cc:385] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.555728 16698 raft_consensus.cc:740] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.565897 16698 consensus_queue.cc:260] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.569486 16698 ts_tablet_manager.cc:1434] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:25:35.557950 16695 tablet_bootstrap.cc:654] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.558260 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.572587 16698 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.573189 16647 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:35.578210 16694 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:35.579195 16694 ts_tablet_manager.cc:1403] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.042s
I20260709 12:25:35.572144 16318 catalog_manager.cc:5697] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.582695 16944 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.583235 16944 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.590062 16944 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:35.591852 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.593592 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.594506 16425 raft_consensus.cc:2393] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:35.596274 16540 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:35.597931 16944 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.591238 16391 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:35.600672 16922 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.601081 16922 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.601449 16922 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.612730 16694 raft_consensus.cc:359] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.613426 16694 raft_consensus.cc:385] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.613725 16694 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.612437 16944 raft_consensus.cc:2749] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.615552 16698 tablet_bootstrap.cc:654] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.615262 16694 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.617574 16694 ts_tablet_manager.cc:1434] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:25:35.612295 16318 catalog_manager.cc:5697] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.618497 16694 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:35.631191 16322 catalog_manager.cc:5697] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.632494 16922 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.635394 16922 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:35.637009 16699 tablet_bootstrap.cc:492] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:35.637557 16699 ts_tablet_manager.cc:1403] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.018s
I20260709 12:25:35.637635 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:35.638249 16647 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.638813 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:35.640461 16699 raft_consensus.cc:359] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:35.640969 16390 leader_election.cc:343] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.641178 16699 raft_consensus.cc:385] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.641609 16699 raft_consensus.cc:740] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.644155 16699 consensus_queue.cc:260] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.647070 16699 ts_tablet_manager.cc:1434] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:35.647205 16698 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:35.647709 16698 ts_tablet_manager.cc:1403] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.005s
I20260709 12:25:35.647329 16647 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:35.648025 16699 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:35.648993 16391 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:35.650180 16922 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.650588 16698 raft_consensus.cc:359] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.651285 16698 raft_consensus.cc:385] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.651552 16698 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.652247 16698 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.652583 16922 raft_consensus.cc:697] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:35.653709 16922 consensus_queue.cc:237] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.654843 16698 ts_tablet_manager.cc:1434] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:35.655273 16699 tablet_bootstrap.cc:654] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.656103 16698 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.668483 16694 tablet_bootstrap.cc:654] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.675448 16944 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.676223 16944 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.684177 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.685356 16425 raft_consensus.cc:2393] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:35.693461 16944 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:35.695549 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:35.697633 16540 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:35.703404 16694 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:35.700323 16695 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:35.705230 16944 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.705535 16694 ts_tablet_manager.cc:1403] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.006s
I20260709 12:25:35.705674 16695 ts_tablet_manager.cc:1403] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.006s
I20260709 12:25:35.715956 16694 raft_consensus.cc:359] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.716018 16695 raft_consensus.cc:359] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.720204 16695 raft_consensus.cc:385] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.720726 16695 raft_consensus.cc:740] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.726876 16698 tablet_bootstrap.cc:654] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.728830 16695 consensus_queue.cc:260] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.731524 16695 ts_tablet_manager.cc:1434] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:25:35.732529 16695 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:35.732652 16699 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:35.733145 16699 ts_tablet_manager.cc:1403] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.036s
I20260709 12:25:35.736769 16694 raft_consensus.cc:385] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.737130 16694 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.737820 16694 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.737898 16699 raft_consensus.cc:359] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.739962 16699 raft_consensus.cc:385] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.740347 16699 raft_consensus.cc:740] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.741340 16699 consensus_queue.cc:260] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.744349 16699 ts_tablet_manager.cc:1434] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:35.756191 16699 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:35.747256 16694 ts_tablet_manager.cc:1434] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:25:35.758276 16694 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:35.766633 16694 tablet_bootstrap.cc:654] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.752398 16695 tablet_bootstrap.cc:654] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.776361 16321 catalog_manager.cc:5697] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.779724 16699 tablet_bootstrap.cc:654] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.780865 16944 raft_consensus.cc:2749] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.781104 16831 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.787727 16831 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.791298 16695 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:35.791150 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.792587 16695 ts_tablet_manager.cc:1403] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
W20260709 12:25:35.792788 16466 leader_election.cc:343] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.792610 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.795511 16648 raft_consensus.cc:2468] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 0.
I20260709 12:25:35.796276 16695 raft_consensus.cc:359] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.797015 16466 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.796815 16831 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.798127 16951 raft_consensus.cc:2804] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.798609 16951 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.799036 16951 raft_consensus.cc:3060] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.797070 16695 raft_consensus.cc:385] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.803512 16694 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:35.808017 16695 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.807240 16951 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.808238 16694 ts_tablet_manager.cc:1403] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.001s
I20260709 12:25:35.812881 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:35.813482 16951 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.814168 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:35.814329 16466 leader_election.cc:343] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.805843 16699 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:35.814786 16648 raft_consensus.cc:3060] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.814488 16695 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:35.815203 16699 ts_tablet_manager.cc:1403] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 12:25:35.810281 16698 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:35.816762 16695 ts_tablet_manager.cc:1434] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:25:35.817384 16698 ts_tablet_manager.cc:1403] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.161s	user 0.027s	sys 0.038s
I20260709 12:25:35.817807 16695 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:35.821561 16694 raft_consensus.cc:359] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.822580 16694 raft_consensus.cc:385] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.822887 16694 raft_consensus.cc:740] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.823333 16648 raft_consensus.cc:2468] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:35.824920 16698 raft_consensus.cc:359] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.825058 16466 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.826148 16951 raft_consensus.cc:2804] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:35.826443 16695 tablet_bootstrap.cc:654] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.826704 16694 consensus_queue.cc:260] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:35.826655 16951 raft_consensus.cc:697] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:35.826468 16699 raft_consensus.cc:359] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.828325 16699 raft_consensus.cc:385] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.828644 16699 raft_consensus.cc:740] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.828481 16951 consensus_queue.cc:237] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.829377 16699 consensus_queue.cc:260] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.831555 16699 ts_tablet_manager.cc:1434] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:25:35.832695 16901 raft_consensus.cc:493] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.833585 16901 raft_consensus.cc:515] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.834504 16694 ts_tablet_manager.cc:1434] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:25:35.835487 16694 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:35.825665 16698 raft_consensus.cc:385] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:35.837039 16698 raft_consensus.cc:740] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:35.854518 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:35.855825 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:35.856516 16423 raft_consensus.cc:2468] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:35.857605 16698 consensus_queue.cc:260] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.859071 16698 ts_tablet_manager.cc:1434] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.000s
W20260709 12:25:35.860069 16614 leader_election.cc:343] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.861188 16614 leader_election.cc:304] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:35.863366 16698 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:35.863747 16792 raft_consensus.cc:2804] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:35.851999 16699 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:35.864133 16792 raft_consensus.cc:493] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.865607 16792 raft_consensus.cc:3060] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.836576 16901 leader_election.cc:290] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:35.874558 16318 catalog_manager.cc:5697] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 1 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.887686 16901 consensus_queue.cc:1048] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.892606 16694 tablet_bootstrap.cc:654] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.896714 16698 tablet_bootstrap.cc:654] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.881984 16951 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.897487 16951 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:35.913730 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:35.931653 16699 tablet_bootstrap.cc:654] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:35.932874 16951 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:35.931803 16792 raft_consensus.cc:515] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.937955 16861 consensus_queue.cc:1048] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:35.941654 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:35.943078 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:35.943753 16422 raft_consensus.cc:3060] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:35.949961 16614 leader_election.cc:343] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:35.954811 16792 leader_election.cc:290] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:35.957269 16831 consensus_queue.cc:1048] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.962292 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:35.963675 16648 raft_consensus.cc:2393] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:35.965956 16466 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:35.968851 16951 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:35.985667 16422 raft_consensus.cc:2468] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:35.986155 16695 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:36.009119 16695 ts_tablet_manager.cc:1403] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.191s	user 0.032s	sys 0.029s
I20260709 12:25:36.010121 16614 leader_election.cc:304] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:36.012076 16945 raft_consensus.cc:2804] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.012712 16945 raft_consensus.cc:697] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:36.013870 16945 consensus_queue.cc:237] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:35.986327 16831 consensus_queue.cc:1048] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:35.992889 16498 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.005816 16861 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.020725 16861 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.012702 16695 raft_consensus.cc:359] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.025540 16695 raft_consensus.cc:385] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.025887 16695 raft_consensus.cc:740] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.027943 16694 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:36.027928 16695 consensus_queue.cc:260] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.028600 16694 ts_tablet_manager.cc:1403] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.193s	user 0.020s	sys 0.027s
I20260709 12:25:36.029327 16571 raft_consensus.cc:3060] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.030572 16695 ts_tablet_manager.cc:1434] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:25:36.031770 16695 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:36.031601 16694 raft_consensus.cc:359] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.032347 16694 raft_consensus.cc:385] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.032919 16694 raft_consensus.cc:740] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.041641 16694 consensus_queue.cc:260] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.043736 16698 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:36.044186 16694 ts_tablet_manager.cc:1434] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.002s
I20260709 12:25:36.044363 16698 ts_tablet_manager.cc:1403] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.181s	user 0.032s	sys 0.087s
I20260709 12:25:36.045586 16694 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:36.053889 16854 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.054553 16854 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.064989 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.069684 16901 consensus_queue.cc:1048] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:36.072212 16854 leader_election.cc:290] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:25:36.072821 16390 leader_election.cc:343] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.072490 16695 tablet_bootstrap.cc:654] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.078922 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.079159 16901 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.079820 16901 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:36.081007 16391 leader_election.cc:343] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.081621 16391 leader_election.cc:304] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:36.081722 16945 consensus_queue.cc:1048] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:36.084530 16854 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.087713 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.089207 16694 tablet_bootstrap.cc:654] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:36.089422 16615 leader_election.cc:343] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.089637 16854 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.091703 16901 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:36.097523 16854 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.117741 16861 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:36.119061 16698 raft_consensus.cc:359] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.119772 16698 raft_consensus.cc:385] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.120056 16698 raft_consensus.cc:740] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.120739 16698 consensus_queue.cc:260] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.127720 16698 ts_tablet_manager.cc:1434] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.001s
I20260709 12:25:36.130191 16698 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
W20260709 12:25:36.114003 16390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 45761.1us
I20260709 12:25:36.133019 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.133751 16573 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:36.134905 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.136111 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:36.140268 16614 leader_election.cc:343] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.150380 16615 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:36.116487 16981 consensus_queue.cc:1048] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:25:36.153430 16614 leader_election.cc:343] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.156965 16614 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:36.162318 16699 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:36.162875 16699 ts_tablet_manager.cc:1403] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.330s	user 0.048s	sys 0.044s
I20260709 12:25:36.150821 16854 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:36.160800 16792 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.160424 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.165644 16901 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.165719 16985 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.180660 16985 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:36.182040 16391 leader_election.cc:343] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.183071 16985 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:36.193064 16319 catalog_manager.cc:5697] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:36.176378 16792 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.210059 16792 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.213655 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.229517 16951 raft_consensus.cc:2749] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.231592 16854 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.238772 16694 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:36.250032 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:36.256875 16694 ts_tablet_manager.cc:1403] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.012s
I20260709 12:25:36.257203 16646 raft_consensus.cc:2393] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
W20260709 12:25:36.265028 16390 leader_election.cc:343] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.265566 16390 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:36.237406 16854 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.264092 16792 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.268018 16699 raft_consensus.cc:359] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.269542 16854 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:36.268721 16699 raft_consensus.cc:385] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.270280 16854 raft_consensus.cc:2749] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.270648 16699 raft_consensus.cc:740] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.247834 16698 tablet_bootstrap.cc:654] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.271423 16699 consensus_queue.cc:260] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.273018 16694 raft_consensus.cc:359] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.273643 16694 raft_consensus.cc:385] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.273904 16694 raft_consensus.cc:740] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.276997 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:36.277622 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:36.243528 16500 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.277683 16648 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:36.287492 16699 ts_tablet_manager.cc:1434] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:25:36.288600 16699 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:36.292891 16694 consensus_queue.cc:260] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.293803 16391 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:36.303323 16792 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:36.231896 16997 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.323861 16465 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:36.300962 16922 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.323797 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:36.325006 16694 ts_tablet_manager.cc:1434] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.068s	user 0.001s	sys 0.008s
I20260709 12:25:36.332073 16694 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:36.331386 16922 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.329715 16700 consensus_queue.cc:1048] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:25:36.343895 16854 consensus_queue.cc:1048] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:36.335474 16993 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.350148 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:36.357049 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.358717 16695 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:36.359310 16695 ts_tablet_manager.cc:1403] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.328s	user 0.021s	sys 0.025s
W20260709 12:25:36.360697 16614 leader_election.cc:343] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.350812 16575 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.353219 16922 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.377259 16698 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:36.378022 16698 ts_tablet_manager.cc:1403] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.249s	user 0.020s	sys 0.004s
I20260709 12:25:36.332572 16997 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.353709 16992 consensus_queue.cc:1048] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:25:36.399904 16928 consensus_queue.cc:1048] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:36.399936 16572 raft_consensus.cc:3060] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:36.410801 16466 consensus_peers.cc:597] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.407531 16997 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:36.411871 16993 consensus_queue.cc:1048] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:36.419559 16698 raft_consensus.cc:359] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.420389 16698 raft_consensus.cc:385] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.433774 16698 raft_consensus.cc:740] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.436213 16699 tablet_bootstrap.cc:654] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.434580 16698 consensus_queue.cc:260] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.443733 16698 ts_tablet_manager.cc:1434] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:25:36.444824 16698 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:36.449177 16922 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.452351 16922 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:36.454975 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 77793.3us
I20260709 12:25:36.457217 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:36.457976 16648 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:36.459548 16391 leader_election.cc:343] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.464941 16694 tablet_bootstrap.cc:654] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.468380 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:36.482908 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:36.500555 16391 leader_election.cc:343] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.512815 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:36.518143 16575 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:36.519742 16615 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:36.521970 16792 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.522609 16792 raft_consensus.cc:697] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:36.523432 16540 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:36.523617 16792 consensus_queue.cc:237] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.524520 17007 raft_consensus.cc:2749] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.539404 16986 consensus_queue.cc:1048] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:36.548795 16695 raft_consensus.cc:359] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.549650 16695 raft_consensus.cc:385] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.550179 16695 raft_consensus.cc:740] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.551208 16695 consensus_queue.cc:260] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.572160 16695 ts_tablet_manager.cc:1434] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.212s	user 0.009s	sys 0.004s
I20260709 12:25:36.537230 16648 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:36.588542 16391 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:36.599165 16699 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:36.599756 16699 ts_tablet_manager.cc:1403] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.311s	user 0.023s	sys 0.029s
I20260709 12:25:36.595609 16925 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.602751 16699 raft_consensus.cc:359] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.605746 16925 raft_consensus.cc:697] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:36.606734 16925 consensus_queue.cc:237] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.608115 16698 tablet_bootstrap.cc:654] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.609552 16495 raft_consensus.cc:3060] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.605831 16699 raft_consensus.cc:385] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.614074 16699 raft_consensus.cc:740] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.616412 16695 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:36.616117 16699 consensus_queue.cc:260] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.625932 16699 ts_tablet_manager.cc:1434] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:25:36.647531 16695 tablet_bootstrap.cc:654] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.658372 16694 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:36.658994 16694 ts_tablet_manager.cc:1403] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.327s	user 0.012s	sys 0.009s
W20260709 12:25:36.661244 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:36.662370 16694 raft_consensus.cc:359] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.663383 16694 raft_consensus.cc:385] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.663693 16694 raft_consensus.cc:740] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.664170 16699 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:36.664594 16694 consensus_queue.cc:260] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.624184 16901 consensus_queue.cc:1048] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 12:25:36.698549 16694 ts_tablet_manager.cc:1434] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:25:36.703933 16694 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:36.720749 16699 tablet_bootstrap.cc:654] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.723456 16698 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:36.724040 16698 ts_tablet_manager.cc:1403] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.279s	user 0.017s	sys 0.003s
I20260709 12:25:36.722050 16496 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.730562 16698 raft_consensus.cc:359] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.734748 16901 consensus_queue.cc:1048] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:36.738260 16698 raft_consensus.cc:385] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.739982 16698 raft_consensus.cc:740] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.754642 16322 catalog_manager.cc:5697] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:36.766999 16698 consensus_queue.cc:260] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.770525 16698 ts_tablet_manager.cc:1434] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:25:36.771725 16698 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:36.771210 16986 raft_consensus.cc:493] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.773113 16986 raft_consensus.cc:515] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.775435 16986 leader_election.cc:290] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:36.777258 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:36.780059 16698 tablet_bootstrap.cc:654] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.785034 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:36.786583 16694 tablet_bootstrap.cc:654] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.801406 16695 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:36.802040 16695 ts_tablet_manager.cc:1403] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.039s
I20260709 12:25:36.801880 16466 leader_election.cc:304] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:36.804383 16698 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:36.801165 17002 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.805354 16698 ts_tablet_manager.cc:1403] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 12:25:36.805261 17002 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.805508 16695 raft_consensus.cc:359] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.806586 16695 raft_consensus.cc:385] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.806980 16695 raft_consensus.cc:740] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.807943 16695 consensus_queue.cc:260] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.808676 16698 raft_consensus.cc:359] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.809329 16698 raft_consensus.cc:385] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.809597 16698 raft_consensus.cc:740] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.810212 16698 consensus_queue.cc:260] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.810712 16695 ts_tablet_manager.cc:1434] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:36.811951 16695 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:36.812323 16698 ts_tablet_manager.cc:1434] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:36.813948 16997 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.814510 16997 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.816917 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.819226 16698 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:36.819959 16997 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:36.820706 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:36.821472 16648 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:36.822235 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.820735 17002 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:36.837184 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.838529 16541 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:36.839460 16997 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:36.825075 16614 leader_election.cc:343] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.839886 16997 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.840287 16997 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:36.841207 16615 leader_election.cc:343] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.843535 16615 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:36.844525 16901 raft_consensus.cc:2749] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.849476 16695 tablet_bootstrap.cc:654] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:36.853504 16540 leader_election.cc:343] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.855249 16698 tablet_bootstrap.cc:654] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.863502 16319 catalog_manager.cc:5697] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:36.874125 16861 raft_consensus.cc:493] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.874795 16861 raft_consensus.cc:515] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:36.880960 16997 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.886713 16997 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:36.887543 16861 leader_election.cc:290] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:36.889325 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:36.890494 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ab7bf5977d4d7e9033989e7f6ddc3f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:36.890938 16540 leader_election.cc:343] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.891379 16422 raft_consensus.cc:2468] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:36.893498 16614 leader_election.cc:304] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:36.894935 16699 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:36.894729 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:36.895452 16699 ts_tablet_manager.cc:1403] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.013s
I20260709 12:25:36.905036 16861 raft_consensus.cc:2804] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.905555 16861 raft_consensus.cc:493] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.905606 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ab7bf5977d4d7e9033989e7f6ddc3f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:36.906041 16861 raft_consensus.cc:3060] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:36.907308 16615 leader_election.cc:343] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.895489 16648 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.917255 16986 raft_consensus.cc:2749] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:36.920082 16699 raft_consensus.cc:359] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.923096 16699 raft_consensus.cc:385] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.923374 16699 raft_consensus.cc:740] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.924556 16699 consensus_queue.cc:260] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.926270 16699 ts_tablet_manager.cc:1434] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:25:36.927189 16699 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:36.928853 16901 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.929550 16901 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.932289 16901 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:36.936082 16648 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:36.943192 16694 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:36.941104 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:36.943759 16694 ts_tablet_manager.cc:1403] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.243s	user 0.010s	sys 0.022s
W20260709 12:25:36.944720 16614 leader_election.cc:343] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.946336 16541 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:36.947249 16694 raft_consensus.cc:359] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.947973 16694 raft_consensus.cc:385] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.948166 17007 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.944307 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.949043 17007 raft_consensus.cc:697] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:36.948236 16694 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.950907 16997 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.951064 16694 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.951460 16997 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:36.951826 16695 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:36.952713 16695 ts_tablet_manager.cc:1403] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.023s
I20260709 12:25:36.953338 16694 ts_tablet_manager.cc:1434] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:25:36.953928 16997 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:36.954345 16694 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:36.955662 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:36.956036 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:36.956583 16422 raft_consensus.cc:2468] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:36.956774 16500 raft_consensus.cc:2468] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:36.958344 16540 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:36.959795 16997 raft_consensus.cc:2804] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.959601 16695 raft_consensus.cc:359] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.960268 16997 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.960603 16695 raft_consensus.cc:385] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.960718 16997 raft_consensus.cc:3060] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.961131 16695 raft_consensus.cc:740] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.962568 16698 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:36.950048 17007 consensus_queue.cc:237] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.962109 16695 consensus_queue.cc:260] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.963083 16698 ts_tablet_manager.cc:1403] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.150s	user 0.007s	sys 0.009s
I20260709 12:25:36.966838 16694 tablet_bootstrap.cc:654] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:36.970695 16614 leader_election.cc:343] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.971237 16614 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:36.973956 16698 raft_consensus.cc:359] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.974673 16698 raft_consensus.cc:385] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.974957 16698 raft_consensus.cc:740] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.975574 16698 consensus_queue.cc:260] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:36.932504 16699 tablet_bootstrap.cc:654] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.979066 16901 raft_consensus.cc:2749] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.979307 16694 tablet_bootstrap.cc:492] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:36.979180 16695 ts_tablet_manager.cc:1434] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260709 12:25:36.979911 16694 ts_tablet_manager.cc:1403] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:25:36.980134 16901 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:36.981050 16695 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:36.987186 16698 ts_tablet_manager.cc:1434] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:25:36.988350 16698 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:36.988072 16694 raft_consensus.cc:359] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:36.993763 16861 raft_consensus.cc:515] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.003422 16694 raft_consensus.cc:385] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.003801 16694 raft_consensus.cc:740] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.004675 16694 consensus_queue.cc:260] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.005762 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ab7bf5977d4d7e9033989e7f6ddc3f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:37.007551 16694 ts_tablet_manager.cc:1434] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
W20260709 12:25:37.007485 16615 leader_election.cc:343] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.007172 16319 catalog_manager.cc:5697] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:37.000137 16614 consensus_peers.cc:597] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.008872 16694 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:37.009492 16861 leader_election.cc:290] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:37.002816 16699 tablet_bootstrap.cc:492] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:37.013243 16699 ts_tablet_manager.cc:1403] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 12:25:37.019004 16694 tablet_bootstrap.cc:654] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.022485 16997 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.024750 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ab7bf5977d4d7e9033989e7f6ddc3f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:37.025506 16422 raft_consensus.cc:3060] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.026424 16695 tablet_bootstrap.cc:654] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.028280 16699 raft_consensus.cc:359] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.029068 16699 raft_consensus.cc:385] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.029354 16699 raft_consensus.cc:740] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.030128 16699 consensus_queue.cc:260] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.031132 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:37.031822 16425 raft_consensus.cc:3060] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.039558 16901 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.040201 16901 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.041097 16698 tablet_bootstrap.cc:654] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.044008 16425 raft_consensus.cc:2468] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:37.044979 16901 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.047513 16422 raft_consensus.cc:2468] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:37.048660 16540 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:37.049542 16997 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.049717 17007 raft_consensus.cc:2804] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.049732 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:37.050506 17007 raft_consensus.cc:697] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:37.050660 16500 raft_consensus.cc:3060] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.051494 17007 consensus_queue.cc:237] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.063203 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:37.065104 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:37.032553 16699 ts_tablet_manager.cc:1434] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260709 12:25:37.068241 16699 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:37.068697 17014 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.069221 17014 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.071511 17014 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.074792 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:37.076144 16614 leader_election.cc:343] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.076498 16695 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:37.077067 16695 ts_tablet_manager.cc:1403] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.005s
W20260709 12:25:37.076403 16390 leader_election.cc:343] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.082664 16614 leader_election.cc:304] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:37.084615 16500 raft_consensus.cc:2468] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:37.085152 16695 raft_consensus.cc:359] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.097798 16695 raft_consensus.cc:385] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.098110 16695 raft_consensus.cc:740] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.098776 16695 consensus_queue.cc:260] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.091729 16799 raft_consensus.cc:2804] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.096998 16321 catalog_manager.cc:5697] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.099862 16799 raft_consensus.cc:697] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:37.065389 16425 raft_consensus.cc:2468] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:37.101024 16799 consensus_queue.cc:237] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.101560 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.102540 16646 raft_consensus.cc:2468] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:37.109567 16391 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:37.110638 16695 ts_tablet_manager.cc:1434] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:25:37.111158 16700 raft_consensus.cc:2804] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.111683 16700 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.111869 16695 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:37.112167 16700 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.114315 16694 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:37.114876 16694 ts_tablet_manager.cc:1403] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.016s
I20260709 12:25:37.086568 16699 tablet_bootstrap.cc:654] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.118191 16694 raft_consensus.cc:359] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.119328 16694 raft_consensus.cc:385] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.119603 16694 raft_consensus.cc:740] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.120404 16694 consensus_queue.cc:260] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.122090 16922 consensus_queue.cc:1048] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.123103 16694 ts_tablet_manager.cc:1434] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:37.125110 16694 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:37.124946 16614 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:37.125830 16901 raft_consensus.cc:2804] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.126307 16901 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.126737 16901 raft_consensus.cc:3060] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.132130 16694 tablet_bootstrap.cc:654] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.133410 16700 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.142611 16695 tablet_bootstrap.cc:654] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.142773 16321 catalog_manager.cc:5697] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.143944 16694 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:37.144546 16694 ts_tablet_manager.cc:1403] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:25:37.147567 16694 raft_consensus.cc:359] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.148237 16694 raft_consensus.cc:385] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.148495 16694 raft_consensus.cc:740] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.153587 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:37.154208 16648 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.154933 16695 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:37.155156 16700 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.139875 16901 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.140880 16698 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:37.156512 16698 ts_tablet_manager.cc:1403] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.003s
I20260709 12:25:37.158742 16695 ts_tablet_manager.cc:1403] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.004s
I20260709 12:25:37.158335 16694 consensus_queue.cc:260] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.165244 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:37.166927 16698 raft_consensus.cc:359] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.167726 16698 raft_consensus.cc:385] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.168015 16698 raft_consensus.cc:740] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.168740 16698 consensus_queue.cc:260] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.170934 16698 ts_tablet_manager.cc:1434] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:37.171929 16698 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:37.171962 16648 raft_consensus.cc:2468] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:37.174971 16572 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.178678 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:37.179275 16425 raft_consensus.cc:3060] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:37.174896 16390 leader_election.cc:343] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.181576 16391 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:37.181625 16695 raft_consensus.cc:359] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.182369 16695 raft_consensus.cc:385] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.182925 16695 raft_consensus.cc:740] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.185776 16699 tablet_bootstrap.cc:492] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:37.186201 16901 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.183707 16695 consensus_queue.cc:260] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.186390 17014 raft_consensus.cc:2804] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.186439 16699 ts_tablet_manager.cc:1403] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.010s
I20260709 12:25:37.191597 16694 ts_tablet_manager.cc:1434] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:25:37.192550 16999 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.197288 16694 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:37.197499 16425 raft_consensus.cc:2468] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:37.194169 16695 ts_tablet_manager.cc:1434] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:25:37.198740 16614 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:37.198984 16695 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:37.190913 17014 raft_consensus.cc:697] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:37.200369 17014 consensus_queue.cc:237] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.200595 16999 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.202909 16999 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:37.204093 16799 raft_consensus.cc:2804] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.204746 16799 raft_consensus.cc:697] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:37.205813 16695 tablet_bootstrap.cc:654] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.205720 16799 consensus_queue.cc:237] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:37.212374 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:37.214584 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:37.216390 16390 leader_election.cc:343] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:37.219228 16614 leader_election.cc:343] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.224749 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:37.225569 16573 raft_consensus.cc:2468] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:37.227706 17007 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.233174 17007 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.236747 16391 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:37.237164 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.236778 16928 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.238907 16928 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.239219 17007 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:37.241139 16928 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:37.243417 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.243673 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:37.244866 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:37.245483 16922 consensus_queue.cc:1048] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.246969 16922 raft_consensus.cc:2804] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.247352 16922 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.247713 16922 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.229812 16999 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.251263 16999 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.279208 16540 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:37.280802 17007 raft_consensus.cc:2749] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.285251 16540 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:37.287793 16698 tablet_bootstrap.cc:654] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.288983 17007 raft_consensus.cc:2749] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.297186 16699 raft_consensus.cc:359] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.298070 16699 raft_consensus.cc:385] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.298409 16699 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.303880 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:37.291823 16922 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.306368 16573 raft_consensus.cc:3060] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.308048 16922 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:37.315934 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:37.317548 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.318339 16649 raft_consensus.cc:2468] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:37.320467 16391 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:37.321907 16700 raft_consensus.cc:2804] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.322441 16700 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.322862 16700 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.324808 16999 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:37.329053 16391 leader_election.cc:343] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.330029 16694 tablet_bootstrap.cc:654] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.329535 16699 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.356580 16699 ts_tablet_manager.cc:1434] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.166s	user 0.008s	sys 0.001s
I20260709 12:25:37.358675 16699 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
W20260709 12:25:37.339360 16390 leader_election.cc:343] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.384804 16321 catalog_manager.cc:5697] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.374641 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:37.397527 16571 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.399039 16698 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:37.399643 16698 ts_tablet_manager.cc:1403] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.228s	user 0.025s	sys 0.036s
W20260709 12:25:37.384996 16390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 47837.3us
I20260709 12:25:37.422457 16993 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.426750 16993 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.429418 16993 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:37.412245 16700 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.429934 16992 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.432744 16571 raft_consensus.cc:2468] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:37.449074 16391 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:37.438614 16700 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:37.454058 16496 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.429773 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:37.454370 16928 consensus_queue.cc:1048] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.440410 16698 raft_consensus.cc:359] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.457479 16698 raft_consensus.cc:385] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.457787 16698 raft_consensus.cc:740] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.458550 16698 consensus_queue.cc:260] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.439316 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:37.459930 16319 catalog_manager.cc:5697] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.440356 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:37.430761 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.461517 16646 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.461982 16649 raft_consensus.cc:2393] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:37.463654 16466 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:37.463572 16999 raft_consensus.cc:2804] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.465422 16999 raft_consensus.cc:697] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:37.461907 16698 ts_tablet_manager.cc:1434] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:25:37.468290 16999 consensus_queue.cc:237] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.447975 16992 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.475226 16992 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.472565 16698 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:37.478325 16699 tablet_bootstrap.cc:654] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.434130 16695 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:37.482900 16695 ts_tablet_manager.cc:1403] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.284s	user 0.037s	sys 0.054s
W20260709 12:25:37.488874 16391 leader_election.cc:343] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.494138 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:37.494927 16423 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:37.499483 16540 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:37.496331 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:37.502712 16992 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.514396 16992 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.519821 16992 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.524705 16986 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:37.525831 16540 leader_election.cc:343] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.528046 16698 tablet_bootstrap.cc:654] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.530696 16695 raft_consensus.cc:359] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.534089 16695 raft_consensus.cc:385] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.528893 17007 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:37.531790 16928 consensus_queue.cc:1048] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:37.534560 16695 raft_consensus.cc:740] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.541895 16695 consensus_queue.cc:260] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.557138 16986 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.557853 16986 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.561801 16986 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:37.563658 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:37.576691 16695 ts_tablet_manager.cc:1434] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.093s	user 0.010s	sys 0.000s
W20260709 12:25:37.551955 16615 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.580506 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:37.581339 16695 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:37.593263 16694 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:37.594017 16694 ts_tablet_manager.cc:1403] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.397s	user 0.021s	sys 0.008s
I20260709 12:25:37.604481 16646 raft_consensus.cc:2468] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:37.607030 16497 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.608314 16466 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:37.610378 16694 raft_consensus.cc:359] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.611222 16694 raft_consensus.cc:385] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.611527 16694 raft_consensus.cc:740] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.614002 16928 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.615643 16391 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:37.631392 16694 consensus_queue.cc:260] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:37.660718 16700 raft_consensus.cc:2804] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.669023 16700 raft_consensus.cc:697] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:37.670022 16700 consensus_queue.cc:237] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:37.680869 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 58964.4us
I20260709 12:25:37.683306 16695 tablet_bootstrap.cc:654] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.690896 16699 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:37.692981 16699 ts_tablet_manager.cc:1403] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.335s	user 0.031s	sys 0.053s
I20260709 12:25:37.703560 16318 catalog_manager.cc:5697] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.718775 16694 ts_tablet_manager.cc:1434] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.124s	user 0.017s	sys 0.009s
I20260709 12:25:37.725080 16694 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:37.727340 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 68118.5us
I20260709 12:25:37.739174 16698 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:37.740015 16698 ts_tablet_manager.cc:1403] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.269s	user 0.019s	sys 0.000s
W20260709 12:25:37.746948 17057 log.cc:927] Time spent T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:37.764966 16698 raft_consensus.cc:359] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.766054 16698 raft_consensus.cc:385] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.766422 16698 raft_consensus.cc:740] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.801389 16698 consensus_queue.cc:260] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:37.865723 16698 ts_tablet_manager.cc:1434] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.125s	user 0.026s	sys 0.037s
I20260709 12:25:37.866849 16698 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:37.866780 16992 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:37.872133 16992 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:37.873802 16694 tablet_bootstrap.cc:654] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:37.927234 16390 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.977092 16925 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.978590 16925 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.002170 16699 raft_consensus.cc:359] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.006256 16699 raft_consensus.cc:385] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.006704 16699 raft_consensus.cc:740] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.007632 16699 consensus_queue.cc:260] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.015698 16925 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:38.018626 16699 ts_tablet_manager.cc:1434] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.325s	user 0.015s	sys 0.002s
I20260709 12:25:38.018486 16928 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.019742 16928 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.024152 16928 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:38.027395 16699 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:38.030107 17053 raft_consensus.cc:2749] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.033836 16698 tablet_bootstrap.cc:654] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.037575 16695 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:38.038800 16695 ts_tablet_manager.cc:1403] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.458s	user 0.012s	sys 0.015s
I20260709 12:25:38.059036 17065 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.063439 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 80666.3us
I20260709 12:25:38.072404 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:38.062856 16695 raft_consensus.cc:359] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.079465 16695 raft_consensus.cc:385] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.079869 16695 raft_consensus.cc:740] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.080704 16695 consensus_queue.cc:260] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:38.081758 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 75823.2us
I20260709 12:25:38.090900 16699 tablet_bootstrap.cc:654] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:38.104127 16391 leader_election.cc:343] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.060199 17065 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.117189 16695 ts_tablet_manager.cc:1434] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.004s
I20260709 12:25:38.120805 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.121474 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:38.124574 17065 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:38.125519 17014 consensus_queue.cc:1048] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.129199 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.138041 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:38.139068 16570 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:38.146685 16695 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:38.155046 16694 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
W20260709 12:25:38.162127 16390 leader_election.cc:343] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:38.164697 16540 leader_election.cc:343] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:38.173569 16540 leader_election.cc:343] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.163897 16390 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
W20260709 12:25:38.176052 16390 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.176106 17014 raft_consensus.cc:2749] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.176772 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:38.177904 17065 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:38.178455 17065 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.178980 17065 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.187667 16694 ts_tablet_manager.cc:1403] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.463s	user 0.018s	sys 0.014s
I20260709 12:25:38.197152 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:38.211863 17061 consensus_queue.cc:1048] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.213871 16695 tablet_bootstrap.cc:654] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.192387 16694 raft_consensus.cc:359] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.216035 16694 raft_consensus.cc:385] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.216343 16694 raft_consensus.cc:740] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.222658 16318 catalog_manager.cc:5697] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.228508 16694 consensus_queue.cc:260] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.248018 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:38.249044 16421 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.253649 17068 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.254360 17068 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.257576 17068 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:38.267273 16698 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
W20260709 12:25:38.228436 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 67142.8us
I20260709 12:25:38.294905 16698 ts_tablet_manager.cc:1403] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.428s	user 0.018s	sys 0.003s
I20260709 12:25:38.298985 17065 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.300452 16649 raft_consensus.cc:2393] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:38.312604 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:38.317283 16541 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:38.318785 17007 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.323823 16694 ts_tablet_manager.cc:1434] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.008s
I20260709 12:25:38.341050 16996 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.341730 16996 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:38.345947 16996 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:38.338338 16421 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:38.346800 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:38.350103 16615 leader_election.cc:343] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.351397 16695 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:38.352043 16695 ts_tablet_manager.cc:1403] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.010s
W20260709 12:25:38.352741 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.353174 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 49616.3us
I20260709 12:25:38.355293 16861 consensus_queue.cc:1048] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.355365 17085 consensus_queue.cc:1048] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.355357 16694 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:38.357194 16698 raft_consensus.cc:359] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.358563 16698 raft_consensus.cc:385] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.358970 16698 raft_consensus.cc:740] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.360117 16698 consensus_queue.cc:260] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:38.366413 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:38.369026 16698 ts_tablet_manager.cc:1434] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:25:38.369992 17065 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:38.371013 16698 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:38.372973 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:25:38.375146 16391 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.382787 16540 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:38.384362 16992 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:38.387045 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.389412 16992 raft_consensus.cc:697] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:38.390671 16992 consensus_queue.cc:237] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.386627 16695 raft_consensus.cc:359] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.393481 16695 raft_consensus.cc:385] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.393831 16695 raft_consensus.cc:740] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.380462 17007 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.406019 16695 consensus_queue.cc:260] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.409348 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:38.412384 16425 raft_consensus.cc:2393] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:38.423642 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:38.426743 16614 leader_election.cc:343] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.446743 16699 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:38.447373 16699 ts_tablet_manager.cc:1403] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.421s	user 0.020s	sys 0.002s
I20260709 12:25:38.396737 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:38.453302 16699 raft_consensus.cc:359] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.454409 16699 raft_consensus.cc:385] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.456341 16572 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:38.455164 16699 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.456804 16465 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:38.457501 16699 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.458410 17068 raft_consensus.cc:3060] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:38.455336 16614 leader_election.cc:343] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.461479 16614 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:38.469065 16694 tablet_bootstrap.cc:654] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.460721 16695 ts_tablet_manager.cc:1434] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.005s
I20260709 12:25:38.478440 16699 ts_tablet_manager.cc:1434] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:25:38.479822 16699 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:38.483124 16695 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:38.494464 16996 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:38.496425 16996 raft_consensus.cc:697] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:38.497669 16996 consensus_queue.cc:237] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.491225 17068 raft_consensus.cc:2749] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.502642 16992 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.504976 17076 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.505012 16992 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.505600 17076 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.506317 16322 catalog_manager.cc:5697] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.507678 17076 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:38.509531 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:38.511348 16540 leader_election.cc:343] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.511711 16698 tablet_bootstrap.cc:654] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.518087 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:38.521932 16390 leader_election.cc:343] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.525483 16699 tablet_bootstrap.cc:654] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:38.530704 16614 leader_election.cc:343] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.535346 16695 tablet_bootstrap.cc:654] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.545569 16614 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:38.526456 16992 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:38.527717 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:38.562070 16646 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:38.552320 17068 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.554338 16861 raft_consensus.cc:2749] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.526149 16700 consensus_queue.cc:1048] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:25:38.557070 17014 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.569779 17014 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.573799 16541 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:38.576260 17071 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:38.576706 17071 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.577039 17071 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.577616 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.583245 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:38.580812 17014 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:38.566205 17068 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.598959 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:38.605074 17068 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:25:38.596868 16390 leader_election.cc:343] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.606894 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:38.611064 16698 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:38.611716 16698 ts_tablet_manager.cc:1403] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.241s	user 0.019s	sys 0.004s
I20260709 12:25:38.614876 16698 raft_consensus.cc:359] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.615710 16698 raft_consensus.cc:385] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.616036 16698 raft_consensus.cc:740] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
W20260709 12:25:38.626650 16391 leader_election.cc:343] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.610679 17071 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.627326 16391 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:38.638863 16698 consensus_queue.cc:260] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.649197 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:38.650887 16999 raft_consensus.cc:2749] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.654601 16424 raft_consensus.cc:2393] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:38.658136 16465 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:38.676836 16694 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:38.677487 16694 ts_tablet_manager.cc:1403] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.323s	user 0.011s	sys 0.007s
W20260709 12:25:38.680058 16391 leader_election.cc:343] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.680444 16391 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:38.682679 17061 raft_consensus.cc:2749] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.686194 17084 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.690559 16699 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:38.691207 16699 ts_tablet_manager.cc:1403] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.212s	user 0.025s	sys 0.025s
I20260709 12:25:38.694159 17071 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:38.699272 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:38.686164 16694 raft_consensus.cc:359] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.700745 16694 raft_consensus.cc:385] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.701089 16694 raft_consensus.cc:740] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.700071 16695 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:38.702455 16695 ts_tablet_manager.cc:1403] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.220s	user 0.025s	sys 0.001s
I20260709 12:25:38.700054 16649 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.712152 16694 consensus_queue.cc:260] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.713423 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:25:38.726159 16540 leader_election.cc:343] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.727010 17084 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.731210 16698 ts_tablet_manager.cc:1434] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.000s
I20260709 12:25:38.731935 16996 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.732525 16698 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:38.731252 16649 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:38.732558 16996 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.734360 16541 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:38.735150 17071 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:38.735697 16996 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:38.739030 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:38.740724 17071 raft_consensus.cc:697] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
W20260709 12:25:38.741087 16615 leader_election.cc:343] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.741765 17071 consensus_queue.cc:237] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.744231 16694 ts_tablet_manager.cc:1434] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:25:38.745343 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.746167 16694 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:38.746976 16614 leader_election.cc:343] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.747552 16614 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:38.749670 17002 raft_consensus.cc:2749] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:38.758147 16699 raft_consensus.cc:359] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.759130 16699 raft_consensus.cc:385] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.759454 16699 raft_consensus.cc:740] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.761093 16699 consensus_queue.cc:260] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:38.762338 16318 catalog_manager.cc:5697] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.769862 16699 ts_tablet_manager.cc:1434] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.004s
I20260709 12:25:38.773108 16694 tablet_bootstrap.cc:654] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.773824 16698 tablet_bootstrap.cc:654] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.778093 16699 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:38.786938 16699 tablet_bootstrap.cc:654] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.805632 16699 tablet_bootstrap.cc:492] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:38.806167 16699 ts_tablet_manager.cc:1403] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.008s
I20260709 12:25:38.805892 16321 catalog_manager.cc:5697] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.812077 16698 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:38.812717 16698 ts_tablet_manager.cc:1403] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.002s
I20260709 12:25:38.713341 16695 raft_consensus.cc:359] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:38.820232 16695 raft_consensus.cc:385] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.818092 16699 raft_consensus.cc:359] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.829774 16695 raft_consensus.cc:740] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.827099 17071 consensus_queue.cc:1048] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.816125 16698 raft_consensus.cc:359] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.842602 16698 raft_consensus.cc:385] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.843004 16698 raft_consensus.cc:740] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.844111 16698 consensus_queue.cc:260] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.846212 16698 ts_tablet_manager.cc:1434] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 12:25:38.847437 16698 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:38.832999 16699 raft_consensus.cc:385] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.849704 16699 raft_consensus.cc:740] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.837411 16695 consensus_queue.cc:260] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:38.855360 16698 tablet_bootstrap.cc:654] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.859081 16699 consensus_queue.cc:260] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:38.862054 16699 ts_tablet_manager.cc:1434] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.003s
I20260709 12:25:38.863060 16699 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:38.871095 16695 ts_tablet_manager.cc:1434] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.001s
I20260709 12:25:38.876231 16699 tablet_bootstrap.cc:654] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.889936 16496 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.882311 17007 consensus_queue.cc:1048] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.880990 16996 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.886447 16694 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:38.894004 16694 ts_tablet_manager.cc:1403] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.148s	user 0.067s	sys 0.026s
I20260709 12:25:38.893774 16996 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:38.897617 16996 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:38.899637 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:38.897254 16694 raft_consensus.cc:359] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:38.901322 16694 raft_consensus.cc:385] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.902218 16694 raft_consensus.cc:740] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.904888 16695 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:38.904348 16694 consensus_queue.cc:260] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:38.901294 16614 leader_election.cc:343] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:38.912352 16694 ts_tablet_manager.cc:1434] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:25:38.915115 16698 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:38.915272 16694 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:38.918093 16698 ts_tablet_manager.cc:1403] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.000s
I20260709 12:25:38.922705 16498 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.931689 16694 tablet_bootstrap.cc:654] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.934128 17069 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.943601 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:38.944521 16424 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:38.957870 16614 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:38.966714 17002 raft_consensus.cc:2804] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:38.967207 17002 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.967614 17002 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:38.974627 16861 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.989253 16695 tablet_bootstrap.cc:654] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.993669 16694 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:38.994390 16694 ts_tablet_manager.cc:1403] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.001s
I20260709 12:25:38.999104 16694 raft_consensus.cc:359] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.000464 16694 raft_consensus.cc:385] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.000885 16694 raft_consensus.cc:740] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.001869 16695 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:39.002556 16695 ts_tablet_manager.cc:1403] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.006s
I20260709 12:25:39.002013 16694 consensus_queue.cc:260] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.007552 16694 ts_tablet_manager.cc:1434] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:25:39.009513 16694 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:39.010898 16695 raft_consensus.cc:359] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.011812 16695 raft_consensus.cc:385] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.012156 16695 raft_consensus.cc:740] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.013118 16695 consensus_queue.cc:260] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.015961 16695 ts_tablet_manager.cc:1434] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:39.017164 16695 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:39.021669 16694 tablet_bootstrap.cc:654] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.023902 16695 tablet_bootstrap.cc:654] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.043781 16694 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:39.051121 16694 ts_tablet_manager.cc:1403] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.000s
I20260709 12:25:39.054739 16699 tablet_bootstrap.cc:492] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:39.055415 16699 ts_tablet_manager.cc:1403] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.193s	user 0.006s	sys 0.013s
I20260709 12:25:39.058874 16699 raft_consensus.cc:359] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.059702 16699 raft_consensus.cc:385] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.060034 16699 raft_consensus.cc:740] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.063289 16694 raft_consensus.cc:359] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.064599 16694 raft_consensus.cc:385] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.064998 16694 raft_consensus.cc:740] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.065783 16694 consensus_queue.cc:260] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.068689 16699 consensus_queue.cc:260] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.071870 16699 ts_tablet_manager.cc:1434] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:25:39.074306 16699 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:39.076529 16698 raft_consensus.cc:359] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.077641 16694 ts_tablet_manager.cc:1434] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:25:39.099718 16694 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:39.072439 17120 log.cc:927] Time spent T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:25:39.091775 17076 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.102341 17076 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.106505 17076 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.107295 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:39.110080 16391 leader_election.cc:343] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.096666 16698 raft_consensus.cc:385] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.112142 16698 raft_consensus.cc:740] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.121685 17007 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.122308 17007 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.124688 16699 tablet_bootstrap.cc:654] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.126238 16420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.127265 16420 raft_consensus.cc:2468] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:39.129911 16540 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:39.119165 16698 consensus_queue.cc:260] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.092164 17002 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.133541 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.134297 16646 raft_consensus.cc:2468] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:39.134389 16992 raft_consensus.cc:2804] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.135018 16992 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.149326 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:39.144331 17007 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.147635 16992 raft_consensus.cc:3060] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.158453 16694 tablet_bootstrap.cc:654] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.165135 16498 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.169719 17002 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.165251 17007 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.188226 16698 ts_tablet_manager.cc:1434] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.270s	user 0.010s	sys 0.000s
I20260709 12:25:39.179374 17085 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.199507 17085 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.202201 17085 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.223366 16698 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
W20260709 12:25:39.227137 16540 leader_election.cc:343] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.178942 17007 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:25:39.230491 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 72117.2us
I20260709 12:25:39.234896 16695 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:39.235509 16695 ts_tablet_manager.cc:1403] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.219s	user 0.038s	sys 0.021s
I20260709 12:25:39.239082 16695 raft_consensus.cc:359] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.239840 16695 raft_consensus.cc:385] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.240118 16695 raft_consensus.cc:740] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.240872 16695 consensus_queue.cc:260] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.244444 17007 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.244679 16695 ts_tablet_manager.cc:1434] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:25:39.246852 16695 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:39.248364 16420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.250293 16572 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:39.250586 16540 leader_election.cc:343] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.255043 16570 raft_consensus.cc:3060] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.257417 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:39.261026 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:39.263931 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:39.264482 16423 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.266959 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:39.270841 16614 leader_election.cc:343] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:39.271685 16614 leader_election.cc:343] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.276292 16423 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:39.284550 16694 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:39.285171 16694 ts_tablet_manager.cc:1403] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.186s	user 0.021s	sys 0.028s
I20260709 12:25:39.290802 17085 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.291438 17085 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.293344 17085 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:39.294566 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:39.296868 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:39.308511 16992 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.309106 17084 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.309875 17084 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.313393 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:39.314932 16424 raft_consensus.cc:3060] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.297902 16391 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:39.320251 17077 raft_consensus.cc:2804] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.320789 17077 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.321199 17077 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.310890 16992 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.312026 16698 tablet_bootstrap.cc:654] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:39.312927 16614 leader_election.cc:343] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.302910 16694 raft_consensus.cc:359] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.329449 16694 raft_consensus.cc:385] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.331183 16694 raft_consensus.cc:740] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.332065 16614 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:39.332000 17077 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:39.340098 16615 leader_election.cc:343] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.341984 16615 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:39.342191 17085 raft_consensus.cc:2804] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:39.343003 17085 raft_consensus.cc:697] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:39.343278 17129 raft_consensus.cc:2749] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:39.344834 16694 consensus_queue.cc:260] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.344183 17085 consensus_queue.cc:237] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.346930 17077 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.349416 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.378252 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:39.384545 16645 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.378757 16694 ts_tablet_manager.cc:1434] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.001s
I20260709 12:25:39.395117 16694 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:39.380044 16423 raft_consensus.cc:2468] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 0.
I20260709 12:25:39.403263 17061 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.403949 17061 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.406100 17061 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.368598 16695 tablet_bootstrap.cc:654] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.409664 16614 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:39.411350 17129 raft_consensus.cc:2804] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.411731 17129 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.412034 17129 raft_consensus.cc:3060] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:39.413959 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 44517.9us
W20260709 12:25:39.451817 16540 leader_election.cc:343] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.458221 16694 tablet_bootstrap.cc:654] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.455581 16540 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:39.452823 16424 raft_consensus.cc:2468] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:39.459054 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:39.461615 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:39.447168 17084 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:39.463543 16391 leader_election.cc:343] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.462723 16992 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:39.473100 16391 leader_election.cc:343] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.487758 16540 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:39.464346 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.486917 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.500038 16992 raft_consensus.cc:2804] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:39.520426 16391 leader_election.cc:343] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.538286 16391 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
W20260709 12:25:39.537561 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:39.543864 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:39.544085 17133 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:25:39.544734 16645 raft_consensus.cc:2468] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:39.547312 16699 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:39.547883 16699 ts_tablet_manager.cc:1403] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.474s	user 0.012s	sys 0.012s
I20260709 12:25:39.550331 17076 raft_consensus.cc:2749] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:39.562036 16698 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:39.562664 16698 ts_tablet_manager.cc:1403] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.352s	user 0.026s	sys 0.021s
I20260709 12:25:39.523962 16646 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:39.529964 16992 raft_consensus.cc:697] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:39.575402 16322 catalog_manager.cc:5697] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.579088 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:39.580288 16391 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:39.581674 16695 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:39.586062 16695 ts_tablet_manager.cc:1403] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.339s	user 0.021s	sys 0.035s
I20260709 12:25:39.581358 16699 raft_consensus.cc:359] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.586841 16699 raft_consensus.cc:385] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.587198 16699 raft_consensus.cc:740] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
W20260709 12:25:39.601473 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 113795us
I20260709 12:25:39.604591 16699 consensus_queue.cc:260] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.597589 17061 raft_consensus.cc:2804] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:39.633132 17142 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.633826 17142 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.634223 17007 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:39.635572 17007 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.636530 17133 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:39.638574 16699 ts_tablet_manager.cc:1434] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.002s
I20260709 12:25:39.623260 16992 consensus_queue.cc:237] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.636284 17142 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.621618 17061 raft_consensus.cc:697] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:39.659566 17007 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:39.657243 16698 raft_consensus.cc:359] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.663223 16698 raft_consensus.cc:385] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.663574 16698 raft_consensus.cc:740] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
W20260709 12:25:39.668305 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 51034.5us
I20260709 12:25:39.674616 17061 consensus_queue.cc:237] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.669118 16698 consensus_queue.cc:260] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.680860 17141 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.681552 16540 leader_election.cc:343] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.681486 17141 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.683315 16466 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:39.684914 17084 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:39.685333 17084 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.685290 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:39.685973 17084 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.690358 17085 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.690964 17085 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.691654 16699 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:39.693101 17129 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.695452 17129 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.699491 17085 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:39.701599 16694 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:39.701398 16695 raft_consensus.cc:359] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.702220 16694 ts_tablet_manager.cc:1403] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.307s	user 0.022s	sys 0.014s
I20260709 12:25:39.702349 16695 raft_consensus.cc:385] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.702778 16695 raft_consensus.cc:740] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.701992 16698 ts_tablet_manager.cc:1434] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.005s
I20260709 12:25:39.705578 16698 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:39.707173 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.719375 16694 raft_consensus.cc:359] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.720224 16694 raft_consensus.cc:385] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.720515 16694 raft_consensus.cc:740] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.703534 16695 consensus_queue.cc:260] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.721349 16694 consensus_queue.cc:260] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.722954 16695 ts_tablet_manager.cc:1434] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.005s
I20260709 12:25:39.723264 16694 ts_tablet_manager.cc:1434] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:25:39.724185 16695 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:39.730406 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:39.761459 16423 raft_consensus.cc:3060] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.732700 16419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.763715 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:39.764393 17084 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.765751 16492 raft_consensus.cc:1240] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:25:39.766633 17084 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.724558 16694 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
W20260709 12:25:39.733769 16391 leader_election.cc:343] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.733794 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:39.768517 16391 leader_election.cc:343] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.760531 16420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.733652 17141 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.734143 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:39.768991 16391 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
W20260709 12:25:39.770453 16614 leader_election.cc:343] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.771880 16423 raft_consensus.cc:2468] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:39.772651 17076 raft_consensus.cc:2749] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:39.775770 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 90514.5us
I20260709 12:25:39.780324 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:39.781059 16646 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.740237 16699 tablet_bootstrap.cc:654] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:39.789557 16540 leader_election.cc:343] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.793118 17147 consensus_queue.cc:1059] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:39.794126 16992 raft_consensus.cc:3055] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:39.794550 16992 raft_consensus.cc:740] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:39.795832 16992 consensus_queue.cc:260] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.798341 16698 tablet_bootstrap.cc:654] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.800061 16646 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
W20260709 12:25:39.772158 16614 leader_election.cc:343] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.800863 16614 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:39.802284 17085 raft_consensus.cc:2749] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:39.811151 16992 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:39.814158 16614 leader_election.cc:343] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:39.808276 16541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 181898us
I20260709 12:25:39.820056 16466 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:39.821574 17151 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:39.822125 17151 raft_consensus.cc:697] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:39.823673 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.823047 17151 consensus_queue.cc:237] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.825522 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.826371 16649 raft_consensus.cc:2468] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:39.828132 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:39.836566 16694 tablet_bootstrap.cc:654] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.838891 16614 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:39.840497 17085 raft_consensus.cc:2804] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:39.841082 17085 raft_consensus.cc:697] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:39.841984 17085 consensus_queue.cc:237] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.843577 16541 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:39.849329 17133 raft_consensus.cc:2749] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.852264 16574 raft_consensus.cc:2410] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:25:39.862669 17151 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.874686 17151 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:39.873595 16541 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:39.877486 17133 raft_consensus.cc:2804] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.877900 17133 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.881313 16695 tablet_bootstrap.cc:654] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.880111 16322 catalog_manager.cc:5697] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.882254 17133 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.902190 16320 catalog_manager.cc:5697] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.903458 17133 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:39.941162 17065 consensus_queue.cc:1048] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:39.944207 16694 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:39.944849 16694 ts_tablet_manager.cc:1403] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.221s	user 0.012s	sys 0.013s
I20260709 12:25:39.948021 16694 raft_consensus.cc:359] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.949062 16694 raft_consensus.cc:385] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.949416 16694 raft_consensus.cc:740] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.954593 16694 consensus_queue.cc:260] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:39.958118 16495 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.959599 16694 ts_tablet_manager.cc:1434] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:25:39.961074 16694 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:39.967141 17133 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:39.967945 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:39.969134 16694 tablet_bootstrap.cc:654] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:39.970780 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.970856 16540 leader_election.cc:343] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.979012 16698 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:39.979655 16698 ts_tablet_manager.cc:1403] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.274s	user 0.011s	sys 0.026s
I20260709 12:25:39.979285 16320 catalog_manager.cc:5697] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.982596 16699 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:39.983196 16699 ts_tablet_manager.cc:1403] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.292s	user 0.024s	sys 0.020s
I20260709 12:25:39.985136 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:39.986611 17151 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:39.991943 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:39.988098 16699 raft_consensus.cc:359] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:39.992969 16699 raft_consensus.cc:385] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.993233 16699 raft_consensus.cc:740] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.996428 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:39.997133 16649 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.000438 16465 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:39.992458 16698 raft_consensus.cc:359] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.005610 16698 raft_consensus.cc:385] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.005996 16698 raft_consensus.cc:740] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.008939 16699 consensus_queue.cc:260] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.019534 16699 ts_tablet_manager.cc:1434] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:25:40.020569 16699 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:40.030445 17133 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.039964 16695 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:40.045467 16695 ts_tablet_manager.cc:1403] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.322s	user 0.009s	sys 0.014s
I20260709 12:25:40.040881 16698 consensus_queue.cc:260] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.037063 17133 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.055207 16320 catalog_manager.cc:5697] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 1 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.058145 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.059105 16646 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:40.061180 16541 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:40.061535 16695 raft_consensus.cc:359] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.062443 16695 raft_consensus.cc:385] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.062779 16695 raft_consensus.cc:740] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.063203 17148 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.063725 17148 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.064174 17148 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.063783 16695 consensus_queue.cc:260] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.065029 16649 raft_consensus.cc:2468] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:40.069002 16694 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:40.069602 16694 ts_tablet_manager.cc:1403] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.004s
I20260709 12:25:40.075165 17133 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.077726 16698 ts_tablet_manager.cc:1434] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.008s
I20260709 12:25:40.079041 16698 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: Bootstrap starting.
I20260709 12:25:40.079301 16694 raft_consensus.cc:359] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.080338 16694 raft_consensus.cc:385] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.079319 16420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:40.082897 16420 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:40.075224 16699 tablet_bootstrap.cc:654] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.096688 16694 raft_consensus.cc:740] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.109047 16694 consensus_queue.cc:260] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.126748 16694 ts_tablet_manager.cc:1434] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 12:25:40.127830 16694 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:40.130491 16695 ts_tablet_manager.cc:1434] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 12:25:40.134578 16541 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:40.142179 17150 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.142923 17150 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.149463 16698 tablet_bootstrap.cc:654] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.150606 16695 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:40.149463 16694 tablet_bootstrap.cc:654] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.158591 17077 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.159205 17077 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.162261 17147 raft_consensus.cc:2804] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.162933 17147 raft_consensus.cc:697] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:40.165297 17150 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:40.165467 17130 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.167891 17130 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.163861 17147 consensus_queue.cc:237] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:40.170323 17130 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.173851 16695 tablet_bootstrap.cc:654] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.181161 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.182027 16647 raft_consensus.cc:2468] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:40.182983 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:40.183758 16570 raft_consensus.cc:2468] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 0.
I20260709 12:25:40.185263 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:40.187958 16574 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.196069 16391 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:40.202824 16391 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:40.205925 17142 raft_consensus.cc:2804] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.206408 17142 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.206779 17142 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.205042 17076 raft_consensus.cc:2804] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.156242 17148 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.216281 17084 raft_consensus.cc:2749] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.217011 17148 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.227885 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:40.229099 16424 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.236204 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.237615 16649 raft_consensus.cc:2393] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
I20260709 12:25:40.237730 16699 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:40.238584 16699 ts_tablet_manager.cc:1403] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.005s
I20260709 12:25:40.249383 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:25:40.214442 16390 leader_election.cc:343] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.214305 17076 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.288049 16699 raft_consensus.cc:359] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.288959 16699 raft_consensus.cc:385] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.289249 16699 raft_consensus.cc:740] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.274420 17077 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:40.280498 17076 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.307920 16424 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:40.313325 16694 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:40.313925 16694 ts_tablet_manager.cc:1403] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.186s	user 0.027s	sys 0.045s
I20260709 12:25:40.323427 16694 raft_consensus.cc:359] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:25:40.296190 16390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 83937.6us
I20260709 12:25:40.329885 16540 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:40.324043 16694 raft_consensus.cc:385] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.330978 16694 raft_consensus.cc:740] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.331724 16694 consensus_queue.cc:260] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:40.334625 16699 consensus_queue.cc:260] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:40.337116 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 94690.8us
I20260709 12:25:40.339352 16694 ts_tablet_manager.cc:1434] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:25:40.343031 16695 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: No bootstrap required, opened a new log
I20260709 12:25:40.343654 16695 ts_tablet_manager.cc:1403] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.049s
I20260709 12:25:40.345606 16699 ts_tablet_manager.cc:1434] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 12:25:40.346529 16541 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:40.332545 17130 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.362907 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:40.363104 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:40.363672 16649 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.365450 17130 raft_consensus.cc:697] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:40.366438 17130 consensus_queue.cc:237] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.368016 16699 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:40.353302 17142 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.374428 16695 raft_consensus.cc:359] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.375193 16695 raft_consensus.cc:385] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.375447 16695 raft_consensus.cc:740] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.379868 17076 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.381587 16694 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: Bootstrap starting.
I20260709 12:25:40.382352 17142 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:40.385413 16570 raft_consensus.cc:1275] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:25:40.385859 16570 pending_rounds.cc:85] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Aborting all ops after (but not including) 0
I20260709 12:25:40.376085 16695 consensus_queue.cc:260] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.383203 17148 raft_consensus.cc:2749] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.386101 16570 pending_rounds.cc:107] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:40.386457 16570 raft_consensus.cc:2889] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:40.388384 16695 ts_tablet_manager.cc:1434] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:25:40.372107 16649 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
W20260709 12:25:40.405448 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 49360.9us
I20260709 12:25:40.408362 16321 catalog_manager.cc:5697] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.417217 16698 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: No bootstrap required, opened a new log
I20260709 12:25:40.417863 16698 ts_tablet_manager.cc:1403] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent bootstrapping tablet: real 0.339s	user 0.024s	sys 0.036s
I20260709 12:25:40.381616 17068 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.388684 17084 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 12:25:40.438045 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:25:40.426581 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 79177us
W20260709 12:25:40.454741 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:40.425927 17133 consensus_queue.cc:1048] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:25:40.432463 17077 consensus_queue.cc:1048] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:40.435442 17068 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.463421 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:40.464035 16694 tablet_bootstrap.cc:654] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.467326 17076 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:40.470196 16698 raft_consensus.cc:359] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.485121 16698 raft_consensus.cc:385] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:40.473822 16390 leader_election.cc:343] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.474666 16699 tablet_bootstrap.cc:654] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.485615 16698 raft_consensus.cc:740] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.489127 16647 raft_consensus.cc:1275] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:40.492255 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:40.492991 16649 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.493518 16698 consensus_queue.cc:260] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.495388 17151 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:40.497043 16498 raft_consensus.cc:3060] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:40.498577 17171 log.cc:927] Time spent T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:40.486758 17174 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.501696 16390 leader_election.cc:343] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.501906 17174 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.508220 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.508406 16496 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.509209 17142 consensus_queue.cc:1048] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.487092 16570 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.531719 16698 ts_tablet_manager.cc:1434] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 12:25:40.570325 16649 raft_consensus.cc:2468] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
W20260709 12:25:40.571357 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 81886.5us
I20260709 12:25:40.581616 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:40.599426 16992 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.599622 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:40.599946 16901 consensus_queue.cc:1048] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:40.600102 16992 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.599687 16419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:40.602407 16992 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.605858 16465 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:40.619983 16321 catalog_manager.cc:5697] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.611222 16391 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:40.630088 17173 raft_consensus.cc:2804] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.630646 17173 raft_consensus.cc:697] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
W20260709 12:25:40.630844 16390 leader_election.cc:343] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.631580 17173 consensus_queue.cc:237] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:40.634974 16423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:40.635696 16423 raft_consensus.cc:2468] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:40.649804 16540 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:40.649958 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.651609 16649 raft_consensus.cc:2468] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:40.639706 17068 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:40.639128 17130 consensus_queue.cc:1048] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:25:40.685307 17134 raft_consensus.cc:2749] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.655064 17071 raft_consensus.cc:2804] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.687053 17071 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.687486 17071 raft_consensus.cc:3060] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.682314 16999 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.660977 17174 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.696332 16699 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:40.689174 16999 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.698474 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:40.699487 16999 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:40.699852 17148 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.700452 17148 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:40.702519 17148 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:40.710035 16699 ts_tablet_manager.cc:1403] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.342s	user 0.019s	sys 0.011s
I20260709 12:25:40.709177 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:40.719923 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:40.720707 16646 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
I20260709 12:25:40.723465 16541 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:40.730273 17133 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.730800 17133 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.731228 17133 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.745800 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:40.720702 16570 raft_consensus.cc:2468] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:25:40.770280 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:40.772497 16540 leader_election.cc:343] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:40.774341 16391 leader_election.cc:343] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:40.775134 16390 leader_election.cc:343] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.775599 16390 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:40.776417 17142 raft_consensus.cc:2749] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.782824 16694 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: No bootstrap required, opened a new log
I20260709 12:25:40.783521 16694 ts_tablet_manager.cc:1403] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: Time spent bootstrapping tablet: real 0.402s	user 0.013s	sys 0.009s
I20260709 12:25:40.787060 16694 raft_consensus.cc:359] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.787938 16694 raft_consensus.cc:385] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.788266 16694 raft_consensus.cc:740] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.789152 16694 consensus_queue.cc:260] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.791162 17148 consensus_queue.cc:1048] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.793556 16694 ts_tablet_manager.cc:1434] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
W20260709 12:25:40.795682 16371 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:40.804384 17133 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:40.807302 16391 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:40.817785 16699 raft_consensus.cc:359] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.818818 16699 raft_consensus.cc:385] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.819144 16699 raft_consensus.cc:740] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.822989 16699 consensus_queue.cc:260] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.841164 17071 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:40.843719 17071 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:40.816859 17142 raft_consensus.cc:2804] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.848184 17142 raft_consensus.cc:697] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:40.840490 17133 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:40.849730 17142 consensus_queue.cc:237] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:40.867918 16466 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:40.873131 17186 log.cc:927] Time spent T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 12:25:40.883795 17084 raft_consensus.cc:2749] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.887363 16699 ts_tablet_manager.cc:1434] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.177s	user 0.003s	sys 0.006s
W20260709 12:25:40.881278 17191 log.cc:927] Time spent T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.076s	user 0.001s	sys 0.002s
I20260709 12:25:40.898836 16699 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:40.930758 16699 tablet_bootstrap.cc:654] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:40.937038 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 112420us
W20260709 12:25:40.945127 16540 consensus_peers.cc:597] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:40.962401 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 128673us
I20260709 12:25:40.965334 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:40.998957 16421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:41.009121 16421 raft_consensus.cc:3060] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:41.059692 16540 leader_election.cc:343] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:41.114854 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 91114.5us
I20260709 12:25:41.114679 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:41.146667 17176 log.cc:927] Time spent T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:41.139014 16645 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.144724 17151 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.185281 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:41.186076 16643 raft_consensus.cc:3060] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.176909 17151 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:41.185953 16421 raft_consensus.cc:2468] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:41.189009 17151 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:25:41.191041 16391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 51790.9us
I20260709 12:25:41.201161 16699 tablet_bootstrap.cc:492] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:41.201668 16699 ts_tablet_manager.cc:1403] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.303s	user 0.015s	sys 0.011s
W20260709 12:25:41.206652 17198 log.cc:927] Time spent T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:25:41.207233 16424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:41.253795 17204 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.254478 17204 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:41.259219 16699 raft_consensus.cc:359] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:41.260061 16699 raft_consensus.cc:385] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.260354 16699 raft_consensus.cc:740] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.239063 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:41.314827 16572 raft_consensus.cc:2393] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 1: Already voted for candidate a8133a8f49724a8897d8bc4f718d802d in this term.
I20260709 12:25:41.315649 16540 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:41.317142 17130 raft_consensus.cc:2804] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.317674 17130 raft_consensus.cc:697] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:41.318591 17130 consensus_queue.cc:237] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:41.320963 17203 consensus_queue.cc:1048] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.324681 16420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:41.325493 16420 raft_consensus.cc:2468] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 0.
W20260709 12:25:41.298362 16390 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.328380 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:41.303877 17200 log.cc:927] Time spent T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.293s	user 0.003s	sys 0.004s
W20260709 12:25:41.295907 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 43723.5us
I20260709 12:25:41.333621 16466 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:41.313093 17204 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:41.287760 16645 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:41.339057 17185 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.293210 16699 consensus_queue.cc:260] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:41.347442 16699 ts_tablet_manager.cc:1434] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.001s
I20260709 12:25:41.351191 16643 raft_consensus.cc:2468] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:41.362568 16540 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:41.363988 16541 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:41.365496 17141 raft_consensus.cc:2804] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.365883 17141 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.366089 17207 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.366230 17141 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.367290 17207 raft_consensus.cc:697] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:41.368165 17207 consensus_queue.cc:237] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:41.376757 16322 catalog_manager.cc:5697] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.387665 16699 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:41.397610 17208 consensus_queue.cc:1048] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.401481 16699 tablet_bootstrap.cc:654] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.402393 17141 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:41.377763 17185 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.422297 16499 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:41.452301 16540 leader_election.cc:343] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.492358 17214 consensus_queue.cc:1048] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:41.522060 17141 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:41.553939 16699 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:41.554737 16699 ts_tablet_manager.cc:1403] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.013s
I20260709 12:25:41.536600 17142 consensus_queue.cc:1048] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:25:41.587116 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:41.588007 16425 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.589252 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:41.563727 17061 consensus_queue.cc:1048] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
W20260709 12:25:41.592136 16540 leader_election.cc:343] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.597913 16699 raft_consensus.cc:359] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:41.598713 16699 raft_consensus.cc:385] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.599020 16699 raft_consensus.cc:740] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.604460 16425 raft_consensus.cc:2468] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:41.604869 16699 consensus_queue.cc:260] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:41.617851 16540 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:41.621105 16699 ts_tablet_manager.cc:1434] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 12:25:41.624804 17216 raft_consensus.cc:2804] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.625439 17216 raft_consensus.cc:697] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:41.626448 17216 consensus_queue.cc:237] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:41.641314 16699 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:41.714143 16318 catalog_manager.cc:5697] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.715428 16318 catalog_manager.cc:5697] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.716727 16699 tablet_bootstrap.cc:654] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.733731 16322 catalog_manager.cc:5697] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 0 to 1, leader changed from <none> to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 1 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } }
I20260709 12:25:41.742964 16699 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:41.743631 16699 ts_tablet_manager.cc:1403] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.008s
I20260709 12:25:41.746681 16699 raft_consensus.cc:359] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:41.747201 16499 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.747464 16699 raft_consensus.cc:385] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.747933 16699 raft_consensus.cc:740] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.748694 16699 consensus_queue.cc:260] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:41.758513 16699 ts_tablet_manager.cc:1434] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:25:41.766109 17068 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.766781 17068 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:41.769680 16699 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:41.769134 16321 catalog_manager.cc:5697] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 1 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.770931 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:41.774554 16422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:41.777530 16465 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:41.778574 17134 raft_consensus.cc:2749] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.783002 17068 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:41.779345 16699 tablet_bootstrap.cc:654] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.818867 16699 tablet_bootstrap.cc:492] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:41.820274 16699 ts_tablet_manager.cc:1403] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.023s
I20260709 12:25:41.826225 17207 consensus_queue.cc:1048] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.835218 17148 consensus_queue.cc:1048] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.844913 16699 raft_consensus.cc:359] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:41.846582 16499 raft_consensus.cc:3060] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.845860 16699 raft_consensus.cc:385] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.850049 16699 raft_consensus.cc:740] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.856607 16699 consensus_queue.cc:260] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:41.859357 17148 consensus_queue.cc:1048] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.864583 16699 ts_tablet_manager.cc:1434] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:25:41.866024 16699 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: Bootstrap starting.
I20260709 12:25:41.880084 16699 tablet_bootstrap.cc:654] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.975282 16499 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.999995 16699 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: No bootstrap required, opened a new log
I20260709 12:25:42.000648 16699 ts_tablet_manager.cc:1403] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: Time spent bootstrapping tablet: real 0.135s	user 0.026s	sys 0.017s
I20260709 12:25:42.000957 17147 consensus_queue.cc:1048] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.003677 16699 raft_consensus.cc:359] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:42.004506 16699 raft_consensus.cc:385] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.004810 16699 raft_consensus.cc:740] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.005571 16699 consensus_queue.cc:260] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:42.009228 16699 ts_tablet_manager.cc:1434] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:42.031963 17207 consensus_queue.cc:1048] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.051174 16499 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.061102 17207 consensus_queue.cc:1048] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.438843  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:25:42.454455 16465 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:25:42.459502 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.469537 16465 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.494592 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.496822 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.500029  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:42.501142  6874 tablet_replica.cc:333] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.501981  6874 raft_consensus.cc:2243] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.502559 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.502841  6874 raft_consensus.cc:2272] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.505334  6874 tablet_replica.cc:333] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.506008  6874 raft_consensus.cc:2243] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.506815  6874 raft_consensus.cc:2272] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.509509  6874 tablet_replica.cc:333] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.510140  6874 raft_consensus.cc:2243] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.510618  6874 raft_consensus.cc:2272] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.513126  6874 tablet_replica.cc:333] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.514092  6874 raft_consensus.cc:2243] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.515120  6874 raft_consensus.cc:2272] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.517840  6874 tablet_replica.cc:333] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.518666  6874 raft_consensus.cc:2243] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.519752  6874 raft_consensus.cc:2272] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.521384 16614 consensus_peers.cc:597] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.522490  6874 tablet_replica.cc:333] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.523413  6874 raft_consensus.cc:2243] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.524387  6874 raft_consensus.cc:2272] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.526998  6874 tablet_replica.cc:333] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.527793  6874 raft_consensus.cc:2243] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.528714  6874 raft_consensus.cc:2272] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.531404  6874 tablet_replica.cc:333] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.532246  6874 raft_consensus.cc:2243] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.533123  6874 raft_consensus.cc:2272] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.535864  6874 tablet_replica.cc:333] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.536793  6874 raft_consensus.cc:2243] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.537294  6874 raft_consensus.cc:2272] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.538379 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.539669  6874 tablet_replica.cc:333] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.540396  6874 raft_consensus.cc:2243] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.540881  6874 raft_consensus.cc:2272] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.543227  6874 tablet_replica.cc:333] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.543845  6874 raft_consensus.cc:2243] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.544317  6874 raft_consensus.cc:2272] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.546963  6874 tablet_replica.cc:333] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.547835  6874 raft_consensus.cc:2243] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.548399  6874 raft_consensus.cc:2272] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.551380  6874 tablet_replica.cc:333] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.552320  6874 raft_consensus.cc:2243] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.552923  6874 raft_consensus.cc:2272] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.553365 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.555730  6874 tablet_replica.cc:333] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.556708  6874 raft_consensus.cc:2243] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.557844  6874 raft_consensus.cc:2272] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.561058  6874 tablet_replica.cc:333] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
W20260709 12:25:42.561715 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.562007  6874 raft_consensus.cc:2243] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.562757  6874 raft_consensus.cc:2272] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.565775  6874 tablet_replica.cc:333] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.566421  6874 raft_consensus.cc:2243] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.567309  6874 raft_consensus.cc:2272] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.570191  6874 tablet_replica.cc:333] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.571005  6874 raft_consensus.cc:2243] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.571599  6874 raft_consensus.cc:2272] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.574237  6874 tablet_replica.cc:333] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.575050  6874 raft_consensus.cc:2243] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.575533  6874 raft_consensus.cc:2272] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.578034  6874 tablet_replica.cc:333] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.578841  6874 raft_consensus.cc:2243] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.579406  6874 raft_consensus.cc:2272] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.580705 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.582384  6874 tablet_replica.cc:333] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.583367  6874 raft_consensus.cc:2243] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.584439  6874 raft_consensus.cc:2272] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.587249  6874 tablet_replica.cc:333] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.588016  6874 raft_consensus.cc:2243] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.588555  6874 raft_consensus.cc:2272] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.591508  6874 tablet_replica.cc:333] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.592519  6874 raft_consensus.cc:2243] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.593724  6874 raft_consensus.cc:2272] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.594233 16540 consensus_peers.cc:597] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.596702  6874 tablet_replica.cc:333] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
W20260709 12:25:42.597090 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.597699  6874 raft_consensus.cc:2243] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.598192  6874 raft_consensus.cc:2272] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.600281  6874 tablet_replica.cc:333] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.600920  6874 raft_consensus.cc:2243] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.601445  6874 raft_consensus.cc:2272] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.603529  6874 tablet_replica.cc:333] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.604105  6874 raft_consensus.cc:2243] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.604539  6874 raft_consensus.cc:2272] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.606033 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.606822  6874 tablet_replica.cc:333] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.607540  6874 raft_consensus.cc:2243] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.607967  6874 raft_consensus.cc:2272] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.610687  6874 tablet_replica.cc:333] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.611502  6874 raft_consensus.cc:2243] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.612107  6874 raft_consensus.cc:2272] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.612509 16540 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.614485  6874 tablet_replica.cc:333] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.615130  6874 raft_consensus.cc:2243] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.615924  6874 raft_consensus.cc:2272] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.618546  6874 tablet_replica.cc:333] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.619151  6874 raft_consensus.cc:2243] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.619645  6874 raft_consensus.cc:2272] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.622140  6874 tablet_replica.cc:333] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.622916  6874 raft_consensus.cc:2243] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.623569  6874 raft_consensus.cc:2272] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.625944  6874 tablet_replica.cc:333] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.626523  6874 raft_consensus.cc:2243] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.626940  6874 raft_consensus.cc:2272] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.629530  6874 tablet_replica.cc:333] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.630107  6874 raft_consensus.cc:2243] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.630550  6874 raft_consensus.cc:2272] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.632750  6874 tablet_replica.cc:333] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.633541  6874 raft_consensus.cc:2243] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.634078  6874 raft_consensus.cc:2272] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.636955  6874 tablet_replica.cc:333] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
W20260709 12:25:42.637537 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.637763  6874 raft_consensus.cc:2243] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.638329  6874 raft_consensus.cc:2272] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.640211  6874 tablet_replica.cc:333] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.640864  6874 raft_consensus.cc:2243] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.641284  6874 raft_consensus.cc:2272] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.643582  6874 tablet_replica.cc:333] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.644188  6874 raft_consensus.cc:2243] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.644685  6874 raft_consensus.cc:2272] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.646747  6874 tablet_replica.cc:333] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.647295  6874 raft_consensus.cc:2243] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.648094  6874 raft_consensus.cc:2272] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.650369  6874 tablet_replica.cc:333] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.651099  6874 raft_consensus.cc:2243] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.651650  6874 raft_consensus.cc:2272] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.653880  6874 tablet_replica.cc:333] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.654568  6874 raft_consensus.cc:2243] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.655050  6874 raft_consensus.cc:2272] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.659075  6874 tablet_replica.cc:333] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.667019  6874 raft_consensus.cc:2243] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:42.668469  6874 raft_consensus.cc:2272] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.671731  6874 tablet_replica.cc:333] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.672569  6874 raft_consensus.cc:2243] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:42.673094 16614 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.673786  6874 raft_consensus.cc:2272] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.674460 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.676669  6874 tablet_replica.cc:333] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.677350  6874 raft_consensus.cc:2243] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.677888  6874 raft_consensus.cc:2272] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.680562  6874 tablet_replica.cc:333] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.681430  6874 raft_consensus.cc:2243] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.682042  6874 raft_consensus.cc:2272] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.684870  6874 tablet_replica.cc:333] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
I20260709 12:25:42.685524  6874 raft_consensus.cc:2243] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.685995  6874 raft_consensus.cc:2272] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.688746  6874 tablet_replica.cc:333] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: stopping tablet replica
W20260709 12:25:42.688899 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.689502  6874 raft_consensus.cc:2243] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.690284  6874 raft_consensus.cc:2272] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:42.716348 16540 consensus_peers.cc:597] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.733727 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.768499  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
W20260709 12:25:42.770908 16614 consensus_peers.cc:597] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.788897 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.850927  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:42.858029 17252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:42.859851 17255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:42.859985 17253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:42.861624  6874 server_base.cc:1061] running on GCE node
I20260709 12:25:42.867622  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:42.867960  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:42.868218  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599942868197 us; error 0 us; skew 500 ppm
I20260709 12:25:42.869071  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:25:42.876559 16540 consensus_peers.cc:597] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.880257  6874 webserver.cc:533] Webserver started at http://127.6.182.129:42693/ using document root <none> and password file <none>
W20260709 12:25:42.880398 16540 consensus_peers.cc:597] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.881233  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:42.881487  6874 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:25:42.882273 16465 consensus_peers.cc:597] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.885319  6874 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
W20260709 12:25:42.894250 16465 consensus_peers.cc:597] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.894770 17262 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.895787  6874 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:42.896174  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "a8133a8f49724a8897d8bc4f718d802d"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-lgtn"
I20260709 12:25:42.896744  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:25:42.923439 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.931533  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:42.933223  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:42.934827  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:42.939528 17269 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:25:42.946245 16540 consensus_peers.cc:597] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:42.951210 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:43.022185 16614 consensus_peers.cc:597] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:43.238813  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:25:43.239264  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.301s	user 0.008s	sys 0.001s
I20260709 12:25:43.239607  6874 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:25:43.244424 17269 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.256692 17269 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.257485 17269 tablet_bootstrap.cc:492] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.258109 17269 ts_tablet_manager.cc:1403] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:25:43.260131 17269 raft_consensus.cc:359] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.260684 17269 raft_consensus.cc:740] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.261294 17269 consensus_queue.cc:260] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.264127 17269 ts_tablet_manager.cc:1434] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:43.264954 17269 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.279165 17269 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.280145 17269 tablet_bootstrap.cc:492] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.280808 17269 ts_tablet_manager.cc:1403] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:25:43.283234 17269 raft_consensus.cc:359] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.283877 17269 raft_consensus.cc:740] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.284505 17269 consensus_queue.cc:260] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.286270 17269 ts_tablet_manager.cc:1434] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:43.287067 17269 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.300609 17269 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.301492 17269 tablet_bootstrap.cc:492] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.302027 17269 ts_tablet_manager.cc:1403] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:25:43.303845 17269 raft_consensus.cc:359] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.304371 17269 raft_consensus.cc:740] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.305083 17269 consensus_queue.cc:260] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.306876 17269 ts_tablet_manager.cc:1434] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:43.307647 17269 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.323177 17269 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.324239 17269 tablet_bootstrap.cc:492] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.325467 17269 ts_tablet_manager.cc:1403] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:25:43.329955 17269 raft_consensus.cc:359] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.330682 17269 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.331631 17269 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.334136 17269 ts_tablet_manager.cc:1434] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:43.334976 17269 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.405048 17269 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.409462 17269 tablet_bootstrap.cc:492] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.410219 17269 ts_tablet_manager.cc:1403] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.075s	user 0.024s	sys 0.024s
I20260709 12:25:43.412873 17269 raft_consensus.cc:359] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.413647 17269 raft_consensus.cc:740] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.414649 17269 consensus_queue.cc:260] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.416898 17269 ts_tablet_manager.cc:1434] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:43.417922 17269 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.445335 17269 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.446334 17269 tablet_bootstrap.cc:492] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.447036 17269 ts_tablet_manager.cc:1403] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:25:43.449528 17269 raft_consensus.cc:359] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.450199 17269 raft_consensus.cc:740] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.450994 17269 consensus_queue.cc:260] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.453171 17269 ts_tablet_manager.cc:1434] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:25:43.453965 17269 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.477265 17269 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.478055 17269 tablet_bootstrap.cc:492] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.478591 17269 ts_tablet_manager.cc:1403] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.002s
I20260709 12:25:43.480480 17269 raft_consensus.cc:359] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.481118 17269 raft_consensus.cc:740] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.481806 17269 consensus_queue.cc:260] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.483852 17269 ts_tablet_manager.cc:1434] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:43.484673 17269 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.497357 17269 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.498221 17269 tablet_bootstrap.cc:492] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.498800 17269 ts_tablet_manager.cc:1403] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:25:43.500996 17269 raft_consensus.cc:359] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.501314  6874 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:25:43.501754  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.262s	user 0.247s	sys 0.013s
I20260709 12:25:43.501550 17269 raft_consensus.cc:740] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.502483 17269 consensus_queue.cc:260] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.505013 17269 ts_tablet_manager.cc:1434] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:43.505899 17269 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.547842 17147 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.548749 17147 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.553254 17209 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.568060 17250 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.568951 17250 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.594702 17269 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.595811 17269 tablet_bootstrap.cc:492] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.596599 17269 ts_tablet_manager.cc:1403] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.091s	user 0.055s	sys 0.032s
I20260709 12:25:43.598465 17147 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.599377 17269 raft_consensus.cc:359] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.554205 17209 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.601100 17273 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.601797 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.600191 17269 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.602530 16645 raft_consensus.cc:2468] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:43.603685 17269 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.621692 17269 ts_tablet_manager.cc:1434] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 12:25:43.622570 17269 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.624246 17272 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.611299 17275 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.625614 17275 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.625209 17272 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.627754 17275 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.614360 17274 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.628836 17274 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.630996 17274 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.618564 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:43.617442 16540 leader_election.cc:336] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.602221 17273 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.639670 17147 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.640184 17147 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.641022 17273 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.641608 16541 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.642508 17147 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.642668 17273 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.643151 17147 raft_consensus.cc:2804] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.643636 17147 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.603754 17250 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:43.644030 17147 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.644585 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.642537 17209 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.648945 17250 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.649509 17250 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:43.650930 16465 leader_election.cc:336] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.651469 16465 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.652022 17250 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.653307 17250 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.643195 17273 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.660926 17273 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.663141 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.663884 16645 raft_consensus.cc:2468] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:43.674098 16466 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.675493 17134 raft_consensus.cc:2804] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.676002 17134 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.676391 17134 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.676213 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:43.631143 17272 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.633354 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:43.677948 16540 leader_election.cc:336] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.678632 16540 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.685814 17148 raft_consensus.cc:2749] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.685880 17134 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.688894 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:43.689545 16645 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.692591 17250 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.693646 17250 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.697166 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:43.697548 16645 raft_consensus.cc:2468] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:43.699182 16466 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.699363 17273 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.700156 17273 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.700368 17134 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.703509 17273 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.700357 17270 raft_consensus.cc:2804] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.704696 17270 raft_consensus.cc:697] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:43.705806 17147 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.705967 17270 consensus_queue.cc:237] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.707477 16572 raft_consensus.cc:2393] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:25:43.710055 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:43.710997 16570 raft_consensus.cc:2468] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:43.712563 17272 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.713389 17272 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.713768 16615 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.715140 17209 raft_consensus.cc:2804] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.715708 17209 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.716279 17209 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.724108 17250 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:25:43.724474 16465 leader_election.cc:336] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.730022 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:43.730712 16645 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.730898 17269 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.731897 17269 tablet_bootstrap.cc:492] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.732550 17269 ts_tablet_manager.cc:1403] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.110s	user 0.043s	sys 0.043s
I20260709 12:25:43.735338 17269 raft_consensus.cc:359] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.736011 17269 raft_consensus.cc:740] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.736083 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.738969 17269 consensus_queue.cc:260] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.740141 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.741307 17269 ts_tablet_manager.cc:1434] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:43.742266 17269 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.740547 16645 raft_consensus.cc:2468] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:25:43.741067 16499 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:43.744895 17147 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.746241 16541 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.747681 17207 raft_consensus.cc:2804] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.748267 17148 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.748782 17148 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.750815 17148 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.752365 17207 raft_consensus.cc:697] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
W20260709 12:25:43.752674 16465 leader_election.cc:336] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.753150 16465 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:43.754113 16465 leader_election.cc:336] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.753432 17207 consensus_queue.cc:237] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.754804 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.755134 17134 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.755720 17134 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.758001 17134 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.758502 17134 raft_consensus.cc:2749] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.758493 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.716187 17272 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.758493 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.762771 17147 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.763407 17147 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.766568 17273 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.767207 17273 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:43.767915 16540 leader_election.cc:336] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:43.768946 16465 leader_election.cc:336] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.770255 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:43.771001 16569 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:43.772029 16615 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.773451 17273 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.773975 17273 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.774276 17273 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.774608 17273 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.779194 16321 catalog_manager.cc:5697] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.781179 16318 catalog_manager.cc:5697] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 2 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.786017 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.791644 17209 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.793439 17273 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.794893 16643 raft_consensus.cc:2393] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 2: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:43.794802 17297 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.797334 17269 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.802096 17269 tablet_bootstrap.cc:492] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.802541 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.803018 17147 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.803052 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:43.803755 17273 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.803834 16569 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.795534 17297 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.762404 16645 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:43.806708 17297 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.808034 17269 ts_tablet_manager.cc:1403] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.016s
I20260709 12:25:43.814798 16466 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.815488 16569 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:43.815902 17270 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.816354 17270 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.816741 17270 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.816826 17269 raft_consensus.cc:359] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.817670 17269 raft_consensus.cc:740] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.809609 17209 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.818828 17269 consensus_queue.cc:260] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.810453 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:43.821166 16570 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.821398 17269 ts_tablet_manager.cc:1434] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:43.822299 17269 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:43.824102 16614 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.824901 17250 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.824992 17209 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.825075 16615 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.825621 17209 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.825515 17250 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.826224 17209 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.826151 17292 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.829048 17292 raft_consensus.cc:697] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:43.829903 17292 consensus_queue.cc:237] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.831061 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.834071 16570 raft_consensus.cc:2468] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:43.833717 16645 raft_consensus.cc:2468] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
W20260709 12:25:43.833024 16614 leader_election.cc:336] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.835280 16614 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.835652 16466 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.836071 17273 raft_consensus.cc:2749] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.836542 17134 raft_consensus.cc:2804] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.837041 17134 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
W20260709 12:25:43.836711 16614 leader_election.cc:336] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.837589 17134 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:43.838488 16614 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.843482 16614 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.844974 17273 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:43.845168 16614 leader_election.cc:336] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.846936 16614 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.848225 17273 raft_consensus.cc:2749] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.845034 16615 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
W20260709 12:25:43.848420 16614 leader_election.cc:336] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:43.838514 16540 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.850580 16540 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.849695 17274 raft_consensus.cc:2804] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.851125 16614 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.851295 17274 raft_consensus.cc:697] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:43.851879 17297 raft_consensus.cc:2749] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.839150 17209 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:43.853729 16614 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.853739 17274 consensus_queue.cc:237] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.855350 16614 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.855824 17209 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.858961 17292 raft_consensus.cc:2749] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.861742 17209 raft_consensus.cc:2749] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.859043 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:43.862826 16614 leader_election.cc:336] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.863977 16495 raft_consensus.cc:2468] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
W20260709 12:25:43.865023 16614 leader_election.cc:336] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.866150 16614 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.866806 16320 catalog_manager.cc:5697] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.868660 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:43.868672 17209 raft_consensus.cc:2749] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.869688 17134 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.852226 17270 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:43.881131 16540 leader_election.cc:336] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.882804 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:43.883770 16645 raft_consensus.cc:2393] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 2: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:25:43.888324 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:25:43.888679 16540 leader_election.cc:336] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.889264 16645 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.894398 16540 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.895263 17148 raft_consensus.cc:2804] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.895653 17148 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.896023 17148 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.900359 17250 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.903501 16540 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:43.905089 17297 raft_consensus.cc:2749] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:43.906065 17270 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.906724 17270 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.908385 17270 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.909540 17134 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.910547 17270 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:43.911962 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:43.912739 16569 raft_consensus.cc:2468] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:43.914126 16466 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.915159 17311 raft_consensus.cc:2804] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.915548 17311 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.908589 16645 raft_consensus.cc:2468] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:43.917667 16466 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.913442 17148 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.919279 17134 raft_consensus.cc:2804] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.922024 17134 raft_consensus.cc:697] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:43.923792 17134 consensus_queue.cc:237] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.920370 17148 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
W20260709 12:25:43.927879 16465 leader_election.cc:336] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.929368 17303 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.915985 17311 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.935014 17303 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:43.938920 17303 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:43.940135 17317 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.940786 17317 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.942883 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:43.943703 16499 raft_consensus.cc:2393] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:43.946264 17269 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:43.947125 17303 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.947933 17303 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.950479 17303 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.950855 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.951530 16645 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:25:43.952329 17317 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.952597 16541 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:43.953483 17303 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.953876 17303 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.954420 17303 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.955505 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.956175 16647 raft_consensus.cc:2468] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:43.957875 16466 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.957301 16320 catalog_manager.cc:5697] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.959192 17270 raft_consensus.cc:2804] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:43.959616 17270 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.960024 17270 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.961268 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:43.961917 16499 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.965926 16318 catalog_manager.cc:5697] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.969774 16499 raft_consensus.cc:2468] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:25:43.969902 17270 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.972890 17134 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.974095 17314 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.974730 17314 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.974742 17269 tablet_bootstrap.cc:492] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:43.977824 17314 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.979808 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.980301 17269 ts_tablet_manager.cc:1403] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.000s
I20260709 12:25:43.981487 17270 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.982666 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:43.983312 16647 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.983816 17303 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:43.979104 16614 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.973598 17134 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:43.989176 17303 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:43.989730 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:43.991007 16643 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.984587 17269 raft_consensus.cc:359] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.991709 17269 raft_consensus.cc:740] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.988250 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:43.998319 16645 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:43.988435 17317 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:43.999552 16466 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:43.987051 17134 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:25:43.977878 16540 leader_election.cc:336] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.001724 16647 raft_consensus.cc:2468] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:44.000551 17270 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:44.002441 17270 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.004099 17270 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.004290 17297 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.004984 17297 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.005720 17269 consensus_queue.cc:260] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.008097 17269 ts_tablet_manager.cc:1434] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:25:44.008028 17297 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:44.009255 17269 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
W20260709 12:25:44.012943 16540 leader_election.cc:336] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.013857 16540 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.017593 17303 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.018244 17303 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.021624 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:44.022069 16540 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.022209 17303 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:44.028009 16643 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
W20260709 12:25:43.998827 16465 leader_election.cc:336] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.034168 16540 leader_election.cc:336] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.034437 16465 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:25:44.035441 16465 leader_election.cc:336] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.036105 16465 leader_election.cc:336] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:43.999759 17317 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.038424 17317 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:44.038918 17317 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:25:43.985563 16614 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.039666 16540 leader_election.cc:336] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.040057 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 54520.2us
W20260709 12:25:44.040654 16614 leader_election.cc:336] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.040398 16540 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.003405 16466 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:44.047071 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:44.047750 16570 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:25:44.047847 17134 raft_consensus.cc:2804] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.049656 16466 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:44.052063 17314 raft_consensus.cc:2804] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:44.052593 17314 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.053166 17314 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.048435 17134 raft_consensus.cc:697] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:44.059206 17134 consensus_queue.cc:237] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.064184 16540 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.065604 17297 raft_consensus.cc:2804] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.067227 17209 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.066345 17297 raft_consensus.cc:697] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:44.067816 17209 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.069145 17297 consensus_queue.cc:237] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.070274 17209 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:44.072257 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.073009 16495 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
W20260709 12:25:44.075178 16614 leader_election.cc:336] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.076233 16614 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.076965 17272 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.077629 17274 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.081329 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.082032 16497 raft_consensus.cc:2468] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
W20260709 12:25:44.082424 16465 leader_election.cc:336] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.083765 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.042927 17303 raft_consensus.cc:2749] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.077445 17272 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:43.986755 17311 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.086124 17272 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:44.087108 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:44.087909 16570 raft_consensus.cc:2468] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:25:44.083935 16614 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:44.088902 17311 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:44.089226 17272 raft_consensus.cc:2804] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:44.089138 16615 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:44.092602 17272 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.092408 16541 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.093220 17272 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.089212 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:44.094477 16569 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.096350 17209 raft_consensus.cc:2804] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:44.096848 17209 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.097242 17209 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.097003 17303 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.098131 17303 raft_consensus.cc:697] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:44.099450 17303 consensus_queue.cc:237] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.033419 17270 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.103430 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:44.104053 16643 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.111351 17270 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:25:44.120199 16465 leader_election.cc:336] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.121047 16465 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.121768 16540 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.123234 16320 catalog_manager.cc:5697] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.124862 16643 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:44.125427 17134 raft_consensus.cc:2749] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:44.126114 16465 leader_election.cc:336] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.126930 16614 leader_election.cc:336] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.140586 16465 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.141541 16465 leader_election.cc:336] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.128103 17269 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.130875 17272 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.148532 17272 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:44.134500 16318 catalog_manager.cc:5697] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 2 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:44.148934 16465 leader_election.cc:336] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.147703 17269 tablet_bootstrap.cc:492] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.151571 17269 ts_tablet_manager.cc:1403] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.006s
I20260709 12:25:44.140549 17303 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:44.155710 17303 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:25:44.156315 17303 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.160032 17269 raft_consensus.cc:359] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.140345 17314 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.161850 17269 raft_consensus.cc:740] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.163060 16495 raft_consensus.cc:2393] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:44.166391 17269 consensus_queue.cc:260] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.170675 17209 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.139724 16569 raft_consensus.cc:2468] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:44.140296 16466 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:44.172073 17134 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.172714 17134 raft_consensus.cc:697] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
W20260709 12:25:44.172917 16465 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.173432 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:44.174100 17269 ts_tablet_manager.cc:1434] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:25:44.174157 16570 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.173718 17134 consensus_queue.cc:237] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.178187 16466 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.179247 17270 raft_consensus.cc:2804] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.179742 17270 raft_consensus.cc:697] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:44.181566 16643 raft_consensus.cc:1275] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.180752 17270 consensus_queue.cc:237] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.183516 17311 consensus_queue.cc:1048] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:44.186144 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 43795.6us
I20260709 12:25:44.194607 16570 raft_consensus.cc:2468] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:44.197988 16645 raft_consensus.cc:1275] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.204849 16466 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:44.206640 17207 consensus_queue.cc:1048] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.207280 17311 raft_consensus.cc:2804] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.207924 17311 raft_consensus.cc:697] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:44.210750 17311 consensus_queue.cc:237] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.219530 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:44.220170 16495 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.222221 16320 catalog_manager.cc:5697] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 2 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.229310 16495 raft_consensus.cc:2468] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
W20260709 12:25:44.224637 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 60855.7us
I20260709 12:25:44.234180 16540 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:44.246031 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:44.247040 16570 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.166322 17314 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:25:44.267933 16465 leader_election.cc:336] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.268442 16614 leader_election.cc:336] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.269096 16465 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.276511 17297 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.278537 17269 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.281770 16569 raft_consensus.cc:1275] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.283769 17209 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:25:44.284192 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 50103.4us
I20260709 12:25:44.287665 17274 consensus_queue.cc:1048] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.291256 16570 raft_consensus.cc:2468] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:44.292560 16615 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:44.293802 17274 raft_consensus.cc:2804] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.294374 17274 raft_consensus.cc:697] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:44.295303 17274 consensus_queue.cc:237] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.291066 16318 catalog_manager.cc:5697] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.311292 16614 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:44.315117 17209 raft_consensus.cc:2804] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.316049 17209 raft_consensus.cc:697] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:44.317667 17209 consensus_queue.cc:237] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.308494 17303 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:25:44.355969 16614 leader_election.cc:336] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:25:44.366497 16614 consensus_peers.cc:597] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:44.366917 16540 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:44.367367 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:44.368036 16614 leader_election.cc:336] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.361536 16318 catalog_manager.cc:5697] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.370409 16318 catalog_manager.cc:5697] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.377072 17303 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:44.390007 16321 catalog_manager.cc:5697] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.407246 17269 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.408355 17269 tablet_bootstrap.cc:492] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.409266 17269 ts_tablet_manager.cc:1403] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.001s
I20260709 12:25:44.409328 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:44.410079 16495 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.412662 17269 raft_consensus.cc:359] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.418355 17269 raft_consensus.cc:740] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.419461 16495 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:25:44.419317 17269 consensus_queue.cc:260] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.422569 17269 ts_tablet_manager.cc:1434] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:44.422344 16540 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:44.427573 17303 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:44.428175 17303 raft_consensus.cc:697] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
W20260709 12:25:44.428687 16540 leader_election.cc:336] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:25:44.429052 17303 consensus_queue.cc:237] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.430462 17269 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.432528 16321 catalog_manager.cc:5697] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.446828 16643 raft_consensus.cc:1275] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.449985 17270 consensus_queue.cc:1048] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.465750 16570 raft_consensus.cc:1275] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.476132 17292 consensus_queue.cc:1048] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.498450 17277 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.499081 17277 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.510432 17277 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:44.532526 17269 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.544900 16318 catalog_manager.cc:5697] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 2, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 2 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:44.534384 16465 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.565656 16643 raft_consensus.cc:1275] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.548524 17269 tablet_bootstrap.cc:492] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.566990 17269 ts_tablet_manager.cc:1403] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.045s
I20260709 12:25:44.567371 17311 consensus_queue.cc:1048] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.579041 17269 raft_consensus.cc:359] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.579860 17269 raft_consensus.cc:740] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.588886 17269 consensus_queue.cc:260] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.591558 17269 ts_tablet_manager.cc:1434] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:25:44.592489 17269 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.595086 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.621320 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:44.626922 17266 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:44.627890 17277 raft_consensus.cc:2749] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.653501 16569 raft_consensus.cc:1275] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.655279 17311 consensus_queue.cc:1048] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:44.665395 17277 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.666039 17277 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.668309 17277 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:44.670604 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:44.674933 16465 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.677264 16647 raft_consensus.cc:1275] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:44.679682 16465 consensus_peers.cc:597] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.680682 17314 consensus_queue.cc:1048] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.719393 17269 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.720510 17269 tablet_bootstrap.cc:492] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.721236 17269 ts_tablet_manager.cc:1403] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.129s	user 0.060s	sys 0.042s
I20260709 12:25:44.724010 17269 raft_consensus.cc:359] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.726866 17269 raft_consensus.cc:740] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
W20260709 12:25:44.707507 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.727684 17269 consensus_queue.cc:260] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:44.730252 17269 ts_tablet_manager.cc:1434] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:44.731161 17269 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.751561 16496 raft_consensus.cc:1275] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.752386 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:44.753149 16465 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.753298 16570 raft_consensus.cc:2393] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:25:44.755178 16572 raft_consensus.cc:1275] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.754083 17269 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.756315 17266 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:44.757228 17277 raft_consensus.cc:3060] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:44.758255 16647 raft_consensus.cc:1275] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:44.765482 17277 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.767314 17269 tablet_bootstrap.cc:492] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.768906 17269 ts_tablet_manager.cc:1403] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.011s
I20260709 12:25:44.771768 17269 raft_consensus.cc:359] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.772531 17269 raft_consensus.cc:740] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.774358 17147 consensus_queue.cc:1048] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:44.775636 16465 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.773481 17269 consensus_queue.cc:260] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.778344 17269 ts_tablet_manager.cc:1434] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:25:44.780251 17269 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.785761 17292 consensus_queue.cc:1048] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.806885 17297 consensus_queue.cc:1048] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:44.811795 16540 consensus_peers.cc:597] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.814409 17269 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.815521 17269 tablet_bootstrap.cc:492] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:44.816321 17269 ts_tablet_manager.cc:1403] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.013s
I20260709 12:25:44.819362 17269 raft_consensus.cc:359] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.820115 17269 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.820869 17269 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.823009 17269 ts_tablet_manager.cc:1434] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:44.823824 17269 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:44.853958 16569 raft_consensus.cc:1275] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:44.893855 16614 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.899117 17311 consensus_queue.cc:1048] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:44.901130 17277 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.901695 17277 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.904522 17277 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:44.908125 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:44.922392 17277 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.923209 17277 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:44.925359 17277 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:44.933961 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:25:44.938019 16465 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:44.938601 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:44.939422 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.950043 17277 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.950805 17277 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:44.951705 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:44.954718 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.956710 17277 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:44.959620 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:44.960129 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:44.961930 17266 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:44.963085 17277 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.963727 17277 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:44.964725 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:44.968309 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:44.972872 17277 leader_election.cc:290] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:44.975535 17277 raft_consensus.cc:2749] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.984401 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:44.984606 17266 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:44.986745 17266 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:44.987934 17277 raft_consensus.cc:2749] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.988947 17277 raft_consensus.cc:2749] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:44.990846 17266 leader_election.cc:304] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:44.992475 17375 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:45.006172 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.027323 17375 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.027998 17375 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.029589 16496 raft_consensus.cc:1275] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:45.030431 17375 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:45.032106 17272 consensus_queue.cc:1048] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:45.036911 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:45.046437 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:45.051796 17266 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:45.053185 17375 raft_consensus.cc:2749] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:45.067166 17269 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.068324 17269 tablet_bootstrap.cc:492] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.069061 17269 ts_tablet_manager.cc:1403] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.245s	user 0.078s	sys 0.140s
I20260709 12:25:45.074302 16495 raft_consensus.cc:1275] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:45.076547 17375 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.091866 17375 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:25:45.093845 16614 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.094141 17375 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
W20260709 12:25:45.094427 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.094864 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.107393 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:45.104056 17297 consensus_queue.cc:1048] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:25:45.116971 17269 raft_consensus.cc:359] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.117960 17269 raft_consensus.cc:740] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.119181 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:45.120316 17269 consensus_queue.cc:260] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.123644 17269 ts_tablet_manager.cc:1434] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:25:45.124470 17269 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.150250 17266 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:45.152272 17375 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:45.152738 16540 consensus_peers.cc:597] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.153280 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.153367 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.154284 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.154704 16540 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.155118 16540 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.196849 17375 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.197441 17375 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.199599 17375 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:45.201645 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:45.204877 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:25:45.212244 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.218845 16465 consensus_peers.cc:597] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.220831 17266 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
W20260709 12:25:45.222684 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.222922 17375 raft_consensus.cc:2749] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:45.247761 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.251456 16614 consensus_peers.cc:597] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.253237 17269 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.254305 17269 tablet_bootstrap.cc:492] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.255007 17269 ts_tablet_manager.cc:1403] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.028s
I20260709 12:25:45.258093 17269 raft_consensus.cc:359] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.258795 17269 raft_consensus.cc:740] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.263615 17269 consensus_queue.cc:260] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.266312 17269 ts_tablet_manager.cc:1434] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:25:45.267204 17269 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
W20260709 12:25:45.285199 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.313987 17269 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.323393 17269 tablet_bootstrap.cc:492] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.324493 17269 ts_tablet_manager.cc:1403] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.011s
I20260709 12:25:45.331835 17269 raft_consensus.cc:359] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.332604 17269 raft_consensus.cc:740] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.333442 17269 consensus_queue.cc:260] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.356734 17269 ts_tablet_manager.cc:1434] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 12:25:45.358372 17269 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
W20260709 12:25:45.359169 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 46449.7us
W20260709 12:25:45.366513 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.371944 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.393929 17269 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.397680 17269 tablet_bootstrap.cc:492] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.398597 17269 ts_tablet_manager.cc:1403] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.000s
I20260709 12:25:45.401983 17269 raft_consensus.cc:359] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.402791 17269 raft_consensus.cc:740] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.403544 17269 consensus_queue.cc:260] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.406312 17269 ts_tablet_manager.cc:1434] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:45.407392 17269 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.432906  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:35115
I20260709 12:25:45.433043 17415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:35115 every 8 connection(s)
I20260709 12:25:45.435856 17269 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.437129 17269 tablet_bootstrap.cc:492] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.438164 17269 ts_tablet_manager.cc:1403] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.003s
I20260709 12:25:45.442287 17269 raft_consensus.cc:359] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.443415 17269 raft_consensus.cc:740] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.444460 17269 consensus_queue.cc:260] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.447687 17269 ts_tablet_manager.cc:1434] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:45.449014 17269 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.472429 17269 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.473524 17269 tablet_bootstrap.cc:492] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.474313 17269 ts_tablet_manager.cc:1403] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 12:25:45.477231 17269 raft_consensus.cc:359] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.478091 17269 raft_consensus.cc:740] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.479154 17269 consensus_queue.cc:260] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.482020 17269 ts_tablet_manager.cc:1434] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:45.483171 17269 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.489794 17375 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.490461 17375 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.494813 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:25:45.501677 17375 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:45.503141 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:45.504781 17265 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:25:45.506145 17375 raft_consensus.cc:2749] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:45.512837 17269 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.513959 17269 tablet_bootstrap.cc:492] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.514726 17269 ts_tablet_manager.cc:1403] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
I20260709 12:25:45.517903 17269 raft_consensus.cc:359] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.518685 17269 raft_consensus.cc:740] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.519418 17269 consensus_queue.cc:260] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.524909 17380 raft_consensus.cc:3060] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.529619 17269 ts_tablet_manager.cc:1434] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 12:25:45.530740 17269 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.532783 17381 raft_consensus.cc:3060] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:45.548936 16465 consensus_peers.cc:597] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:45.553757 16540 consensus_peers.cc:597] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.554148 17382 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.558756 17378 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:45.577183 16540 consensus_peers.cc:597] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:45.587553 17416 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41909
I20260709 12:25:45.588227 17416 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:45.589372 17416 heartbeater.cc:507] Master 127.6.182.190:41909 requested a full tablet report, sending...
I20260709 12:25:45.594826 17367 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.623026 17269 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.625061 17269 tablet_bootstrap.cc:492] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.625980 17269 ts_tablet_manager.cc:1403] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.032s
I20260709 12:25:45.629813 17363 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.637409 17269 raft_consensus.cc:359] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.638645 17269 raft_consensus.cc:740] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.639919 17269 consensus_queue.cc:260] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.642998 17269 ts_tablet_manager.cc:1434] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:45.649014 17269 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.664537 17382 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.721377 17269 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.722951 17269 tablet_bootstrap.cc:492] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.723716 17269 ts_tablet_manager.cc:1403] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.002s
I20260709 12:25:45.725147 16318 ts_manager.cc:194] Re-registered known tserver with Master: a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:25:45.726652 17269 raft_consensus.cc:359] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.727448 17269 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.728186 17269 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.729753 17269 ts_tablet_manager.cc:1434] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:45.730602 17269 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.752728 17269 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.753751 17269 tablet_bootstrap.cc:492] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.754451 17269 ts_tablet_manager.cc:1403] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:25:45.757076 17269 raft_consensus.cc:359] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.757777 17269 raft_consensus.cc:740] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.758483 17269 consensus_queue.cc:260] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.760790 17269 ts_tablet_manager.cc:1434] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:45.761612 17269 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.773480 16318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51072
I20260709 12:25:45.779093 17425 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.779199 17416 heartbeater.cc:499] Master 127.6.182.190:41909 was elected leader, sending a full tablet report...
I20260709 12:25:45.779692 17425 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.780712 17269 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.781687 17269 tablet_bootstrap.cc:492] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.782349 17269 ts_tablet_manager.cc:1403] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:25:45.782963 17425 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:45.783078 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:25:45.784227 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:25:45.784981 17269 raft_consensus.cc:359] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.785953 17269 raft_consensus.cc:740] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.785769 17265 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:25:45.786734 17425 raft_consensus.cc:2749] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:45.786710 17269 consensus_queue.cc:260] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:45.788703 17269 ts_tablet_manager.cc:1434] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:45.789556 17269 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.812171 17269 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.813082 17269 tablet_bootstrap.cc:492] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.813696 17269 ts_tablet_manager.cc:1403] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:25:45.815686 17269 raft_consensus.cc:359] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.816241 17269 raft_consensus.cc:740] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.816865 17269 consensus_queue.cc:260] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.818912 17269 ts_tablet_manager.cc:1434] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:25:45.819720 17269 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.832403 17209 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.833153 17209 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.835778 17209 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:45.837452 17382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:25:45.837690 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:25:45.839268 16614 leader_election.cc:343] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.838382 16495 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:25:45.842645 16614 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:45.843974 17209 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:45.844425 17209 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.845084 17209 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:45.850931 17269 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.852041 17269 tablet_bootstrap.cc:492] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.852830 17269 ts_tablet_manager.cc:1403] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.015s
I20260709 12:25:45.854364 17209 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.854986 17269 raft_consensus.cc:359] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.855660 17269 raft_consensus.cc:740] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.856479 17209 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:45.856312 17269 consensus_queue.cc:260] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.857621 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:45.858278 16495 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:45.858186 17382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:25:45.858637 17269 ts_tablet_manager.cc:1434] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:45.859531 17269 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
W20260709 12:25:45.860069 16614 leader_election.cc:343] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.868078 16495 raft_consensus.cc:2468] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:25:45.883107 16614 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:45.883951 17385 raft_consensus.cc:2804] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:45.884388 17385 raft_consensus.cc:697] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:45.885212 17385 consensus_queue.cc:237] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.887036 17269 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.888098 17269 tablet_bootstrap.cc:492] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.888777 17269 ts_tablet_manager.cc:1403] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.002s
I20260709 12:25:45.891366 17269 raft_consensus.cc:359] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.892082 17269 raft_consensus.cc:740] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.892786 17269 consensus_queue.cc:260] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:45.894876 17269 ts_tablet_manager.cc:1434] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:45.895713 17269 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.902246 16318 catalog_manager.cc:5697] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 3, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 3 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.939874 17269 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.941025 17269 tablet_bootstrap.cc:492] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.941807 17269 ts_tablet_manager.cc:1403] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.017s
I20260709 12:25:45.945772 17269 raft_consensus.cc:359] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.946555 17269 raft_consensus.cc:740] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.947458 17269 consensus_queue.cc:260] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.950196 17269 ts_tablet_manager.cc:1434] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:45.951104 17269 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:45.973665 17269 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.974931 17269 tablet_bootstrap.cc:492] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:45.975626 17269 ts_tablet_manager.cc:1403] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.001s
I20260709 12:25:45.978012 17269 raft_consensus.cc:359] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.978654 17269 raft_consensus.cc:740] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.979422 17269 consensus_queue.cc:260] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:45.986785 17269 ts_tablet_manager.cc:1434] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:45.989476 17269 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.185973 17363 raft_consensus.cc:3060] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.215595 17269 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.216820 17269 tablet_bootstrap.cc:492] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.217489 17269 ts_tablet_manager.cc:1403] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.230s	user 0.019s	sys 0.019s
I20260709 12:25:46.223737 17269 raft_consensus.cc:359] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:46.224485 17269 raft_consensus.cc:740] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.225576 17269 consensus_queue.cc:260] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:25:46.226569 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 78824.3us
I20260709 12:25:46.229763 17269 ts_tablet_manager.cc:1434] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:25:46.241860 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 97625.9us
I20260709 12:25:46.291338 17269 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.309381 17380 raft_consensus.cc:3060] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.326273 17362 raft_consensus.cc:3060] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.358500 17269 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.359628 17269 tablet_bootstrap.cc:492] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.360351 17269 ts_tablet_manager.cc:1403] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.002s
I20260709 12:25:46.362903 17269 raft_consensus.cc:359] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.363762 17269 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.364567 17269 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.366820 17269 ts_tablet_manager.cc:1434] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:25:46.368199 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.370085 17269 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.384186 16495 raft_consensus.cc:1275] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:46.387181 17459 consensus_queue.cc:1048] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.400453 17269 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.401695 17269 tablet_bootstrap.cc:492] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.406351 17269 ts_tablet_manager.cc:1403] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.004s
I20260709 12:25:46.410863 17269 raft_consensus.cc:359] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.411695 17269 raft_consensus.cc:740] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.412580 17269 consensus_queue.cc:260] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.414911 17269 ts_tablet_manager.cc:1434] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:46.415828 17269 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.446683 17269 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.448153 17269 tablet_bootstrap.cc:492] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.449147 17269 ts_tablet_manager.cc:1403] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.007s
I20260709 12:25:46.452447 17269 raft_consensus.cc:359] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.458132 17269 raft_consensus.cc:740] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.458904 17269 consensus_queue.cc:260] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.461313 17269 ts_tablet_manager.cc:1434] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:46.462354 17269 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.489066 17269 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.490231 17269 tablet_bootstrap.cc:492] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.491009 17269 ts_tablet_manager.cc:1403] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 12:25:46.493387 17269 raft_consensus.cc:359] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:46.494143 17269 raft_consensus.cc:740] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.495046 17269 consensus_queue.cc:260] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:46.496795 17269 ts_tablet_manager.cc:1434] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:46.497642 17269 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.519062 17269 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.520192 17269 tablet_bootstrap.cc:492] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.520996 17269 ts_tablet_manager.cc:1403] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 12:25:46.523871 17269 raft_consensus.cc:359] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.524418 17269 raft_consensus.cc:740] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.525104 17269 consensus_queue.cc:260] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.527185 17269 ts_tablet_manager.cc:1434] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
I20260709 12:25:46.528663 17269 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.537602 17363 raft_consensus.cc:3060] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.549315 17269 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.550374 17269 tablet_bootstrap.cc:492] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.551175 17269 ts_tablet_manager.cc:1403] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:25:46.564282 17269 raft_consensus.cc:359] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.565052 17269 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.565775 17269 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.567787 17269 ts_tablet_manager.cc:1434] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:25:46.568576 17269 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.583223 17269 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.584175 17269 tablet_bootstrap.cc:492] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.584921 17269 ts_tablet_manager.cc:1403] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:25:46.587286 17269 raft_consensus.cc:359] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.587823 17269 raft_consensus.cc:740] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.588421 17269 consensus_queue.cc:260] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.590396 17269 ts_tablet_manager.cc:1434] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:46.591444 17269 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.604617 17269 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.605698 17269 tablet_bootstrap.cc:492] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.606328 17269 ts_tablet_manager.cc:1403] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:25:46.608160 17269 raft_consensus.cc:359] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.608740 17269 raft_consensus.cc:740] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.609359 17269 consensus_queue.cc:260] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:46.611366 17269 ts_tablet_manager.cc:1434] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:46.612473 17269 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.628559 17269 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.629606 17269 tablet_bootstrap.cc:492] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.630283 17269 ts_tablet_manager.cc:1403] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:25:46.636453 17269 raft_consensus.cc:359] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:46.637166 17269 raft_consensus.cc:740] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.637897 17269 consensus_queue.cc:260] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:46.639770 17269 ts_tablet_manager.cc:1434] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:25:46.640475 17269 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap starting.
I20260709 12:25:46.663651 17269 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.665104 17269 tablet_bootstrap.cc:492] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Bootstrap complete.
I20260709 12:25:46.665825 17269 ts_tablet_manager.cc:1403] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 12:25:46.668331 17269 raft_consensus.cc:359] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.669059 17269 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.669695 17269 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:46.672479 17269 ts_tablet_manager.cc:1434] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:46.797392 17363 raft_consensus.cc:3060] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.947377 17380 raft_consensus.cc:3060] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:25:47.148699 17363 raft_consensus.cc:3060] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:48.191612 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 47715.7us
I20260709 12:25:55.458511  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.510052 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "020b055b364646c9b177588ef98ec412"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:55.510932 16572 raft_consensus.cc:606] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:55.525133 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:55.525794 16645 raft_consensus.cc:606] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:55.531580 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:55.532248 16645 raft_consensus.cc:606] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:55.535262 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:55.535806 16645 raft_consensus.cc:606] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:55.538458 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:55.538954 16645 raft_consensus.cc:606] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:55.541291 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:55.541780 16645 raft_consensus.cc:606] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:55.543182  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:55.544984  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.546212  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.608332 17497 raft_consensus.cc:993] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.609064 17508 raft_consensus.cc:1081] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.611084 16497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:54650
I20260709 12:25:55.611691 16497 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.611974 17508 raft_consensus.cc:993] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.612123 16497 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.612478 17508 raft_consensus.cc:1081] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.619438 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:54650
I20260709 12:25:55.620007 16495 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.620401 16495 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.621594 16497 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.624811 16497 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.626017 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.626526 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.626856 16575 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.627144 16645 raft_consensus.cc:3055] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.627496 16645 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:55.628329 16645 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.629779 16645 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.631832 17519 raft_consensus.cc:993] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:55.632360 17497 raft_consensus.cc:1081] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:55.634061 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37868
I20260709 12:25:55.634588 17363 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.634925 17363 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.636734 16495 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.638957 16645 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.639900 16495 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.641008 16466 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:55.642040 17505 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.642578 17505 raft_consensus.cc:697] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:55.643496 17505 consensus_queue.cc:237] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.644420 16575 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.647639 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.646318 17363 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.648270 16645 raft_consensus.cc:3055] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.648681 16645 raft_consensus.cc:740] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:55.649992 17363 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.651351 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.651983 16643 raft_consensus.cc:3055] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.652294 16643 raft_consensus.cc:740] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:55.653303 16643 consensus_queue.cc:260] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.654714 16645 consensus_queue.cc:260] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.655382 16643 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.656090 16645 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.654105 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.654316 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.659068 16572 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.666736 16575 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.675438 16645 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.675016 16322 catalog_manager.cc:5697] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.679456 16466 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:25:55.680408 17505 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.685881 17505 raft_consensus.cc:697] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:55.687237 17505 consensus_queue.cc:237] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.693922 16575 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.696879 16643 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:55.697113 16572 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:55.698853 17266 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:55.701781 17523 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.703961 17523 raft_consensus.cc:697] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:55.705487 17523 consensus_queue.cc:237] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.719784 16321 catalog_manager.cc:5697] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.728742 17513 raft_consensus.cc:993] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:55.729290 17513 raft_consensus.cc:1081] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:55.728910 16322 catalog_manager.cc:5697] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.731187 17378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "020b055b364646c9b177588ef98ec412"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37894
I20260709 12:25:55.731745 17378 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.732023 17378 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.741854 17378 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.743665 17378 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.744331 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.744709 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.745142 16572 raft_consensus.cc:3055] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.745374 16643 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.745532 16572 raft_consensus.cc:740] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:55.746459 16572 consensus_queue.cc:260] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.747762 16572 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.751901 16643 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:55.753060 17266 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:55.753317 16572 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:55.753891 17523 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.754431 17523 raft_consensus.cc:697] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:55.755264 17523 consensus_queue.cc:237] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:55.765794 16322 catalog_manager.cc:5697] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.779237 17497 raft_consensus.cc:993] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.779713 17497 raft_consensus.cc:1081] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Signalling peer 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.781167 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:54650
I20260709 12:25:55.781665 16495 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.781957 16495 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:55.788216 16495 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.789633 16495 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.790424 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.790771 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.791051 16572 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:55.791450 16643 raft_consensus.cc:3055] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:55.791755 16643 raft_consensus.cc:740] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:55.792519 16643 consensus_queue.cc:260] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.793859 16643 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:55.797531 16572 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:25:55.798950 16466 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:55.799834 17505 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:55.800360 17505 raft_consensus.cc:697] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:55.801463 17505 consensus_queue.cc:237] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.804590 16643 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:25:55.814169 16322 catalog_manager.cc:5697] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 3, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 3 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.954584 17497 raft_consensus.cc:993] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.955248 17497 raft_consensus.cc:1081] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer 57226fc89069472b9311be6e596aa8ee to start an election
I20260709 12:25:55.957118 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:54650
I20260709 12:25:55.957700 16495 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:55.958022 16495 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.963714 16495 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.965409 16495 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:55.966295 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:55.966740 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:55.966969 16575 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.967344 16643 raft_consensus.cc:3055] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.967648 16643 raft_consensus.cc:740] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:55.968669 16643 consensus_queue.cc:260] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.970103 16643 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.975029 16575 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.976387 16466 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:25:55.977337 17503 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.977602 16643 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:25:55.977815 17503 raft_consensus.cc:697] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:55.978803 17503 consensus_queue.cc:237] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:25:55.988318 16322 catalog_manager.cc:5697] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 2 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.040150 16643 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.041448 17503 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.060019 16575 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.061875 17503 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.111300 16643 raft_consensus.cc:1275] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.112689 17505 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.125429 16572 raft_consensus.cc:1275] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.126950 17505 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.175319 16643 raft_consensus.cc:1275] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.176581 17523 consensus_queue.cc:1048] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.189049 16572 raft_consensus.cc:1275] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.193995 17525 consensus_queue.cc:1048] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.209365 16575 raft_consensus.cc:1275] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.211673 17525 consensus_queue.cc:1048] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.223098 16643 raft_consensus.cc:1275] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.224577 17523 consensus_queue.cc:1048] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.300755 16575 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:56.302055 17503 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.311620 16643 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:56.313531 17540 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:56.482721 16645 raft_consensus.cc:1275] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.484265 17540 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.499682 16572 raft_consensus.cc:1275] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:56.503490 17540 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.593472  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.631826 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:56.632467 16645 raft_consensus.cc:606] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.647099 16497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:25:56.647675 16497 raft_consensus.cc:606] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.650267 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "912f04f17584451592c26c403070693c"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:56.650781 16572 raft_consensus.cc:606] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.653455 16497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:25:56.653928 16497 raft_consensus.cc:606] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.656284 16497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e"
dest_uuid: "57226fc89069472b9311be6e596aa8ee"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:25:56.656735 16497 raft_consensus.cc:606] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.659853 16645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6439a65987543bbb05819426afdf56f"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:56.660387 16645 raft_consensus.cc:606] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:56.661860  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:56.665304  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:56.666350  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.701051 17550 raft_consensus.cc:993] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.701599 17550 raft_consensus.cc:1081] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.703299 17378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "912f04f17584451592c26c403070693c"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37894
I20260709 12:25:56.703842 17378 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.704192 17378 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.711933 17378 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:56.714596 17378 leader_election.cc:290] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:56.715018 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:56.715636 16497 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.716472 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:56.717161 16572 raft_consensus.cc:3055] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:56.717496 16572 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:56.718369 16572 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:56.719873 16572 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.723487 16497 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.725118 17265 leader_election.cc:304] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:56.725998 17523 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:56.726497 17523 raft_consensus.cc:697] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:56.727420 17523 consensus_queue.cc:237] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:56.729967 16572 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.739890 16322 catalog_manager.cc:5697] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.868667 17505 raft_consensus.cc:993] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.869158 17503 raft_consensus.cc:1081] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.870556 17378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37884
I20260709 12:25:56.871116 17378 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.871467 17378 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.877310 17378 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.879187 17378 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:56.879941 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:56.880383 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:56.880762 16645 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.881130 16495 raft_consensus.cc:3055] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:56.881470 16495 raft_consensus.cc:740] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:56.882194 16495 consensus_queue.cc:260] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.883414 16495 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.887454 16645 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.889185 17266 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:56.890151 17523 raft_consensus.cc:2804] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:56.890158 16495 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.890727 17523 raft_consensus.cc:697] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:56.891705 17523 consensus_queue.cc:237] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.902316 16322 catalog_manager.cc:5697] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.942559 17505 raft_consensus.cc:993] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.943075 17505 raft_consensus.cc:1081] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.945187 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37884
I20260709 12:25:56.945751 17363 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:56.946118 17363 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.953285 17363 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.955142 17363 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:56.955924 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:56.956561 16645 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.956179 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:56.958758 16495 raft_consensus.cc:3055] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:56.959151 16495 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:56.961459 16495 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.962776 16495 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:56.964047 16645 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.965783 17266 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:56.966593 17523 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:56.967145 17523 raft_consensus.cc:697] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:56.967983 17523 consensus_queue.cc:237] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:56.982311 16322 catalog_manager.cc:5697] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.985868 16495 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:56.998793 17519 raft_consensus.cc:993] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:56.999689 17562 raft_consensus.cc:1081] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.001459 17380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6439a65987543bbb05819426afdf56f"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37868
I20260709 12:25:57.001659 17519 raft_consensus.cc:993] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.002058 17380 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.002183 17562 raft_consensus.cc:1081] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.002450 17380 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.004875 17378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37868
I20260709 12:25:57.005517 17378 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.005861 17378 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.013330 17378 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.018025 17378 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:57.018674 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:57.019485 16572 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.024762 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:57.025444 16645 raft_consensus.cc:3055] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:57.025743 16645 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:57.026659 16572 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.026505 16645 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.027809 16645 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.010207 17380 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:57.036939 16645 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.038264 17380 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:25:57.038489 17266 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:57.039458 17523 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:57.039984 17523 raft_consensus.cc:697] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:57.040462 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:57.041080 16495 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.040867 17523 consensus_queue.cc:237] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.038671 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:57.045287 16645 raft_consensus.cc:3055] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:57.045650 16645 raft_consensus.cc:740] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:57.046952 16645 consensus_queue.cc:260] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:57.047816 16495 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.048942 17265 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:57.050036 17525 raft_consensus.cc:2804] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:57.050559 17525 raft_consensus.cc:697] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:57.051591 17525 consensus_queue.cc:237] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:25:57.048332 16645 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.060729 16645 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.060133 16322 catalog_manager.cc:5697] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.082816 16322 catalog_manager.cc:5697] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.241811 16495 raft_consensus.cc:1275] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.243186 17525 consensus_queue.cc:1048] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.257658 16572 raft_consensus.cc:1275] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.259423 17547 consensus_queue.cc:1048] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.265587 17505 raft_consensus.cc:993] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.266113 17540 raft_consensus.cc:1081] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.267800 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37884
I20260709 12:25:57.268364 17363 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.268779 17363 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.276080 17363 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:57.279475 17363 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:57.279596 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:57.280313 16495 raft_consensus.cc:3055] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:57.280656 16495 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:25:57.281559 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:57.281445 16495 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:57.282117 16572 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.282722 16495 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.290686 16495 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.291730 17265 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:57.292673 17547 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:57.293136 17547 raft_consensus.cc:697] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:57.293177 16572 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.294041 17547 consensus_queue.cc:237] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:57.310537 16322 catalog_manager.cc:5697] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.352429 16645 raft_consensus.cc:1275] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.353721 17547 consensus_queue.cc:1048] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.364472 16495 raft_consensus.cc:1275] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.366308 17525 consensus_queue.cc:1048] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.454919 16645 raft_consensus.cc:1275] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.456243 17525 consensus_queue.cc:1048] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.459539 16495 raft_consensus.cc:1275] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.461109 17523 consensus_queue.cc:1048] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.467515 16572 raft_consensus.cc:1275] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.472729 17547 consensus_queue.cc:1048] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.482688 16645 raft_consensus.cc:1275] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.485571 17547 consensus_queue.cc:1048] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.522293 16643 raft_consensus.cc:1275] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.523778 17525 consensus_queue.cc:1048] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.530112 16495 raft_consensus.cc:1275] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.539114 17525 consensus_queue.cc:1048] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.722224  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:57.733559 16572 raft_consensus.cc:1275] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.735019 17547 consensus_queue.cc:1048] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.748903 16496 raft_consensus.cc:1275] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:57.751375 17523 consensus_queue.cc:1048] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.779937 16647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:57.780567 16647 raft_consensus.cc:606] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:57.783360 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:57.784271 16572 raft_consensus.cc:606] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:57.790843 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:57.791463 16572 raft_consensus.cc:606] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:57.794520 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:57.795352 16572 raft_consensus.cc:606] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:57.798163 16647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7"
dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
mode: GRACEFUL
new_leader_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:40874
I20260709 12:25:57.799032 16647 raft_consensus.cc:606] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Received request to transfer leadership to TS a8133a8f49724a8897d8bc4f718d802d
I20260709 12:25:57.800472  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:57.802345  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:57.803000  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:57.924909 17571 raft_consensus.cc:993] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.925432 17497 raft_consensus.cc:1081] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:57.927218 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37868
I20260709 12:25:57.927784 17363 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.928191 17363 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.935252 17363 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.936900 17363 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:57.938215 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:57.938831 16647 raft_consensus.cc:3055] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:57.939087 16647 raft_consensus.cc:740] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:57.939859 16647 consensus_queue.cc:260] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.941227 16647 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.945999 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:57.946709 16575 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:57.947950 16647 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.949302 17266 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:57.950066 17547 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:57.950559 17547 raft_consensus.cc:697] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:57.951537 17547 consensus_queue.cc:237] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:57.954073 16575 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:57.961978 16318 catalog_manager.cc:5697] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.003657 17532 raft_consensus.cc:993] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.005100 17532 raft_consensus.cc:1081] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.006739 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37894
I20260709 12:25:58.007299 17363 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.007597 17363 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.013733 17363 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.015923 17363 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:58.016419 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:58.017141 16496 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.018824 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:58.019495 16575 raft_consensus.cc:3055] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:58.019819 16575 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:58.020610 16575 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.022034 16575 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.023855 16496 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.025034 17265 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:58.025961 17547 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:58.026675 17547 raft_consensus.cc:697] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:58.027531 17547 consensus_queue.cc:237] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.028792 16575 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.033075 17571 raft_consensus.cc:993] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.033654 17497 raft_consensus.cc:1081] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.037293 17363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37868
I20260709 12:25:58.037804 17363 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.038080 17363 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.039795 16318 catalog_manager.cc:5697] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.046690 17363 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.049809 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:58.050323 17363 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:58.050786 16575 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.051322 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:58.052004 16647 raft_consensus.cc:3055] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:58.052301 16647 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:25:58.053125 16647 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.054322 16647 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.075886 16647 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.076256 16575 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.077847 17266 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:58.078768 17547 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:58.079322 17547 raft_consensus.cc:697] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:58.080153 17547 consensus_queue.cc:237] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.093057 16318 catalog_manager.cc:5697] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.100911 17575 raft_consensus.cc:993] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.101473 17532 raft_consensus.cc:1081] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.103122 17380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37894
I20260709 12:25:58.103761 17380 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.104087 17380 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.109447 17380 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.113349 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:25:58.113950 16496 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.118115 17380 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:25:58.122285 16496 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.123690 17265 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:58.125679 17525 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:58.126187 17525 raft_consensus.cc:697] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:58.127140 17525 consensus_queue.cc:237] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.127159 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:58.131414 16575 raft_consensus.cc:3055] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:58.132220 16575 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:58.133306 16575 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:25:58.135349 16575 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.143275 16575 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:25:58.180769 16318 catalog_manager.cc:5697] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 2 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.207762 17532 raft_consensus.cc:993] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: : Instructing follower a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.209039 17532 raft_consensus.cc:1081] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Signalling peer a8133a8f49724a8897d8bc4f718d802d to start an election
I20260709 12:25:58.212913 17380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a"
dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
 from {username='slave'} at 127.0.0.1:37894
I20260709 12:25:58.214047 17380 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.214679 17380 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:58.231040 17380 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.233973 17380 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:25:58.235148 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:25:58.235510 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:25:58.236179 16572 raft_consensus.cc:3055] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:58.236284 16643 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:58.236704 16572 raft_consensus.cc:740] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:25:58.238040 16572 consensus_queue.cc:260] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.239548 16572 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:58.244721 16643 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 3.
I20260709 12:25:58.246073 17266 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:25:58.247088 17523 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:58.247675 17523 raft_consensus.cc:697] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 3 LEADER]: Becoming Leader. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:25:58.249197 16572 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 3.
I20260709 12:25:58.249109 17523 consensus_queue.cc:237] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:25:58.271488 16318 catalog_manager.cc:5697] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d reported cstate change: term changed from 2 to 3, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to a8133a8f49724a8897d8bc4f718d802d (127.6.182.129). New cstate: current_term: 3 leader_uuid: "a8133a8f49724a8897d8bc4f718d802d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.359117 16643 raft_consensus.cc:1275] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.361855 17523 consensus_queue.cc:1048] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:58.450395 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 49849.5us
I20260709 12:25:58.529475 16569 raft_consensus.cc:1275] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.538420 17547 consensus_queue.cc:1048] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:58.557060 16575 raft_consensus.cc:1275] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.560247 17602 consensus_queue.cc:1048] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:25:58.633872 16497 raft_consensus.cc:1275] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.635052 16647 raft_consensus.cc:1275] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.637272 17525 consensus_queue.cc:1048] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:58.638440 17597 consensus_queue.cc:1048] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:58.650414 16569 raft_consensus.cc:1275] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.656198 17597 consensus_queue.cc:1048] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:58.673908 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 45890.7us
I20260709 12:25:58.746050 16497 raft_consensus.cc:1275] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.751977 17525 consensus_queue.cc:1048] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:58.760047 16570 raft_consensus.cc:1275] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:58.762337 17602 consensus_queue.cc:1048] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:58.822022 16643 raft_consensus.cc:1275] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:58.823457 17525 consensus_queue.cc:1048] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.833837 16572 raft_consensus.cc:1275] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Refusing update from remote peer a8133a8f49724a8897d8bc4f718d802d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:58.835331 17597 consensus_queue.cc:1048] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.840106  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:58.896322 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:25:58.897032 16572 raft_consensus.cc:606] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:25:58.898633  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:25:58.900599  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:58.901765  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.081372 17644 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.082170 17644 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.088701 17644 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.105237 17629 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:00.106082 17629 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:00.148269 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 125344us
W20260709 12:26:00.154569 17265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 47141.1us
I20260709 12:26:00.150470 17625 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.159060 17625 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:00.160326 17636 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.160981 17636 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.162318 17627 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:00.162921 17627 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.163527 17636 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.149174 17644 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.165016 17644 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.158473 17634 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.178146 17649 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.178378 17627 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.178867 17649 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.183911 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.170629 17629 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.174883 17634 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.152876 17648 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.185976 17649 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:00.187830 17636 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.213287 17641 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.214067 17641 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.212584 17625 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:00.216248 17636 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.220361 17636 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:00.222705 16615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.009s	sys 0.008s
I20260709 12:26:00.225164 17634 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:00.212554 17642 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.226750 17642 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.229729 17642 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:00.225870 17644 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.232123 17641 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:00.232558 16615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.010s	sys 0.008s
I20260709 12:26:00.234277 17645 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.235205 17645 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:00.238229 17625 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.238967 17625 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.193521 17648 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.240782 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.242282 17648 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:00.247051 17625 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:00.249298 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.251614 17650 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:00.252251 17650 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.254875 17650 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.255834 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.258105 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.258698 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.259991 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.261510 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.265379 17638 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.266077 17638 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.268510 17644 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.268533 17638 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.269316 17644 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:00.282735 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 127081us
W20260709 12:26:00.283547 17265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 97672.2us
I20260709 12:26:00.286700 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:26:00.287119 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 94963.4us
I20260709 12:26:00.288640 17633 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.289240 17633 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:00.291193 17658 raft_consensus.cc:493] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.291975 17658 raft_consensus.cc:515] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.292454 17643 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.293174 17643 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.294585 17658 leader_election.cc:290] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:00.295022 17633 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.297945 17650 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:00.298631 17650 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.299887 17633 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.301029 17650 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.301108 17633 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.303831 17633 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:00.309947 17648 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.310642 17648 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:00.312368 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.312769 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.314013 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.313902 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.316875 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.317423 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.317625 17380 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:26:00.317960 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.318876 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.319223 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.320474 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.321847 17648 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.322144 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.326299 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.330540 17643 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.333784 17644 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.238407 17645 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.335855 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.339313 17655 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:00.339906 17651 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:00.340135 17655 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.340601 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.340559 17651 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:00.342828 17655 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.342893 17651 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:00.343537 17651 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.345167 16466 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.343582 17644 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:00.346287 17645 raft_consensus.cc:2749] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.345981 17644 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.351900 17644 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.344148 17651 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:00.353156 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.360992 17651 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:00.357252 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.353895 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.363780 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.365535 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.366587 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.368969 16644 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:00.367393 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.370401 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.370651 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.371585 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.373242 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.374909 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.375274 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.376948 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.377882 16541 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:00.376919 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.378890 17659 raft_consensus.cc:2749] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.376968 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.380563 16541 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:00.381433 17633 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:00.381857 17633 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:00.382292 17633 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.383041 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.385303 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.385383 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.386624 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.387125 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.387887 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.389678 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.393327 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.397445 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.398315 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440906c79bf64ae3bd7a7b15c6abba82" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:00.400233 17633 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.402382 16614 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:00.402902 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.403383 17654 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:00.403832 17654 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:00.402926 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:00.404290 17654 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:00.405786 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:00.406760 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.407526 16574 raft_consensus.cc:1240] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:00.411831 16466 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.413275 16466 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.413960 17632 raft_consensus.cc:2749] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.415055 17634 raft_consensus.cc:2749] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.416669 16614 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.417158 16615 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.417552 17644 raft_consensus.cc:2749] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.418298 17632 consensus_queue.cc:1059] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:00.419502 17634 raft_consensus.cc:3055] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:00.419862 17634 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:00.420053 17641 raft_consensus.cc:2749] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.420809 17634 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.422118 17634 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.425261 17654 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.427723 17654 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:00.412003 16540 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.428051 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.411831 17266 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:00.429843 17633 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:00.430087 16614 leader_election.cc:304] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.431222 17641 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.431531 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:00.433014 17644 raft_consensus.cc:2749] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.433239 17659 raft_consensus.cc:2749] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.435196 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:26:00.437529 16615 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.438761 17653 raft_consensus.cc:2749] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.438908 17654 raft_consensus.cc:2749] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.437844 16540 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.439921 16615 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.440164 17659 raft_consensus.cc:2749] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.441020 17654 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.441797 16540 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.441380 17266 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:00.443188 17633 raft_consensus.cc:2749] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.443369 16615 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.443225 17653 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:00.444763 17641 raft_consensus.cc:2749] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.446033 16615 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.446903 17641 raft_consensus.cc:2749] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.446630 16540 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.449083 17633 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:00.449170 16615 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.450256 17641 raft_consensus.cc:2749] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.450438 16615 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.451399 17266 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.451933 16466 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.450452 16540 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.452903 17634 raft_consensus.cc:2749] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.453451 17266 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.453591 17633 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.454944 17641 raft_consensus.cc:2749] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.456310 17656 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.457458 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:00.458652 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:00.452423 17651 raft_consensus.cc:2749] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.462311 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:00.462634 16615 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:00.464499 17641 raft_consensus.cc:2749] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:00.468230 17266 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:00.469060 17656 raft_consensus.cc:2749] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:00.474346 16495 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:00.482586 16540 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:00.483605 17628 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:00.484153 17628 raft_consensus.cc:697] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:00.485163 17628 consensus_queue.cc:237] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:00.510057 16322 catalog_manager.cc:5697] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 2 to 3, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.767757 16645 raft_consensus.cc:1240] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:00.769213 17633 consensus_queue.cc:1059] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.770375 17628 raft_consensus.cc:3055] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:00.770762 17628 raft_consensus.cc:740] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:00.771754 17628 consensus_queue.cc:260] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:00.773190 17628 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:00.877051  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.900714 16645 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:00.909657 16645 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.911063 17628 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:00.918776 16571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:26:00.919524 16571 raft_consensus.cc:606] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:00.922971 16572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "957637a18e91481fb00d24ee6684e679"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:26:00.923790 16572 raft_consensus.cc:606] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:00.927026  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:00.928967  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:00.929906  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.936218 16495 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.944017 17628 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:01.246758 17411 debug-util.cc:398] Leaking SignalData structure 0x7b0800240e80 after lost signal to thread 6877
W20260709 12:26:01.304502 17411 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7ac0 after lost signal to thread 16356
W20260709 12:26:01.689893 17411 debug-util.cc:398] Leaking SignalData structure 0x7b08001b98a0 after lost signal to thread 16525
W20260709 12:26:01.711561 17411 debug-util.cc:398] Leaking SignalData structure 0x7b08002994c0 after lost signal to thread 16599
W20260709 12:26:01.988962 17411 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9d80 after lost signal to thread 16673
W20260709 12:26:01.998407 17411 debug-util.cc:398] Leaking SignalData structure 0x7b0800233d40 after lost signal to thread 17415
I20260709 12:26:02.049428  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.366961 17681 raft_consensus.cc:493] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.367725 17681 raft_consensus.cc:515] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.370052 17681 leader_election.cc:290] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.373623 17683 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.374209 17683 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.374820 17682 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.375368 17682 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.376791 17683 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.378631 17682 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.395952 17681 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
W20260709 12:26:02.396445 16613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.012s	sys 0.008s
W20260709 12:26:02.397578 16613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.014s	sys 0.008s
I20260709 12:26:02.404770 17676 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.405372 17676 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.405773 17677 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.406667 17677 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.409008 17676 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.414963 17676 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.415851 17676 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.412259 17675 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.416842 17675 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:02.410861 17264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.014s	sys 0.051s
W20260709 12:26:02.418509 17264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.014s	sys 0.051s
I20260709 12:26:02.419718 17675 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.412029 17674 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.420439 17674 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.422566 17674 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.409905 17677 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.424997 17676 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.427157 17685 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.427894 17685 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.430213 17685 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.427191 17681 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.439479 17685 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.440446 17685 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.444866 17682 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.445545 17682 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.447784 17682 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.448210 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.454891 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.449164 17681 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.458557 17681 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.459403 17681 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.462359 17686 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.462967 17686 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.463238 17681 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.464564 17681 raft_consensus.cc:493] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.465361 17686 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.465807 17672 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.466439 17672 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.468528 17682 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.469120 17682 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.469494 17672 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.471109 17682 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.483168 17685 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.486150 17684 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.492436 17684 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.501092 17684 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.504371 17690 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.505636 17690 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.511178 17690 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.465178 17681 raft_consensus.cc:515] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:26:02.491626 17266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.027s	sys 0.025s
I20260709 12:26:02.493507 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:26:02.512955 17266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.027s	sys 0.025s
I20260709 12:26:02.513195 17363 raft_consensus.cc:2468] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.486477 17672 raft_consensus.cc:493] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
W20260709 12:26:02.488519 16612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.006s	sys 0.013s
W20260709 12:26:02.514240 16612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.008s	sys 0.013s
I20260709 12:26:02.517966 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
W20260709 12:26:02.501241 17263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.017s	sys 0.000s
I20260709 12:26:02.518749 17362 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:02.519764 17680 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.520339 17680 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:02.518745 17263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.017s	sys 0.000s
I20260709 12:26:02.522680 17680 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.524386 17651 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.524940 17651 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.526490 17686 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.531247 17678 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.527062 17651 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.532394 17651 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.532886 17651 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.531982 17678 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.527482 17679 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.534966 17679 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.535377 17651 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.535923 17651 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.537186 17696 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.537292 17654 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.538255 17654 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.540860 17654 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.536401 17651 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.542086 17691 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.542923 17679 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.531054 17686 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.574671 17681 leader_election.cc:290] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.575520 17686 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.576210 17688 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.543335 17651 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.581625 17679 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.584910 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.585031 17679 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:26:02.543789 16615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.028s	sys 0.031s
W20260709 12:26:02.586354 16615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.028s	sys 0.031s
I20260709 12:26:02.543875 17696 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.587349 17679 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.587476 17692 raft_consensus.cc:493] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.588593 17696 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.488919 17685 raft_consensus.cc:493] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.568202 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.589778 16645 raft_consensus.cc:2393] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d in current term 2: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:02.545642 17691 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.546516 17680 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.514273 17672 raft_consensus.cc:515] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.580094 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.582779 17701 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
W20260709 12:26:02.595235 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 64621.7us
I20260709 12:26:02.589010 17678 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.603308 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.581532 17684 raft_consensus.cc:493] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.613554 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.614585 16649 raft_consensus.cc:2468] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 2.
I20260709 12:26:02.588231 17692 raft_consensus.cc:515] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.597007 17654 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.619143 17675 raft_consensus.cc:493] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.606400 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.601217 17696 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.603499 17690 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.589326 17685 raft_consensus.cc:515] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.609850 17679 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.620693 17678 raft_consensus.cc:493] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.619249 17680 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.640815 17687 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.640957 17704 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.640538 17703 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.641551 17687 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.641839 17704 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.643484 17680 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.635320 17654 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.643822 17687 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.591254 17688 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.644831 17705 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.645596 17654 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.645412 17705 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.647080 17688 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.647739 17705 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.641853 17703 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.647926 17693 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.648926 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.648809 17693 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.619598 17684 raft_consensus.cc:515] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.636762 17696 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.651767 17678 raft_consensus.cc:515] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.652113 17696 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.637959 17690 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.649839 17703 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.644374 17687 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.661309 17687 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.661711 17690 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.662660 17698 raft_consensus.cc:493] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.660271 17684 leader_election.cc:290] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.663385 17698 raft_consensus.cc:515] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.651906 17693 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.663842 17687 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.664804 17693 raft_consensus.cc:493] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.665345 17695 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.666330 17695 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.636564 17675 raft_consensus.cc:515] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.669144 17675 leader_election.cc:290] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.669257 17695 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.670692 17692 leader_election.cc:290] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.671594 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.672475 17685 leader_election.cc:290] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.673211 17672 leader_election.cc:290] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.672290 17691 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.670974 17695 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.674201 17704 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.674513 17695 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.675688 16465 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.672339 16644 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:26:02.677729 17693 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.679899 17693 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.680598 17695 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.682271 17698 leader_election.cc:290] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.682724 17688 raft_consensus.cc:493] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.614652 17701 raft_consensus.cc:515] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.706749 17688 raft_consensus.cc:515] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.683653 17679 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.699438 17677 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
W20260709 12:26:02.707931 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 95127.3us
I20260709 12:26:02.729069 16465 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.654078 17681 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.708499 17683 raft_consensus.cc:2804] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.663396 17689 raft_consensus.cc:493] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
W20260709 12:26:02.724395 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 96772.8us
I20260709 12:26:02.733582 17676 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.734342 17676 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.737212 17676 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.739897 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.754459 17362 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:26:02.755442 17688 leader_election.cc:290] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.758060 17701 leader_election.cc:290] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.741140 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.760497 17378 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.742264 17351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.744740 17687 raft_consensus.cc:493] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.762324 17687 raft_consensus.cc:515] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.745986 17712 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.746848 17693 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.765208 17693 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.765030 17712 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.767388 17693 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.731886 17683 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.746587 17681 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.730883 17677 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.748759 17696 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.769001 17696 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.769611 17707 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.770020 17681 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.748333 17689 raft_consensus.cc:515] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.770221 17707 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.772281 17689 leader_election.cc:290] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.772804 17689 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.749315 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.751937 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.773885 17704 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.774117 16645 raft_consensus.cc:2468] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.774490 17704 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.720532 17675 raft_consensus.cc:493] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.775420 17675 raft_consensus.cc:515] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.775954 17709 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.709688 17678 leader_election.cc:290] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.776487 17709 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.777423 17675 leader_election.cc:290] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.739773 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.773212 17689 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.778640 17709 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.709822 17698 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.780889 17698 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.782450 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.782961 17698 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.783182 17367 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:26:02.784142 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.750952 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.759794 17679 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.728682 17674 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.786185 17674 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.788362 17680 raft_consensus.cc:493] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.789055 17680 raft_consensus.cc:515] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.790666 17704 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.791263 17680 leader_election.cc:290] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.792227 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.793128 17679 raft_consensus.cc:493] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.785530 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.793710 17679 raft_consensus.cc:515] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.780365 17689 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.768424 17683 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.795680 16569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303"
dest_uuid: "9579e506d72842a9a847d0498878c3fd"
mode: GRACEFUL
new_leader_uuid: "57226fc89069472b9311be6e596aa8ee"
 from {username='slave'} at 127.0.0.1:56874
I20260709 12:26:02.795843 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.796363 16569 raft_consensus.cc:606] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Received request to transfer leadership to TS 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:02.767925 17693 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.797907 17693 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.798295 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.801456 17715 raft_consensus.cc:493] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.802043 17715 raft_consensus.cc:515] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:26:02.802522 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 73569.5us
I20260709 12:26:02.802642 17688 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:02.803228 17688 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.803596 17688 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.804312 17715 leader_election.cc:290] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.805701 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.806167 17357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.806723 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.807410 17357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.807780 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.809820 17706 raft_consensus.cc:493] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.810360 17706 raft_consensus.cc:515] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.812893 17710 raft_consensus.cc:493] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.813441 17710 raft_consensus.cc:515] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.814353 17683 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.815752 17710 leader_election.cc:290] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.816284 17710 raft_consensus.cc:493] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.825279 17710 raft_consensus.cc:515] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.826612 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.816579 17712 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.808537 17357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.827311 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.827980 17380 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:02.828011 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.817823 17707 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.821806 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.827343 17710 leader_election.cc:290] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.828563 17357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.830058 17382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.831399 17266 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.830878 17693 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.812619 17706 leader_election.cc:290] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.836678 16495 raft_consensus.cc:1240] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:02.838421  6879 debug-util.cc:398] Leaking SignalData structure 0x7b0800336ba0 after lost signal to thread 16613
I20260709 12:26:02.839613 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.840405 16647 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.834033 17681 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.836410 17382 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:26:02.841339 17681 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.838621 17706 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.841607 17710 raft_consensus.cc:493] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.840559 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.842312 17706 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.843629 17681 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.842389 17710 raft_consensus.cc:515] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.839757 17701 raft_consensus.cc:2804] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:02.844689 17701 raft_consensus.cc:493] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.844740 17382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.845184 17701 raft_consensus.cc:3060] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.845593 17706 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.845700 17710 leader_election.cc:290] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.846918 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.847667 16646 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.848125 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.849166 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.849920 16646 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.851521 17688 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.852918 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.854939 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.855078 17710 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.855726 17710 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.856590 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.857862 17707 raft_consensus.cc:493] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.859045 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.859246 17691 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.859480 17707 raft_consensus.cc:515] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.860296 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.858247 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.855747 16646 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:02.858790 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.859894 17691 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.862500 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.862542 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.863407 16646 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 1.
I20260709 12:26:02.863932 17691 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.858101 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.861533 17710 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.861558 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.866084 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.866973 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.868309 16466 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:02.868978 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.869659 17715 raft_consensus.cc:2749] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:02.870337 17707 leader_election.cc:290] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.871397 17704 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.871436 16466 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:02.871881 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.872385 17715 raft_consensus.cc:2804] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.872884 17715 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.872908 16572 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.873476 17715 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.872001 17704 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.880162 16466 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:02.881642 17352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.881982 17681 raft_consensus.cc:2804] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.882477 17681 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.882920 17681 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.827278 17683 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.883778 17707 raft_consensus.cc:493] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.884382 17716 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.884441 17689 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.884928 17702 raft_consensus.cc:493] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.885178 17716 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.885525 17702 raft_consensus.cc:515] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.886716 17694 raft_consensus.cc:493] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.887290 17694 raft_consensus.cc:515] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.887873 17702 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.875448 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.888682 16499 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.889433 17694 leader_election.cc:290] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.892189 17716 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.875941 17351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.876848 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.892819 17693 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.878650 17687 leader_election.cc:290] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.878750 17674 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.879269 17677 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.893395 17693 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.837853 17680 raft_consensus.cc:493] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.894526 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.894467 17680 raft_consensus.cc:515] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:02.895648 17693 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:26:02.896265 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 56551us
I20260709 12:26:02.879631 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.880184 17696 leader_election.cc:290] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.885336 17689 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.899226 17689 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.893428 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.900274 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.900604 16492 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:26:02.894757 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.874023 17691 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:02.902266 17691 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.882197 17704 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.874647 17266 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.902920 16540 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.904260 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.884347 17707 raft_consensus.cc:515] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.910912 16641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.905416 17679 leader_election.cc:290] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.904126 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.912513 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.905422 16466 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:02.913120 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.910028 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.910303 17691 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.914036 16466 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:02.914465 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.911854 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.915473 16466 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:02.915679 17706 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.915828 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002181790b60483db2f0b175ffa46e97" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.913820 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.916143 17706 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.916409 17685 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.916697 17706 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.914647 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.917057 17685 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.917394 16492 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:02.917554 17685 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.918352 17683 raft_consensus.cc:2749] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:02.871455 16614 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
W20260709 12:26:02.920010 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 48622us
I20260709 12:26:02.915503 17680 leader_election.cc:290] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.924973 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.920660 17696 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.925884 17696 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.924450 16614 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.921350 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.922102 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.917542 17708 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:02.929383 17708 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:02.929816 17708 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.929873 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.930758 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.926406 17696 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:02.928390 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 54031.6us
I20260709 12:26:02.931582 16572 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.932175 17691 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:02.932962 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.928714 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.934878 17712 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:02.934813 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.935410 17712 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.935848 17712 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.937002 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.911746 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7e81a4e4bb44878fc114bec5022722" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.938438 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:26:02.926985 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.938767 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.927013 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.907835 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.928287 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c4e3e74104556b0fdc8dbf900c78b" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.930902 16540 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:02.905251 17715 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.932753 17691 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:02.931159 17713 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:02.905722 17688 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:02.941252 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.941357 17701 raft_consensus.cc:515] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.942950 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.995860 16569 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.939514 16572 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.944387 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.996583 17691 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.927649 17685 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.996973 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.997154 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.998158 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.998577 17715 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.963982 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.998859 17685 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.948215 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.999298 17691 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:02.999727 17691 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.000073 17691 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.000154 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.000821 16575 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:03.001627 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.002027 16465 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:02.946493 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.891963 17681 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:02.999286 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.947351 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.004000 17701 leader_election.cc:290] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:02.927973 16466 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:03.004330 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.953712 17351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:03.005087 17682 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:03.005548 17682 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:03.005973 17682 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:02.951210 17367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.963168 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.959908 17696 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.946234 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.009827 16570 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.915468 17707 leader_election.cc:290] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:02.971933 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.010596 17696 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:02.947762 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d" is_pre_election: true
I20260709 12:26:02.973665 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.974936 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a4d37de09ac428a9151d21ca953d08c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.012507 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.013154 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.013672 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.014411 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419069393a644530ac323793012d5f9c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:26:03.014786 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 86889.7us
I20260709 12:26:02.975706 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.976585 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.015923 17688 raft_consensus.cc:2749] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:02.977172 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.016722 16465 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.017552 17688 raft_consensus.cc:2749] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:02.983593 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.984767 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.985677 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5374aa54af41848399d9477ec0fccf" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.986133 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd8dd213a384928ad8674ef30844b45" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.986555 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.031342 16494 raft_consensus.cc:2468] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8133a8f49724a8897d8bc4f718d802d in term 1.
I20260709 12:26:02.987393 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71519fa014734fe68b4df3cea03ca766" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.033322 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.018620 16465 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.034531 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.035444 17715 raft_consensus.cc:2749] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.036194 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.038043 16465 leader_election.cc:304] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.038820 17715 raft_consensus.cc:2749] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.039441 17707 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.040077 16465 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.040550 17265 leader_election.cc:304] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:02.988932 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b09eddf44e747eb9bc7886771ea40fd" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:02.990044 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.990365 16641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:02.995354 17713 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:02.998420 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.044071 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.044207 17715 raft_consensus.cc:2749] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.044670 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.045383 17679 raft_consensus.cc:2749] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.045934 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.046439 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.047150 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.047812 16572 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:02.956553 17706 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.002136 16575 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:02.945724 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.049486 17265 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:02.999337 16573 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:03.004443 17681 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:03.050312 17706 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:03.005084 16574 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 1.
I20260709 12:26:03.051025 17679 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:03.017463 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:02.981207 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.052800 17265 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d; no voters: 
I20260709 12:26:03.018939 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.053753 17679 raft_consensus.cc:2804] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:03.054160 17679 raft_consensus.cc:493] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:03.023306 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.054558 17679 raft_consensus.cc:3060] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:02.988546 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafc96e5f9404fd4be84ec37525a1b25" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:26:03.023991 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 93162.2us
I20260709 12:26:02.972944 16614 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d; no voters: 
W20260709 12:26:03.057404 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 84544.5us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:487: Failure
Failed
Bad status: Remote error: Service unavailable: leadership transfer for 0a637f29bcd04712ae40966d9b293303 already in progress
I20260709 12:26:03.059221 17687 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.059448  6874 tablet_server.cc:179] TabletServer@127.6.182.129:35115 shutting down...
I20260709 12:26:03.059677 17687 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.060180 17687 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.971231 17712 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.028025 16615 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.029263 17708 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.064795 17712 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.066052 17676 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.066493 17676 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.066923 17676 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.068317 17708 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:03.068992 16643 raft_consensus.cc:2393] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:03.068650 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:26:03.073374 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 45434.1us
I20260709 12:26:03.078131 16614 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.039999 17707 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:02.955457 17352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8133a8f49724a8897d8bc4f718d802d"
I20260709 12:26:03.043422 17713 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.049649 16571 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:02.949602 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.019799 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.023192 17691 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.096444 16541 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.099478 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.083269 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.098209 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab5fdb3eb3e45b2a3b1acf9288fc9c5" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.101646 17704 raft_consensus.cc:2749] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.099112 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.102779 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.097743 16499 raft_consensus.cc:1240] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.084944 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2d3f30f6a6496fa42959f3adc78ff9" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.080507 17687 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:26:03.094235 16353 debug-util.cc:398] Leaking SignalData structure 0x7b08003813e0 after lost signal to thread 6877
I20260709 12:26:03.103924 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.084038 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.104652 17266 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.097821 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.085691 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.106549 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35263f5174d84840b741879f4ba4e980" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.081499 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b59162ae2d417092181b3f9198701e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.107610 16541 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.107851 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.082295 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c6323485424469a3be43cd3a647cad" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.100560 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.081355 17707 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.101754 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.106103 17701 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.110145 17696 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.101969 16566 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:03.110833 17696 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.111303 17696 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.111661 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.110180 17266 leader_election.cc:304] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.108559 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.113266 16614 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.113855 17266 leader_election.cc:304] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.110046 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bce0408d844486ae486633aad4bc7e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.114884 17680 raft_consensus.cc:2749] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.115583 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5dd7018976414e8ed99fd67565655d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.111104 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.100035 16493 raft_consensus.cc:1240] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.104516 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.117203 16571 raft_consensus.cc:2368] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3.
I20260709 12:26:03.118271 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
W20260709 12:26:03.104784 16353 debug-util.cc:398] Leaking SignalData structure 0x7b08003fee60 after lost signal to thread 16356
I20260709 12:26:03.118973 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2855310d11c545378f19afd1715ebb47" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.119635 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:26:03.120240 16353 debug-util.cc:398] Leaking SignalData structure 0x7b080005f560 after lost signal to thread 16525
I20260709 12:26:03.121024 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.120101 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.113936 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f105035b4f4eda8c0fb001d571ddaa" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.016286 16466 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
W20260709 12:26:03.121572 16353 debug-util.cc:398] Leaking SignalData structure 0x7b08000d51c0 after lost signal to thread 16599
I20260709 12:26:03.121974 17674 raft_consensus.cc:2749] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.121263 17266 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.078809 16615 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:03.123699 17704 raft_consensus.cc:2749] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.125061 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17303c99a9d4e87b2d1903bff808994" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.125805 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.018738 17682 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:03.180712 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 54192.9us
I20260709 12:26:03.180832 16614 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:03.194728 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 73560.1us
W20260709 12:26:03.182305 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 63648.8us
I20260709 12:26:03.188939 16541 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.191601 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 175391us
W20260709 12:26:03.191675 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 112945us
I20260709 12:26:03.196542 16466 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.197952 16466 leader_election.cc:304] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.198853 17715 raft_consensus.cc:2749] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.200073 16466 leader_election.cc:304] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.201467 17684 raft_consensus.cc:2749] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:03.195611 17266 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.202523 17674 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:03.202996 17674 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:03.203106 17266 leader_election.cc:304] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.203449 17674 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.203591 17682 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:03.204309 17706 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:03.198137 17703 raft_consensus.cc:2749] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.204747 17706 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:03.205205 17706 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.205581 17266 leader_election.cc:304] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:03.205849 16353 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6d20 after lost signal to thread 16673
I20260709 12:26:03.206437 17678 raft_consensus.cc:2749] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.207077 17678 raft_consensus.cc:2749] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.207394 16353 debug-util.cc:398] Leaking SignalData structure 0x7b080039a5e0 after lost signal to thread 17415
I20260709 12:26:03.207706 17678 raft_consensus.cc:2749] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.207985 16614 leader_election.cc:304] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.208702 17677 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.209210 17266 leader_election.cc:400] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3.
I20260709 12:26:03.209591 17266 leader_election.cc:403] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.201762 17680 raft_consensus.cc:2749] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.210135 17708 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.196547 16615 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.207816 16353 debug-util.cc:398] Leaking SignalData structure 0x7b0800074660 after lost signal to thread 17633
I20260709 12:26:03.211262 17266 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.214210 16541 leader_election.cc:304] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.214442 17686 raft_consensus.cc:2749] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.215726 16541 leader_election.cc:304] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.211725 16614 leader_election.cc:304] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.113286 17701 raft_consensus.cc:2749] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.213655 16615 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:03.211406 16465 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 246 similar messages]
I20260709 12:26:03.209172 17677 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.229405 17691 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.197891 17687 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:03.253561 17695 raft_consensus.cc:2749] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.253935 16540 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.253935 16541 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.216935 17716 raft_consensus.cc:2749] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.256258 17709 raft_consensus.cc:2749] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.213989 16353 debug-util.cc:398] Leaking SignalData structure 0x7b0800177a60 after lost signal to thread 17634
I20260709 12:26:03.228706 17711 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.246558 17713 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.261360 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.261715 16540 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.262856 17713 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.263447 17709 raft_consensus.cc:2749] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.263736 16540 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.263010 17698 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:03.217029 17707 raft_consensus.cc:2749] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.263295 17694 consensus_queue.cc:1059] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.240047 17676 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.265890 17694 raft_consensus.cc:3055] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.266279 17694 raft_consensus.cc:740] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.267457 17676 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.267213 17694 consensus_queue.cc:260] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.264611 17716 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.267913 16645 raft_consensus.cc:1240] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.214468 17675 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.268679 17675 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.269100 17675 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.269176 16540 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.271426 17707 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.272764 17265 leader_election.cc:304] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.275775 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.219062 17686 raft_consensus.cc:2749] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.278098 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.222997 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.219208 17697 raft_consensus.cc:2749] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.280771 17677 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.281469 16645 raft_consensus.cc:2393] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:03.287766 17708 raft_consensus.cc:2749] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3.
I20260709 12:26:03.271216 17706 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.288724 16540 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.289670 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.290426 17696 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:03.289721 17713 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.287921 17694 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.293102 17713 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.293623 17713 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.295738 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.297536 17677 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.297816 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.299741 17677 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.299461 17679 raft_consensus.cc:515] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.230026 16466 leader_election.cc:304] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.301476 17688 raft_consensus.cc:2749] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.301637 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 71730.6us
I20260709 12:26:03.220600 16615 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.302887 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:26:03.303668 17265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 87631.5us
I20260709 12:26:03.304504 16466 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.303313 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 82767.4us
I20260709 12:26:03.303509 17714 raft_consensus.cc:2749] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.304672 17265 leader_election.cc:304] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.305455 17688 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.306017 17688 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.306126 17714 raft_consensus.cc:2749] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.306473 17688 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.311430 17677 raft_consensus.cc:2749] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.312704 17265 leader_election.cc:304] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.314113 17699 raft_consensus.cc:2749] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.316601 17265 leader_election.cc:304] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
W20260709 12:26:03.303305 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 68738.1us
I20260709 12:26:03.334249 17701 raft_consensus.cc:2749] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.321676 16615 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:03.341197 16615 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:03.342399 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 94935us
I20260709 12:26:03.320421 17674 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:03.343393 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 132007us
I20260709 12:26:03.306465 16466 leader_election.cc:304] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.315974 17688 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.344318 17677 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.292467 17696 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:03.354728 17675 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.292467 17706 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:03.359035 16615 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:03.371447 16615 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:03.372510 17711 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:03.372970 17711 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.373299 17711 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:03.361609 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 55217.4us
I20260709 12:26:03.374169 16466 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.375861 16466 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.376873 17684 raft_consensus.cc:2749] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.377637 17684 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.377419 16466 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.364567 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.378157 17684 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.378873 17684 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.367362 16497 raft_consensus.cc:1240] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:03.380643 17676 raft_consensus.cc:2804] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:03.381461 17676 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
W20260709 12:26:03.367090 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.383522 16645 raft_consensus.cc:1240] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.382320 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:03.385533 16615 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.385962 16466 leader_election.cc:304] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.387562 17692 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.387835 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.388126 17692 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.388655 17692 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.388772 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.389324 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.390472 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56252914f95a4889a4f744beb66359d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.369920 17682 raft_consensus.cc:2749] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.392738 17703 raft_consensus.cc:2749] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.390496 17641 raft_consensus.cc:2749] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:03.386355 17676 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.396085 17679 leader_election.cc:290] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.368080 17677 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.396657 17687 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.397286 17687 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.397744 17687 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.398891 17674 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.387419 16615 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.396746 17677 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.361272 17686 raft_consensus.cc:2749] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.401849 17686 raft_consensus.cc:2749] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.369155 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.416339 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.410108 16466 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.419319 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.420594 17694 consensus_queue.cc:1059] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:03.421169 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.421732 17694 raft_consensus.cc:3055] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.420595 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.422813 16493 raft_consensus.cc:2393] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:03.419008 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.424346 16571 raft_consensus.cc:2393] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 3: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:26:03.422173 17694 raft_consensus.cc:740] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.427378 17703 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:03.432698 17703 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:03.433144 17703 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.433270 17694 consensus_queue.cc:260] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.434623 17694 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.437822 16645 raft_consensus.cc:1240] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.439672 17702 consensus_queue.cc:1059] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.440851 17704 raft_consensus.cc:3055] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.441220 17704 raft_consensus.cc:740] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.428380 16466 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.429141 17675 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:03.429530 17692 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:26:03.447331 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.452250 16465 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.452673 16466 leader_election.cc:304] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.369072 17699 consensus_queue.cc:1059] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:26:03.455140 16466 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.458839 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 45842.7us
I20260709 12:26:03.460593 16466 leader_election.cc:304] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:03.455639 16465 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.442096 17704 consensus_queue.cc:260] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.480983 17688 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.467478 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.482647 17711 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.485705 17711 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.467147 17685 raft_consensus.cc:2749] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.460289 17681 raft_consensus.cc:2749] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.479480 17703 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.458374 17715 raft_consensus.cc:2749] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.476102 17713 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.466562 16466 leader_election.cc:304] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.456254 17682 raft_consensus.cc:2749] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.489975 16465 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.536860 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 69948.2us
W20260709 12:26:03.536378 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 43832.1us
W20260709 12:26:03.536337 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 153791us
W20260709 12:26:03.540505 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 74302.2us
I20260709 12:26:03.541744 16645 raft_consensus.cc:1240] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:03.539592 16465 consensus_peers.cc:597] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.546272 16648 raft_consensus.cc:1240] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.546725 17681 raft_consensus.cc:2749] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.561117 17703 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.561632 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef6c0d79aee443896c5b4c0cc5ea863" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.556222 17676 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.536857 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:26:03.551190 16614 leader_election.cc:336] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.565263 16614 leader_election.cc:304] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.572157 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.574445 17676 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.575522 17722 raft_consensus.cc:2749] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.575423 17684 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.578339 17677 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.585755 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.589591 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.598284 16649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.588894 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.603796 16574 raft_consensus.cc:1240] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Rejecting Update request from peer 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.606542 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.617784 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:26:03.600881 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 293646us
I20260709 12:26:03.589335 16645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.600997 16647 raft_consensus.cc:1240] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.606994 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.642670 16574 raft_consensus.cc:1240] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.647769 16649 raft_consensus.cc:1240] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:03.609988 16615 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.599601 17704 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.652314 17713 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:03.592497 17692 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.580595 17677 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.591722 16644 raft_consensus.cc:1240] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.596544 16641 raft_consensus.cc:1240] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:03.656831 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 46944us
I20260709 12:26:03.657612 16615 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.599974 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.590754 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.591693 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.591187 16492 raft_consensus.cc:1240] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.659307 17711 raft_consensus.cc:2749] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.593601 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.630033 17701 raft_consensus.cc:3055] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:03.659956 16539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.607332 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.601816 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.600106 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:03.664309 16497 raft_consensus.cc:1240] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.604168 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.661428 17266 leader_election.cc:304] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.598536 17687 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.657744 17714 consensus_queue.cc:1059] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:26:03.666700 17701 raft_consensus.cc:740] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.664851 17679 consensus_queue.cc:1059] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:03.680852 17722 consensus_queue.cc:1059] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.681066 17701 consensus_queue.cc:260] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.682026 17722 raft_consensus.cc:3055] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.682147 17701 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.682447 17722 raft_consensus.cc:740] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:03.661522 17677 raft_consensus.cc:2749] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.678946 17714 raft_consensus.cc:3055] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.691355 17714 raft_consensus.cc:740] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.691877 17708 consensus_queue.cc:1059] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.679518 16648 raft_consensus.cc:1240] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.693960 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.671799 17684 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.692359 17714 consensus_queue.cc:260] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.679107 17687 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.697108 17714 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.683440 17722 consensus_queue.cc:260] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:03.698694 17722 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:03.699878 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.701138 17708 raft_consensus.cc:3055] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.701517 17708 raft_consensus.cc:740] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.701722 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.702374 17708 consensus_queue.cc:260] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.703943 16492 raft_consensus.cc:1240] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:03.705013 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.706132 17678 consensus_queue.cc:1059] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.711937 17708 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:03.712443 16614 leader_election.cc:336] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.676666 16615 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.713013 16614 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.714298 16615 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.688396 16500 raft_consensus.cc:1240] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.688568 17697 raft_consensus.cc:2749] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.688611 17679 raft_consensus.cc:3055] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.690668 17720 consensus_queue.cc:1059] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.716324 16648 raft_consensus.cc:1240] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.717339 16497 raft_consensus.cc:1240] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer a8133a8f49724a8897d8bc4f718d802d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.717959 17720 raft_consensus.cc:3055] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.717366 17679 raft_consensus.cc:740] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.718349 17720 raft_consensus.cc:740] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.720727 17680 consensus_queue.cc:1059] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.721479 17679 consensus_queue.cc:260] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:03.722978 17679 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.725284 17720 consensus_queue.cc:260] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.726769 17720 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.728892 17677 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.729074 17674 raft_consensus.cc:2749] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.729480 17680 consensus_queue.cc:1059] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.728933 17676 raft_consensus.cc:2749] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.730571 17680 raft_consensus.cc:3055] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.730930 17680 raft_consensus.cc:740] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.731293 16615 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.732105 17676 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:26:03.733436 16614 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.734043 16614 leader_election.cc:336] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.734503 16614 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.735754 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.736398 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.736428 16466 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.739149 16466 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.740448 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:03.740689 17684 raft_consensus.cc:2749] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.741492 17684 raft_consensus.cc:2749] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.742095 17684 consensus_queue.cc:1059] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:03.742509 16465 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.743376 17684 raft_consensus.cc:3055] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.743752 17684 raft_consensus.cc:740] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:03.744612 17684 consensus_queue.cc:260] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.747066 17684 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.748842  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:03.740507 16466 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.750340 17699 raft_consensus.cc:3055] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.737769 17674 raft_consensus.cc:2749] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.731750 17680 consensus_queue.cc:260] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.750810 17699 raft_consensus.cc:740] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8133a8f49724a8897d8bc4f718d802d, State: Running, Role: LEADER
I20260709 12:26:03.750844 17685 consensus_queue.cc:1059] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:03.755108 16466 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.755213 17699 consensus_queue.cc:260] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.757676 17680 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.750344 17688 raft_consensus.cc:2749] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.756304 16465 leader_election.cc:336] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.751175  6874 tablet_replica.cc:333] stopping tablet replica
W20260709 12:26:03.758247 16614 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.764816 16614 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.765642 17677 raft_consensus.cc:2749] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.767056 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.768131 16614 leader_election.cc:336] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.769194 16614 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.756019 17710 consensus_queue.cc:1059] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:03.759222 17699 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.759667 17685 raft_consensus.cc:3055] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:03.773439 17685 raft_consensus.cc:740] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
W20260709 12:26:03.774586 16614 leader_election.cc:336] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.774391 17685 consensus_queue.cc:260] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.775080 16614 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.775820 17685 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:03.773443 17710 raft_consensus.cc:3055] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.777208 17710 raft_consensus.cc:740] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:03.758370 16465 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.763227 17706 raft_consensus.cc:2749] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:03.764194 16466 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.778002 17710 consensus_queue.cc:260] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.778887 17706 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.779534 17710 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.771981  6874 raft_consensus.cc:2243] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.780401  6874 raft_consensus.cc:2272] T 459c4e3e74104556b0fdc8dbf900c78b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.784026  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.754858 17692 consensus_queue.cc:1059] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:03.785461 17677 raft_consensus.cc:2749] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.786201 17677 raft_consensus.cc:2749] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.787315 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.787935 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.788204 17684 raft_consensus.cc:3055] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.788686 17684 raft_consensus.cc:740] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
W20260709 12:26:03.788434 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.789539 17684 consensus_queue.cc:260] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:26:03.790343 16614 leader_election.cc:336] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.790702 17684 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.790737 16614 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.798501 17674 raft_consensus.cc:2749] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.799084 16540 leader_election.cc:304] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
W20260709 12:26:03.799882 17266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 80579us
I20260709 12:26:03.800105 17694 raft_consensus.cc:2749] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:03.799894 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.801136 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.801425 16540 leader_election.cc:304] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.802151 17694 raft_consensus.cc:2749] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.805074 17694 consensus_queue.cc:1059] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.806022 17713 raft_consensus.cc:3055] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.806434 17713 raft_consensus.cc:740] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.807308 17713 consensus_queue.cc:260] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.807901 17710 raft_consensus.cc:2749] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.808365 17713 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:03.808851 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 52586.6us
I20260709 12:26:03.812203 16497 raft_consensus.cc:1240] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.812314 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:03.812871 16492 raft_consensus.cc:1240] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.815855 16540 leader_election.cc:304] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.816699 17704 raft_consensus.cc:2749] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.822672 16540 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.823382 17713 raft_consensus.cc:2749] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.824749 17713 consensus_queue.cc:1059] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:03.824910 16540 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.825783  6874 raft_consensus.cc:2243] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.826407 17704 raft_consensus.cc:3055] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:03.826524 17694 raft_consensus.cc:2749] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.827037 17704 raft_consensus.cc:740] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.828204 16648 raft_consensus.cc:1240] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Rejecting Update request from peer 57226fc89069472b9311be6e596aa8ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:03.828001 17704 consensus_queue.cc:260] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.829879 17704 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:03.828449  6874 raft_consensus.cc:2272] T 25341f99080e43ab92f1b8ffdd24bd2b P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.833639 17694 consensus_queue.cc:1059] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.834883 17713 raft_consensus.cc:3055] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.835314 17713 raft_consensus.cc:740] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.835847  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.836370 17713 consensus_queue.cc:260] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.828809 16466 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.841007 17713 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.844923 17710 raft_consensus.cc:2749] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.828405 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:03.838171 17694 consensus_queue.cc:1059] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.836920  6874 raft_consensus.cc:2243] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.845687 17710 consensus_queue.cc:1059] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.846674 17694 raft_consensus.cc:3055] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.847038 17694 raft_consensus.cc:740] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.847137 17710 raft_consensus.cc:3055] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.847599 17710 raft_consensus.cc:740] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:03.847949 17694 consensus_queue.cc:260] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.848474 17710 consensus_queue.cc:260] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.849437 17694 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.849783 17710 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:03.850590 17685 consensus_queue.cc:1175] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9579e506d72842a9a847d0498878c3fd" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:26:03.839311 17716 consensus_queue.cc:1059] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.854720 17716 raft_consensus.cc:3055] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.855118 17716 raft_consensus.cc:740] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:03.856065 17716 consensus_queue.cc:260] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.856874 16492 raft_consensus.cc:1240] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Rejecting Update request from peer 9579e506d72842a9a847d0498878c3fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:03.858134 17716 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.861254  6874 raft_consensus.cc:2272] T 002181790b60483db2f0b175ffa46e97 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:03.856792 16465 leader_election.cc:336] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.862416 16465 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.863679 16465 leader_election.cc:336] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.864210 17684 raft_consensus.cc:2749] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.869102 17722 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.870642 16465 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.867257  6874 tablet_replica.cc:333] stopping tablet replica
W20260709 12:26:03.878115 16540 leader_election.cc:336] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.878219  6874 raft_consensus.cc:2243] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.880092 17684 raft_consensus.cc:2749] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.880894  6874 raft_consensus.cc:2272] T bb5374aa54af41848399d9477ec0fccf P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:03.882176 16465 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.882432 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 54093.4us
I20260709 12:26:03.878742 16540 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.882928 16465 leader_election.cc:336] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.883834 17684 consensus_queue.cc:1059] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.886708  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.887871 17685 raft_consensus.cc:3055] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.888351 17685 raft_consensus.cc:740] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:03.889047 17716 raft_consensus.cc:2749] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.889484  6874 raft_consensus.cc:2243] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.889364 17685 consensus_queue.cc:260] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:03.890906  6874 raft_consensus.cc:2272] T 56252914f95a4889a4f744beb66359d2 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.890952 17685 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.894851  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.896059  6874 raft_consensus.cc:2243] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.896729  6874 raft_consensus.cc:2272] T 7c6984bac3db42cca9c8fb4969479f32 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:03.887315 16540 leader_election.cc:336] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.900703 16540 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.901520 17716 raft_consensus.cc:2749] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.902004 16540 leader_election.cc:336] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.902590 16540 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.903339 17716 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.903771 16540 leader_election.cc:336] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.904325 16540 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.883494 16465 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.905112 17716 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.905877 17710 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.907310  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.908461  6874 raft_consensus.cc:2243] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.909222  6874 raft_consensus.cc:2272] T 98012d4197b649e6be7f7df5d46b6218 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:03.911332 16540 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.911924 16540 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.912747 17716 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:03.913177 16540 leader_election.cc:336] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.913693 16540 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.914515 17716 raft_consensus.cc:2749] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.914947 16540 leader_election.cc:336] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.914291  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.915573 16540 leader_election.cc:304] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:03.917024 16540 leader_election.cc:336] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.917438 16540 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.918483 17713 raft_consensus.cc:2749] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.918632 16540 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.919142 16540 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.919313 17713 raft_consensus.cc:2749] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.926272  6874 raft_consensus.cc:2243] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.927124  6874 raft_consensus.cc:2272] T 4a4d37de09ac428a9151d21ca953d08c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.928733 17713 raft_consensus.cc:2749] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:03.929875 16540 leader_election.cc:336] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:03.930402 16540 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:03.931173 17699 raft_consensus.cc:493] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:03.936012  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.936920 17699 raft_consensus.cc:515] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:03.938028  6874 raft_consensus.cc:2243] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.938076 17713 raft_consensus.cc:2749] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.939052  6874 raft_consensus.cc:2272] T 2a2d3f30f6a6496fa42959f3adc78ff9 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.939450 17699 leader_election.cc:290] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:03.941313 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.941661 17699 raft_consensus.cc:493] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:03.941843 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b875e4a6504b43ef98139d098839a56c" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:03.942330 17699 raft_consensus.cc:515] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:03.943645 17266 leader_election.cc:304] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:03.944773 17708 raft_consensus.cc:2749] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:03.944882 17720 raft_consensus.cc:493] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:03.945520 17720 raft_consensus.cc:515] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:03.947276  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:03.953104 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.950438 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:03.947898 17720 leader_election.cc:290] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:03.958125 17708 raft_consensus.cc:493] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
W20260709 12:26:03.939502 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:04.043478 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 104032us
W20260709 12:26:04.044384 16540 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:04.044844 16540 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:04.045600 17713 raft_consensus.cc:2749] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:04.047214 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:03.958668 16541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.951974 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fcca6ce8824a0884716942fc18ff9a" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:04.050598 17266 leader_election.cc:304] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:04.051924 17720 raft_consensus.cc:2749] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:03.948702 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10685b118db4ae794b1ecf232267bb8" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:03.958501 17699 leader_election.cc:290] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:04.058220 17265 leader_election.cc:304] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:04.041320  6874 raft_consensus.cc:2243] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.060021  6874 raft_consensus.cc:2272] T 39b59162ae2d417092181b3f9198701e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.043411 17708 raft_consensus.cc:515] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:04.059242 17699 raft_consensus.cc:2749] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:04.063526 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:04.065574  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.066793  6874 raft_consensus.cc:2243] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.067543  6874 raft_consensus.cc:2272] T 440906c79bf64ae3bd7a7b15c6abba82 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.068778 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad58928df6e4de09d9efac2b2da0a2e" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:04.068575 17713 consensus_queue.cc:1059] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:04.069929 17713 raft_consensus.cc:3055] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:04.070297 17713 raft_consensus.cc:740] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:04.071539  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.071275 17713 consensus_queue.cc:260] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.073053 17266 leader_election.cc:304] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:04.074054 17699 raft_consensus.cc:2749] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:04.075217 17713 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:04.072690  6874 raft_consensus.cc:2243] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.077534 17699 raft_consensus.cc:493] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:04.078073  6874 raft_consensus.cc:2272] T c753e3027c7b414c9b0eb823b6c2893e P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.078146 17699 raft_consensus.cc:515] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:04.083091 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:04.086527 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52cfc56c2e6b47dca2c52bfe83853728" candidate_uuid: "a8133a8f49724a8897d8bc4f718d802d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:04.086993  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.088234  6874 raft_consensus.cc:2243] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.088387 17266 leader_election.cc:304] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8133a8f49724a8897d8bc4f718d802d; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:04.088809  6874 raft_consensus.cc:2272] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.089360 17720 raft_consensus.cc:2749] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:04.089540 17699 leader_election.cc:290] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:04.095108 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:04.095561 17708 leader_election.cc:290] T 1ad58928df6e4de09d9efac2b2da0a2e P a8133a8f49724a8897d8bc4f718d802d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:04.098795 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:04.099506 16540 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:04.100167 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:04.100932 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:04.101944 16540 leader_election.cc:336] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:04.103022 16540 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:04.103899 17713 raft_consensus.cc:2749] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:04.110476  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.111696  6874 raft_consensus.cc:2243] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.112267  6874 raft_consensus.cc:2272] T 2abf5d33e7a744ab8a191960f961bdcd P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.115689  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.116758  6874 raft_consensus.cc:2243] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.118047  6874 raft_consensus.cc:2272] T 96e703662cca4f18a580ec34362c26ba P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.121344  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.122359  6874 raft_consensus.cc:2243] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.122944  6874 raft_consensus.cc:2272] T cafc96e5f9404fd4be84ec37525a1b25 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.126403  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.127454  6874 raft_consensus.cc:2243] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.128127  6874 raft_consensus.cc:2272] T 35263f5174d84840b741879f4ba4e980 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.132004  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.133074  6874 raft_consensus.cc:2243] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.134421  6874 raft_consensus.cc:2272] T 020b055b364646c9b177588ef98ec412 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.148902  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.149904  6874 raft_consensus.cc:2243] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.150554  6874 raft_consensus.cc:2272] T 2ef6c0d79aee443896c5b4c0cc5ea863 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.154794  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.155871  6874 raft_consensus.cc:2243] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.156463  6874 raft_consensus.cc:2272] T f4d8cd99199d478e8112f6890e152dd7 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.160040  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.161064  6874 raft_consensus.cc:2243] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.161619  6874 raft_consensus.cc:2272] T 71519fa014734fe68b4df3cea03ca766 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.177131  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.178330  6874 raft_consensus.cc:2243] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.179486  6874 raft_consensus.cc:2272] T 09a476f9e5784529a3f8e75fed90d096 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.182879  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.183781  6874 raft_consensus.cc:2243] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.184444  6874 raft_consensus.cc:2272] T 4e7e81a4e4bb44878fc114bec5022722 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.202797  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.203755  6874 raft_consensus.cc:2243] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.204358  6874 raft_consensus.cc:2272] T b9ab7bf5977d4d7e9033989e7f6ddc3f P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.211345  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.212863  6874 raft_consensus.cc:2243] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.213651  6874 raft_consensus.cc:2272] T 6b09eddf44e747eb9bc7886771ea40fd P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.236044  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.236987  6874 raft_consensus.cc:2243] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.256289  6874 raft_consensus.cc:2272] T 419069393a644530ac323793012d5f9c P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.265544  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.266535  6874 raft_consensus.cc:2243] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.267190  6874 raft_consensus.cc:2272] T bb9f76a3c6784d0f97f736edeb104e6b P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.270666  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.271575  6874 raft_consensus.cc:2243] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.272156  6874 raft_consensus.cc:2272] T 912f04f17584451592c26c403070693c P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.283398  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.284338  6874 raft_consensus.cc:2243] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.285562  6874 raft_consensus.cc:2272] T 729d22f5fdb4470dbb68890b960a8395 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.297001  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.298022  6874 raft_consensus.cc:2243] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.304396  6874 raft_consensus.cc:2272] T 30c6323485424469a3be43cd3a647cad P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.307981  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.309900  6874 raft_consensus.cc:2243] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.310478  6874 raft_consensus.cc:2272] T b875e4a6504b43ef98139d098839a56c P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.313660  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.314525  6874 raft_consensus.cc:2243] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.315147  6874 raft_consensus.cc:2272] T 229e66771a884b868626f2c5c0f7ce0e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.318519  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.319356  6874 raft_consensus.cc:2243] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.319880  6874 raft_consensus.cc:2272] T 06cf958045274e6f8c8b60508d68cf26 P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.323161  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.323947  6874 raft_consensus.cc:2243] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.325115  6874 raft_consensus.cc:2272] T f6439a65987543bbb05819426afdf56f P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.328358  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.329303  6874 raft_consensus.cc:2243] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.329869  6874 raft_consensus.cc:2272] T f1fcca6ce8824a0884716942fc18ff9a P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.333082  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.333973  6874 raft_consensus.cc:2243] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.334590  6874 raft_consensus.cc:2272] T e2f105035b4f4eda8c0fb001d571ddaa P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.337999  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.339036  6874 raft_consensus.cc:2243] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.339677  6874 raft_consensus.cc:2272] T a8ad60577d0e48709e6040873bb43f0c P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.342913  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.343765  6874 raft_consensus.cc:2243] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.344400  6874 raft_consensus.cc:2272] T 55bce0408d844486ae486633aad4bc7e P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.357714  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.358518  6874 raft_consensus.cc:2243] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.359040  6874 raft_consensus.cc:2272] T 52cfc56c2e6b47dca2c52bfe83853728 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.414705  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.415567  6874 raft_consensus.cc:2243] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:04.416924  6874 raft_consensus.cc:2272] T 6271255b6fb24144ae8515a99a98297a P a8133a8f49724a8897d8bc4f718d802d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.420301  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.440685  6874 raft_consensus.cc:2243] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.441388  6874 raft_consensus.cc:2272] T 2855310d11c545378f19afd1715ebb47 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.444593  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.445549  6874 raft_consensus.cc:2243] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.446205  6874 raft_consensus.cc:2272] T a10685b118db4ae794b1ecf232267bb8 P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.450369  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.451130  6874 raft_consensus.cc:2243] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.451762  6874 raft_consensus.cc:2272] T 607f98fb104d4e60bb399f4e52414dff P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.454782  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.455503  6874 raft_consensus.cc:2243] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.456067  6874 raft_consensus.cc:2272] T 12bffdfc1b45484c9452392f860318fd P a8133a8f49724a8897d8bc4f718d802d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.458938  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:04.459636  6874 raft_consensus.cc:2243] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.460242  6874 raft_consensus.cc:2272] T 9bd8dd213a384928ad8674ef30844b45 P a8133a8f49724a8897d8bc4f718d802d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.839187 17704 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.839749 17704 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:04.841969 17704 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:04.845609 17711 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:04.845834 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:04.846230 17711 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.846596 16500 raft_consensus.cc:2468] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:04.850332 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:04.850802 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:04.851228 16500 raft_consensus.cc:2393] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:04.851577 16573 raft_consensus.cc:2468] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:04.853955 16615 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:04.854799 17722 raft_consensus.cc:2804] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:04.855199 17722 raft_consensus.cc:493] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:04.855576 17722 raft_consensus.cc:3060] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:04.860037 16540 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:04.862732 17694 raft_consensus.cc:2804] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:04.863148 17694 raft_consensus.cc:493] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.863505 17694 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:04.848531 17711 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:04.892937 16540 leader_election.cc:336] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:04.900180 17694 raft_consensus.cc:515] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:04.906078 17722 raft_consensus.cc:515] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.909031 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:04.909931 16492 raft_consensus.cc:2393] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:04.910135 17694 leader_election.cc:290] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
W20260709 12:26:04.913026 16540 leader_election.cc:336] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:04.913206 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6984bac3db42cca9c8fb4969479f32" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:04.913955 16492 raft_consensus.cc:3060] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:04.915295 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6f61d9e2dc485baa469c1bcf3f9b6d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:04.922065 17711 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:04.922652 17711 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.924700 17711 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:04.926282 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:04.927073 16568 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:04.927348 16492 raft_consensus.cc:2468] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:04.926357 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:04.928642 16500 raft_consensus.cc:2393] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:04.929823 16615 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:04.931416 17676 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:04.931814 17676 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:04.931926 17722 leader_election.cc:290] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:04.932260 17676 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:04.931831 16573 raft_consensus.cc:2468] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:04.934131 16615 leader_election.cc:304] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:04.935281 17711 raft_consensus.cc:2804] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:04.935837 17711 raft_consensus.cc:697] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:04.936812 17711 consensus_queue.cc:237] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.940856 17676 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.943794 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:04.943796 16540 leader_election.cc:304] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:04.944887 16492 raft_consensus.cc:2393] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:04.944919 17694 raft_consensus.cc:2804] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:04.945633 17694 raft_consensus.cc:697] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:04.946805 17694 consensus_queue.cc:237] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:04.956177 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:04.958540 17676 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:04.966157 16573 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:04.967464 16615 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:04.968921 17711 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:04.982566 16322 catalog_manager.cc:5697] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.987797 17711 raft_consensus.cc:697] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:04.988951 17711 consensus_queue.cc:237] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:04.996534 16318 catalog_manager.cc:5697] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.023449 17694 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.023977 17694 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.026235 17694 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.027697 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.028836 16646 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.030316 16541 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.031370 17694 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.031827 17694 raft_consensus.cc:493] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.032472 17694 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:05.042598 16540 leader_election.cc:336] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.049427 17694 raft_consensus.cc:515] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.053049 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607f98fb104d4e60bb399f4e52414dff" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.053714 16646 raft_consensus.cc:3060] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.076860 17730 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.077473 17730 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.079840 17730 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.081485 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.082242 16642 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:05.075822 16322 catalog_manager.cc:5697] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 1 to 2, leader changed from 9579e506d72842a9a847d0498878c3fd (127.6.182.131) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 2 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.086673 16466 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:05.081482 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.088901 17684 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:05.089378 17684 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.089753 17684 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.092548 17692 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.093227 17692 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.095542 17692 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.098802 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.099656 16642 raft_consensus.cc:2393] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
W20260709 12:26:05.101728 16465 leader_election.cc:336] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.103978 17684 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.109238 17730 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.110541 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.107086 17684 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 5 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.118672 17730 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.114097 17716 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.119992 17716 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.121433 17730 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.111331 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.122151 17716 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.122241 16642 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.124428 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
W20260709 12:26:05.126609 16465 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.116587 17692 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.128176 17692 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.130322 17692 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.126663 17716 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.104063 16646 raft_consensus.cc:2468] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.131341 17716 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.134135 17716 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.131891 16642 raft_consensus.cc:2468] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 5.
I20260709 12:26:05.135818 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.117275 17694 leader_election.cc:290] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.137285 16541 leader_election.cc:304] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.109551 16466 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.141341 16466 leader_election.cc:304] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:05.145686 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.148741 16500 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 4.
I20260709 12:26:05.145632 17716 raft_consensus.cc:2804] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:05.150206 17716 raft_consensus.cc:697] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:05.147459 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.150918 16492 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.146770 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.152660 17704 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.153309 17704 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.153460 17716 consensus_queue.cc:237] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.155579 17704 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.156400 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.158120 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.158982 16540 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:05.148779 17692 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.162055 16646 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.169480 17722 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.169996 17722 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.170341 17694 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:05.170712 16540 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:05.170987 17694 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.171531 17694 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.172147 17722 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.173623 17722 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:05.174072 17722 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.160300 17684 raft_consensus.cc:2804] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:05.161566 16648 raft_consensus.cc:2393] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:05.174163 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.177983 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.178109 16568 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:05.178418 17722 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.179420 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.181568 16492 raft_consensus.cc:2393] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:05.178656 16573 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:05.179412 16615 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.183753 16615 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.184654 17722 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.185173 17722 raft_consensus.cc:493] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.185590 17722 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.191045 17711 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:05.191275 16614 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.191608 17711 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:05.192071 17711 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.159526 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.194226 16322 catalog_manager.cc:5697] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.204241 17694 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.208158 16466 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:05.209524 17740 raft_consensus.cc:2804] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.210094 17704 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.210435 17713 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.210624 17716 raft_consensus.cc:493] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:05.211036 17713 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.210651 17704 raft_consensus.cc:493] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.211143 17716 raft_consensus.cc:515] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.212152 17704 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.213244 17713 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.213591 17716 leader_election.cc:290] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.214107 17716 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.214574 17716 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.214980 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.200436 17722 raft_consensus.cc:515] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.215623 16648 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.216681 17716 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.209992 17740 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.194872 16642 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.217610 17740 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.217881 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.218353 16466 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.218598 16648 raft_consensus.cc:2368] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 4. Current term is 5.
I20260709 12:26:05.219009 17684 raft_consensus.cc:697] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 5 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:05.219599 16541 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.220175 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.219931 17684 consensus_queue.cc:237] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.220885 16648 raft_consensus.cc:2393] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
W20260709 12:26:05.209975 16540 leader_election.cc:336] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.221256 16541 leader_election.cc:400] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Vote denied by peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917) with higher term. Message: Invalid argument: T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 4. Current term is 5.
I20260709 12:26:05.220692 17713 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.221998 17713 raft_consensus.cc:493] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.222376 17713 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.200546 17711 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.224596 17711 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.225661 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.226190 17722 leader_election.cc:290] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.227087 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bffdfc1b45484c9452392f860318fd" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.231758 16568 raft_consensus.cc:3060] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.227382 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.227782 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.237409 16492 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.237674 16500 raft_consensus.cc:2393] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:05.238552 17716 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.239220 17711 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.239149 17716 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.212145 17692 raft_consensus.cc:2749] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.228407 17694 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 5 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.240916 17694 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:05.241420 17694 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.242008 17716 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:05.228735 17704 raft_consensus.cc:515] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.228950 17730 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.231051 16541 leader_election.cc:403] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.243893 17730 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:05.244164 16614 leader_election.cc:336] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.243606 17713 raft_consensus.cc:515] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.252955 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.253715 16647 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.244266 17730 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.252439 16568 raft_consensus.cc:2468] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:05.255473 16615 leader_election.cc:304] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.256875 17722 raft_consensus.cc:2804] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:05.258195 17722 raft_consensus.cc:697] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:05.253939 16492 raft_consensus.cc:2468] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 5.
I20260709 12:26:05.239780 17711 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.245882 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.260370 17722 consensus_queue.cc:237] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.247074 17704 leader_election.cc:290] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.262799 17711 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.247553 17716 raft_consensus.cc:3060] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.248584 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.249610 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.263487 16646 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.263775 16642 raft_consensus.cc:2393] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 2: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:05.263865 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.265874 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.266919 16492 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:05.245261 16573 raft_consensus.cc:2368] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.277271 16646 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.278643 16647 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.252880 16322 catalog_manager.cc:5697] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.272572 17740 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.279668 17713 leader_election.cc:290] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.243602 17694 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.281013 17740 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.263928 17730 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.282419 16614 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:05.294366 16541 leader_election.cc:304] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.294659 17711 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.299649 16540 leader_election.cc:304] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:05.299870 17711 raft_consensus.cc:493] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.300395 17711 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.303160 17687 raft_consensus.cc:493] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:05.303807 17687 raft_consensus.cc:515] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.306562 17742 raft_consensus.cc:2804] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:05.307411 17694 raft_consensus.cc:2804] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:05.307876 17694 raft_consensus.cc:697] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:05.308351 17742 raft_consensus.cc:697] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 5 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:05.308908 17694 consensus_queue.cc:237] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.309307 17742 consensus_queue.cc:237] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.311269 16318 catalog_manager.cc:5697] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.312829 16615 leader_election.cc:400] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.313222 16615 leader_election.cc:403] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.313808 17687 leader_election.cc:290] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.314633 16500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.317555 16500 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.315316 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0af858657e45a992b1c1c0883e888f" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.315634 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.320048 16491 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.315927 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.316301 17722 raft_consensus.cc:2749] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.321488 16497 raft_consensus.cc:2368] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 2. Current term is 3.
I20260709 12:26:05.314568 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.321831 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddb5ffc80c04064b4a3b894023118d2" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.322402 16492 raft_consensus.cc:2368] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 4. Current term is 5.
I20260709 12:26:05.316257 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee31b43a234a4568866bc7b687e42337" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.323258 16493 raft_consensus.cc:3060] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.323520 16614 leader_election.cc:400] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 4. Current term is 5.
I20260709 12:26:05.323822 16614 leader_election.cc:403] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.324240 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab89972ea7341a79be8a760a43ccfcb" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.324512 17722 raft_consensus.cc:3060] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:05.324928 16495 raft_consensus.cc:3060] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.296054 17730 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.316040 16541 leader_election.cc:304] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.331081 17713 raft_consensus.cc:2804] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:05.331459 17704 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.332018 17704 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.334391 17704 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.335173 16495 raft_consensus.cc:2468] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.337029 16492 raft_consensus.cc:1275] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:05.313378 16540 leader_election.cc:336] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.348739 16540 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.294672 17716 raft_consensus.cc:2749] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917) with higher term. Message: Invalid argument: T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 4. Current term is 5.
I20260709 12:26:05.350293 17716 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.351822 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.352514 16646 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.353351 17687 consensus_queue.cc:1048] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:05.346414 16465 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:05.356001 16540 leader_election.cc:336] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.356561 16540 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.359288 17687 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9579e506d72842a9a847d0498878c3fd)
I20260709 12:26:05.359930 17694 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.359822 17687 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.360157 16646 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.361354 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229e66771a884b868626f2c5c0f7ce0e" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.361740 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ed76da550ea4f6690eb02f71843397a" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.361977 16647 raft_consensus.cc:3060] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.362326 16573 raft_consensus.cc:3060] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.362749 17687 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.364305 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.365108 16492 raft_consensus.cc:2393] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 2: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:05.339329 17722 raft_consensus.cc:2749] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 4. Current term is 5.
I20260709 12:26:05.347700 16322 catalog_manager.cc:5697] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.370464 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.371158 16642 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 1.
I20260709 12:26:05.373636 17711 raft_consensus.cc:515] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.374272 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.374954 16492 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.376433 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.377034 16491 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.377063 16573 raft_consensus.cc:2468] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.381405 17730 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.382256 16647 raft_consensus.cc:2468] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:05.382086 17730 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.388607 16491 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:05.388655 17704 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:05.390188 17730 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.347816 16493 raft_consensus.cc:2468] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.391007 16541 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.370622 16322 catalog_manager.cc:5697] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.393486 16466 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.399894 16540 leader_election.cc:400] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 2. Current term is 3.
I20260709 12:26:05.401860 16540 leader_election.cc:403] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.403883 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.404842 16573 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.405512 16540 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.406335 16466 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.407799 17740 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.408385 17740 raft_consensus.cc:493] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.408907 17740 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.416203 16614 leader_election.cc:304] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:05.419292 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.422991 16466 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.417690 17742 raft_consensus.cc:2804] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.419042 17730 raft_consensus.cc:2804] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:05.475073 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 69679.6us
I20260709 12:26:05.401827 17704 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.441296 16568 raft_consensus.cc:1275] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.442699 17742 raft_consensus.cc:493] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.442351 17711 leader_election.cc:290] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.442142 17692 raft_consensus.cc:2804] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:05.446363 17713 raft_consensus.cc:697] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:05.469777 17737 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.447481 17730 raft_consensus.cc:697] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:05.446813 17722 raft_consensus.cc:2804] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:05.474341 17694 raft_consensus.cc:2749] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.478380 17684 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.499858 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.501924 16646 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.500902 17746 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.494596 17742 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.478302 17740 raft_consensus.cc:515] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:05.498536 16541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 75621.5us
I20260709 12:26:05.511130 16493 raft_consensus.cc:1275] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.511929 17740 leader_election.cc:290] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.515202 17740 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.515949 17740 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.518505 17740 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.495507 17754 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 2. Current term is 3.
I20260709 12:26:05.509717 17746 raft_consensus.cc:493] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.549175 17722 raft_consensus.cc:697] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:05.574671 17753 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.575350 17753 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.575580 17722 consensus_queue.cc:237] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.549456 17694 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.573221 17739 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.574225 17716 raft_consensus.cc:2749] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.579546 17753 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:26:05.580693 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 81074.7us
I20260709 12:26:05.509290 17684 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.582013 17692 raft_consensus.cc:697] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:05.588770 17761 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.589389 17692 consensus_queue.cc:237] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.589551 17761 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.592778 17757 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.585168 17730 consensus_queue.cc:237] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.593663 17757 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:05.596719  6874 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17411)
I20260709 12:26:05.571758 17746 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.581151 17694 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.582842 17739 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.500041 17737 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.580291 17713 consensus_queue.cc:237] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.616524 17739 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.617395 17758 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.618091 17758 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.618943 17684 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.620301 17758 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:05.620900 17737 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.610137 17761 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.607726 17748 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.638303 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.640121 16572 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.641597 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.642505 16572 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.640039 17737 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.661168 17737 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.662261 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.662915 16566 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.663450 17737 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.644896 17739 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.666393 17739 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.644884 17716 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.635242 17748 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.645078 16466 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.660096 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.680428 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.681169 16570 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:05.682699 17758 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.668594 17739 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.659750 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6a412331894ae5b4797dbc5cdba9ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:05.684506 16571 raft_consensus.cc:3060] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.684937 17711 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.685503 17711 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.686005 17704 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.686990 17757 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.687590 17711 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.689741 16570 raft_consensus.cc:1275] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.683272 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.679620 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.690640 16575 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:05.680119 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
W20260709 12:26:05.677863 16465 leader_election.cc:336] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.677779 16569 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.692361 16574 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.693826 17764 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.673255 17716 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.694434 17764 raft_consensus.cc:493] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.699054 16466 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.700189 17759 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.702778 17759 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.703177 16571 raft_consensus.cc:2468] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:05.702895 17742 raft_consensus.cc:515] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.705323 16573 raft_consensus.cc:2368] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.705616 17764 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.683357 17758 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.710502 17752 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.711452 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:05.711156 17752 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.699695 16572 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:05.675562 17748 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.715418 17759 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.716485 16566 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:05.675369 17694 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.718362 17716 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.718827 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.719462 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.719695 17742 leader_election.cc:290] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.720165 16642 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.720532 16648 raft_consensus.cc:1275] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:05.719763 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.710513 17758 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.721796 16646 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.723366 17752 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.725019 16647 raft_consensus.cc:2393] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
W20260709 12:26:05.727946 16465 leader_election.cc:336] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:05.728554 16465 leader_election.cc:336] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:05.729008 16465 leader_election.cc:336] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:05.729463 16465 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:05.729839 16465 leader_election.cc:336] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.731225 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.724038 16322 catalog_manager.cc:5697] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.731885 16647 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.734145 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.735096 16647 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 2.
I20260709 12:26:05.737759 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.738386 16647 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.744415 16541 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.745694 17758 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.746145 17758 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.746555 17758 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.747854 16541 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.748772 17739 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.749258 16615 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.750169 17694 consensus_queue.cc:1048] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.751853 17742 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.752321 17742 raft_consensus.cc:493] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.752769 17742 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.749249 17739 raft_consensus.cc:493] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.754133 17739 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:05.755405 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:05.755898 16465 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:05.761386 17765 consensus_queue.cc:1048] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.762763 17748 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.763219 17748 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.763619 17748 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.733934 16466 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.765437 16466 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.766069 17759 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.766644 17759 raft_consensus.cc:493] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.766997 17759 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.770311 16466 leader_election.cc:304] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.770749 17684 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.775353 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.776186 16574 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.772521 16615 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.777776 16541 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.778834 16541 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.778702 16647 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:05.781810 16541 leader_election.cc:304] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.783030 17768 raft_consensus.cc:2804] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:05.771245 17737 raft_consensus.cc:2804] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:05.780547 16466 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.785636 16572 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:05.788307 16615 leader_election.cc:400] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.788728 16615 leader_election.cc:403] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.789213 17770 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.789855 16615 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.792081 16642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.792701 16648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.794478 16641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.795259 17764 raft_consensus.cc:515] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.795486 16641 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:05.783581 17768 raft_consensus.cc:697] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:05.797309 16568 raft_consensus.cc:1275] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:05.797597 17768 consensus_queue.cc:237] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.798607 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:05.799419 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.799526 16643 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:05.800242 16568 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:05.771332 17684 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.800858 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.801244 17684 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.791337 17770 raft_consensus.cc:2749] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973) with higher term. Message: Invalid argument: T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3.
I20260709 12:26:05.792092 17750 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:05.806763 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c18e43c84047efb66015470a2254ab" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.785838 17716 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.812175 16647 raft_consensus.cc:3060] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.785570 17694 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:05.818066 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 232131us
I20260709 12:26:05.807533 17687 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.818742 16466 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.827139 17687 raft_consensus.cc:493] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.827593 17687 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.828936 17730 raft_consensus.cc:2749] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.807165 17750 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.809095 17763 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:26:05.832697 17750 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.814745 17767 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:05.817072 17694 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.833455 17694 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.808773 17737 raft_consensus.cc:697] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:05.839058 17737 consensus_queue.cc:237] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.840898 17759 raft_consensus.cc:515] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.825624 17684 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:05.845504 16466 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:05.846189 16540 leader_election.cc:336] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.842190 17694 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.808422 17692 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.814030 17716 raft_consensus.cc:493] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.773903 17746 raft_consensus.cc:515] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:05.855494 16318 catalog_manager.cc:5697] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.859802 16497 raft_consensus.cc:1275] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:05.853556 16647 raft_consensus.cc:2468] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:05.859985 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:05.847260 17763 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.864162 16497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.867242 16644 raft_consensus.cc:1275] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:05.870746 17684 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:05.855059 17692 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.855764 17740 raft_consensus.cc:2804] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:05.904371 16614 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:05.905288 16614 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.858711 17716 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:05.906162 16614 leader_election.cc:336] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.862397 17765 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.909579 17765 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.912211 17765 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:05.912806 16496 raft_consensus.cc:1240] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:05.902695 17756 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.915683 17756 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:05.917766 17756 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:05.902976 17755 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.918174 17742 raft_consensus.cc:515] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.919992 17694 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.920833 16574 raft_consensus.cc:2393] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 3: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:26:05.902360 17764 leader_election.cc:290] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.926560 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a637f29bcd04712ae40966d9b293303" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:05.918915 17755 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.928040 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.929157 17755 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:26:05.929905 17776 log.cc:927] Time spent T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:26:05.930328 16499 raft_consensus.cc:1275] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:05.927213 16498 raft_consensus.cc:3060] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.932761 16573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:05.878530 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:05.937655 17750 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.933427 16573 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:05.920758 16321 catalog_manager.cc:5697] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.879205 17722 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.872738 17759 leader_election.cc:290] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:05.872829 17711 consensus_queue.cc:1048] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:26:05.946113 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e703662cca4f18a580ec34362c26ba" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.986255 16643 raft_consensus.cc:3060] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.947343 16640 raft_consensus.cc:1275] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:05.948467 17746 leader_election.cc:290] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:05.989444 17746 consensus_queue.cc:1048] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.994712 17740 raft_consensus.cc:493] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:05.995226 17740 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:05.979912 17687 raft_consensus.cc:515] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.998929 17687 leader_election.cc:290] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.920517 17742 leader_election.cc:290] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:05.949842 17748 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.932502 17739 raft_consensus.cc:515] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:06.007781 17748 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:26:05.953258 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 44144.2us
W20260709 12:26:06.008972 16614 leader_election.cc:336] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.009441 16614 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:05.953441 16615 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
W20260709 12:26:06.013238 16615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 59924.5us
I20260709 12:26:06.013466 17687 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:06.013995 17687 raft_consensus.cc:493] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.014371 17687 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.015125 17692 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.942126 16322 catalog_manager.cc:5697] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:05.960320 16465 leader_election.cc:336] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:05.875914 17767 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:05.875898 17763 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:26:06.016523 16465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 56244.5us
W20260709 12:26:06.017055 16465 leader_election.cc:336] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.018224 16497 raft_consensus.cc:2393] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:05.973196 17757 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:06.019701 17757 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.020898 17767 raft_consensus.cc:493] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.021461 17767 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:05.974877 17758 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:05.960207 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:05.984475 17722 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.025127 16647 raft_consensus.cc:2393] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:06.008493 17716 raft_consensus.cc:515] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.028038 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9f76a3c6784d0f97f736edeb104e6b" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:06.028751 16491 raft_consensus.cc:3060] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.031373 17758 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.031765 17716 leader_election.cc:290] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.008255 17739 leader_election.cc:290] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:06.038291 16465 leader_election.cc:336] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.047326 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8cd99199d478e8112f6890e152dd7" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.048086 16574 raft_consensus.cc:3060] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.055181 16495 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:06.057240 17756 consensus_queue.cc:1059] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.983821 17750 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.064652 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:06.065476 16495 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:06.068349 16643 raft_consensus.cc:2468] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:06.068866 17757 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.069123 17748 raft_consensus.cc:2749] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:06.069643 16647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ad60577d0e48709e6040873bb43f0c" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:06.070276 16647 raft_consensus.cc:3060] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.071484 17763 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:06.072857 17722 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.073884 16541 leader_election.cc:304] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:06.075134 16643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:06.076363 16643 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:06.079509 17748 raft_consensus.cc:3055] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:06.079916 17748 raft_consensus.cc:740] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.080294 16647 raft_consensus.cc:2468] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 4.
I20260709 12:26:06.080801 17748 consensus_queue.cc:260] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:06.081872 17748 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.083180 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.084014 16566 raft_consensus.cc:2393] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 3: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:26:06.084159 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.085100 16572 raft_consensus.cc:2393] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 3: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:26:06.089952 17766 consensus_queue.cc:1048] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.091964 16541 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:06.092919 16541 leader_election.cc:304] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
W20260709 12:26:06.093961 16540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 79297us
I20260709 12:26:06.098160 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:06.099014 16646 raft_consensus.cc:2393] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:06.102093 16498 raft_consensus.cc:2468] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:06.105440 16498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:06.107287 16574 raft_consensus.cc:2468] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:06.108274 16569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:06.108673 16615 leader_election.cc:304] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:06.102612 17758 raft_consensus.cc:2804] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.114382 16491 raft_consensus.cc:2468] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 4.
I20260709 12:26:06.115458 17694 raft_consensus.cc:2804] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.116050 17694 raft_consensus.cc:697] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:06.116971 17694 consensus_queue.cc:237] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.130384 16540 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5
I20260709 12:26:06.135761 16646 raft_consensus.cc:1275] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:06.107427 17746 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:06.126101 17758 raft_consensus.cc:697] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:06.126418 17722 raft_consensus.cc:2804] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.140842 16498 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:06.152086 17746 raft_consensus.cc:493] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
W20260709 12:26:06.134510 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.157414 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 298658us
I20260709 12:26:06.162367 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
W20260709 12:26:06.165309 16465 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.165890 16465 leader_election.cc:336] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.165609 17758 consensus_queue.cc:237] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.170114 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.174252 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:06.174875 16575 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 2.
I20260709 12:26:06.175161 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abf5d33e7a744ab8a191960f961bdcd" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.175735 16574 raft_consensus.cc:3060] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.177470 17760 consensus_queue.cc:1048] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.178270 17759 consensus_queue.cc:1048] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.178776 16643 raft_consensus.cc:1275] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:06.149943 17716 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.180269 16644 raft_consensus.cc:1275] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.177717 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98012d4197b649e6be7f7df5d46b6218" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.181541 16572 raft_consensus.cc:3060] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.182133 16566 raft_consensus.cc:1275] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:06.176465 17722 raft_consensus.cc:697] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.186467 17722 consensus_queue.cc:237] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.191748 17687 raft_consensus.cc:515] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.132076 17768 consensus_queue.cc:1048] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:26:06.160109 17767 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:06.152582 17746 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.203572 16574 raft_consensus.cc:2468] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:06.205367 17767 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:06.208214 17687 leader_election.cc:290] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.208618 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.226291 16646 raft_consensus.cc:2410] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:26:06.222342 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 45102.5us
I20260709 12:26:06.223165 16540 leader_election.cc:304] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:06.223747 16574 raft_consensus.cc:1275] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.229489 17766 raft_consensus.cc:2804] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.230134 17766 raft_consensus.cc:697] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:06.231107 17766 consensus_queue.cc:237] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:26:06.233870 16540 leader_election.cc:336] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.234656 16540 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.235672 17757 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.245818 17684 consensus_queue.cc:1048] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:06.220970 16566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06cf958045274e6f8c8b60508d68cf26" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.250375 16566 raft_consensus.cc:3060] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.242882 17763 consensus_queue.cc:1048] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:06.252828 16571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25341f99080e43ab92f1b8ffdd24bd2b" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.253595 16571 raft_consensus.cc:3060] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.226722 17768 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:26:06.259325 17687 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.253466 16466 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.264848 17764 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:06.088330 17740 raft_consensus.cc:515] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
W20260709 12:26:06.236218 16540 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.267578 16572 raft_consensus.cc:2468] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
W20260709 12:26:06.268707 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.270598 16466 leader_election.cc:304] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.273571 16466 leader_election.cc:304] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.265916 17764 raft_consensus.cc:493] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:06.278395 16540 leader_election.cc:336] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.279134 16540 leader_election.cc:336] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.279734 16540 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.282059 16466 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
W20260709 12:26:06.285809 16540 consensus_peers.cc:597] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.268208 17782 consensus_queue.cc:1048] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:06.288300 17782 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:06.293256 16498 raft_consensus.cc:1240] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Rejecting Update request from peer 736f96578e2c4a2fb240e98ccdce0fb5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:06.274844 17737 raft_consensus.cc:2804] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.278292 17764 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.278167 17730 raft_consensus.cc:2804] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.307992 16614 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:06.301851 17740 leader_election.cc:290] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.310638 17737 raft_consensus.cc:697] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:06.310292 17692 raft_consensus.cc:515] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:06.311693 17737 consensus_queue.cc:237] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:06.313001 17730 raft_consensus.cc:697] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:06.313973 17730 consensus_queue.cc:237] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:06.314514 16493 raft_consensus.cc:2393] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 4: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:06.333281 16614 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:06.331048 16571 raft_consensus.cc:2468] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:06.349098 16643 raft_consensus.cc:1275] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:06.341363 17756 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:06.357646 17774 consensus_queue.cc:1048] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:06.361716 17716 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:06.362260 16540 leader_election.cc:336] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.342123 17687 raft_consensus.cc:2804] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:06.354959 17756 raft_consensus.cc:493] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.377426 16497 raft_consensus.cc:1275] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:06.378134 16465 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:06.381175 16540 leader_election.cc:336] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.393688 16465 consensus_peers.cc:597] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.385805 16499 raft_consensus.cc:1275] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.387603 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
W20260709 12:26:06.391021 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.395985 16496 raft_consensus.cc:2393] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 4: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
W20260709 12:26:06.396188 16614 leader_election.cc:336] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.401140 16614 leader_election.cc:336] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.402292 16614 leader_election.cc:336] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.403453 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.403923 16614 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.356907 17692 leader_election.cc:290] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:06.392171 17687 raft_consensus.cc:493] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8133a8f49724a8897d8bc4f718d802d)
I20260709 12:26:06.402981 16567 raft_consensus.cc:3060] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.406308 16493 raft_consensus.cc:1275] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:06.404392 16614 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.407635 16566 raft_consensus.cc:2468] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
W20260709 12:26:06.410575 16465 leader_election.cc:336] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.396145 17756 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:06.416675 16614 leader_election.cc:336] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.419587 16614 consensus_peers.cc:597] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.414566 17687 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:06.421384 16614 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.422626 16614 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.422994 16615 leader_election.cc:304] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
W20260709 12:26:06.424345 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.417722 17753 raft_consensus.cc:2749] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:06.415566 17716 consensus_queue.cc:1048] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:26:06.424785 17771 raft_consensus.cc:2749] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:06.429246 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.426111 17722 raft_consensus.cc:2804] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.446559 17757 raft_consensus.cc:2749] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:06.455693 17764 raft_consensus.cc:515] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:06.456504 17722 raft_consensus.cc:697] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.439481 17760 consensus_queue.cc:1048] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:06.422904 17746 raft_consensus.cc:515] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:06.501861 16540 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.502437 16540 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:06.503427 16540 leader_election.cc:336] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.504352 16540 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.505062 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:06.509091 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:35115, user_credentials={real_user=slave}} blocked reactor thread for 65584.5us
I20260709 12:26:06.506695 16322 catalog_manager.cc:5697] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.511445 16569 raft_consensus.cc:2393] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 736f96578e2c4a2fb240e98ccdce0fb5 in current term 4: Already voted for candidate 9579e506d72842a9a847d0498878c3fd in this term.
I20260709 12:26:06.506974 17766 raft_consensus.cc:2749] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:06.513262 16540 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.510449 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 228454us
I20260709 12:26:06.514797 16540 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9579e506d72842a9a847d0498878c3fd; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.516396 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729d22f5fdb4470dbb68890b960a8395" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:06.517118 16640 raft_consensus.cc:3060] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:06.521492 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.522626 16614 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.523588 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.524088 16614 leader_election.cc:336] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:06.525198 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.526232 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:06.527254 16644 raft_consensus.cc:2393] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 57226fc89069472b9311be6e596aa8ee in current term 4: Already voted for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in this term.
I20260709 12:26:06.527961 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea1365c62bb457f95eb3d1f583a6d7d" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.523609 17704 raft_consensus.cc:2749] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:06.543294 17764 leader_election.cc:290] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
W20260709 12:26:06.545351 17795 log.cc:927] Time spent T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:26:06.557041 17746 leader_election.cc:290] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:06.557117 16466 leader_election.cc:304] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.559377 17722 consensus_queue.cc:237] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.561256 16647 raft_consensus.cc:1275] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:06.567781 16646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6271255b6fb24144ae8515a99a98297a" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:06.568322 16646 raft_consensus.cc:3060] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.575338 16647 raft_consensus.cc:1275] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:06.543883 17756 raft_consensus.cc:515] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:06.584663 16466 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee; no voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:06.590067 16646 raft_consensus.cc:2468] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 4.
I20260709 12:26:06.590102 17711 consensus_queue.cc:1048] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 12:26:06.597623  6874 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17411)
I20260709 12:26:06.600471 16541 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:06.574203 17692 raft_consensus.cc:2804] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:06.604261 16465 leader_election.cc:336] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.573675 17687 raft_consensus.cc:515] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:06.609797 16640 raft_consensus.cc:2468] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 3.
I20260709 12:26:06.585134 17758 consensus_queue.cc:1048] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:06.588699 17730 raft_consensus.cc:2749] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:06.607098 16567 raft_consensus.cc:2468] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:06.591022 17684 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:26:06.629055 16496 raft_consensus.cc:1275] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.627218 17687 leader_election.cc:290] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:06.630904 17716 consensus_queue.cc:1048] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.606499 17766 raft_consensus.cc:2804] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:06.642746 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.643394 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.643950 16614 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.644381 16614 leader_election.cc:304] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 9579e506d72842a9a847d0498878c3fd, a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:06.646152 16465 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:06.632237 16568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912f04f17584451592c26c403070693c" candidate_uuid: "57226fc89069472b9311be6e596aa8ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:06.647899 16568 raft_consensus.cc:3060] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.648713 17767 raft_consensus.cc:2749] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:06.672341 16491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6439a65987543bbb05819426afdf56f" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:06.673306 16491 raft_consensus.cc:3060] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.684451 16643 raft_consensus.cc:1275] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:06.686848 17716 consensus_queue.cc:1048] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.711570 16491 raft_consensus.cc:2468] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:06.719995 17756 leader_election.cc:290] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:06.652907 17766 raft_consensus.cc:697] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
W20260709 12:26:06.757229 16614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:34585, user_credentials={real_user=slave}} blocked reactor thread for 60641.4us
I20260709 12:26:06.758667 16614 leader_election.cc:304] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:06.772316 16499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c753e3027c7b414c9b0eb823b6c2893e" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:06.775316 16499 raft_consensus.cc:3060] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:06.730098 17766 consensus_queue.cc:237] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:06.791198 16644 raft_consensus.cc:1275] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:26:06.796875 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 179918us
I20260709 12:26:06.787675 17771 raft_consensus.cc:2804] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.798130 16466 leader_election.cc:304] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:06.798305 17692 raft_consensus.cc:697] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
W20260709 12:26:06.822446 16540 consensus_peers.cc:597] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:06.823304 16540 leader_election.cc:336] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.819037 17763 raft_consensus.cc:2804] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.851172 16499 raft_consensus.cc:2468] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:06.855168 17704 consensus_queue.cc:1048] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.856513 16321 catalog_manager.cc:5697] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.859829 16321 catalog_manager.cc:5697] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.854449 16614 leader_election.cc:304] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:06.875391 16321 catalog_manager.cc:5697] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 2 to 3, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 3 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.877261 16574 raft_consensus.cc:1275] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.877452 16572 raft_consensus.cc:1275] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:06.882025 17722 raft_consensus.cc:2804] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.882265 16566 raft_consensus.cc:1275] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:06.882692 17722 raft_consensus.cc:697] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.883699 17722 consensus_queue.cc:237] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:06.886826 17692 consensus_queue.cc:237] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
I20260709 12:26:06.878657 16615 leader_election.cc:304] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:06.892928 16321 catalog_manager.cc:5697] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.878157 17763 raft_consensus.cc:697] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
W20260709 12:26:06.912613 16614 leader_election.cc:336] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:06.903252 17771 raft_consensus.cc:697] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.900323 17753 raft_consensus.cc:2804] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:06.926069 17771 consensus_queue.cc:237] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:06.911430 17763 consensus_queue.cc:237] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:06.933312 17814 consensus_queue.cc:1048] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:26:06.967083 17827 log.cc:927] Time spent T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:26:06.935529 17815 consensus_queue.cc:1048] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:26:06.974283 17761 consensus_queue.cc:1048] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.954770 17753 raft_consensus.cc:697] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:06.978258 17753 consensus_queue.cc:237] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:06.986764 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:06.987615 16540 consensus_peers.cc:597] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.002439 16614 leader_election.cc:336] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:07.003688 16572 raft_consensus.cc:1275] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:07.005858 16465 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.006532 16465 consensus_peers.cc:597] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.050155 17820 log.cc:927] Time spent T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
W20260709 12:26:07.055388 16614 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.067039 16570 raft_consensus.cc:1275] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:07.070092 17722 consensus_queue.cc:1048] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.113400 16568 raft_consensus.cc:2468] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57226fc89069472b9311be6e596aa8ee in term 4.
I20260709 12:26:07.120201 17815 consensus_queue.cc:1048] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:07.120533 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:07.121214 16540 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.125777 16318 catalog_manager.cc:5697] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.129002 16466 leader_election.cc:304] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:07.133587 16318 catalog_manager.cc:5697] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.135939 16318 catalog_manager.cc:5697] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.140658 17817 raft_consensus.cc:2804] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:07.141383 17817 raft_consensus.cc:697] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Becoming Leader. State: Replica: 57226fc89069472b9311be6e596aa8ee, State: Running, Role: LEADER
I20260709 12:26:07.142398 17817 consensus_queue.cc:237] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } }
W20260709 12:26:07.149606 16614 consensus_peers.cc:597] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.171705 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:07.175776 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:07.194126 16322 catalog_manager.cc:5697] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 3, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 3 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.198987 16322 catalog_manager.cc:5697] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:07.259626 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:07.264405 16321 catalog_manager.cc:5697] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 3 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 4 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.262663 16640 raft_consensus.cc:1275] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:07.296698 17713 consensus_queue.cc:1048] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:07.337930 16540 consensus_peers.cc:597] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.348063 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:07.355281 16318 catalog_manager.cc:5697] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.370153 16318 catalog_manager.cc:5697] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 3, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 3 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.372000 16318 catalog_manager.cc:5697] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 57226fc89069472b9311be6e596aa8ee (127.6.182.130). New cstate: current_term: 4 leader_uuid: "57226fc89069472b9311be6e596aa8ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.377219 16499 raft_consensus.cc:1275] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:07.379081 17687 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.395769 16567 raft_consensus.cc:1275] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:07.397758 16540 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:07.397805 17771 consensus_queue.cc:1048] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.425534 16644 raft_consensus.cc:1275] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.427609 17763 consensus_queue.cc:1048] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.430186 16322 catalog_manager.cc:5697] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from 57226fc89069472b9311be6e596aa8ee (127.6.182.130) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.453181 16322 catalog_manager.cc:5697] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.474013 16499 raft_consensus.cc:1275] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:07.478665 17765 consensus_queue.cc:1048] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:07.479614 16614 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.496598 16499 raft_consensus.cc:1275] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:26:07.505265 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.506103 16465 consensus_peers.cc:597] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:07.506860 16465 consensus_peers.cc:597] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.509732 17756 consensus_queue.cc:1048] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.555451 16567 raft_consensus.cc:1275] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:07.586429 17757 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:07.587170 17757 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
W20260709 12:26:07.599105  6874 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17411)
I20260709 12:26:07.607971 17757 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:07.610292 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:07.612317 16492 raft_consensus.cc:2393] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd in current term 3: Already voted for candidate 57226fc89069472b9311be6e596aa8ee in this term.
I20260709 12:26:07.613395 17771 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.614044 17771 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:07.615355 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:07.616129 16640 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
I20260709 12:26:07.619706 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:07.620481 16572 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 2.
I20260709 12:26:07.621860 16615 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:07.622663 17756 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:07.623095 17756 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.623422 17756 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.624373 17771 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:07.633461 17815 consensus_queue.cc:1048] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.635576 16541 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 57226fc89069472b9311be6e596aa8ee
I20260709 12:26:07.636487 17713 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:07.636950 17713 raft_consensus.cc:493] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 736f96578e2c4a2fb240e98ccdce0fb5)
I20260709 12:26:07.637382 17713 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:07.643761 16572 raft_consensus.cc:1275] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 57226fc89069472b9311be6e596aa8ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:07.643992 17756 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:07.645480 17815 consensus_queue.cc:1048] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.648893 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee" is_pre_election: true
I20260709 12:26:07.649608 16494 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:07.658993 17756 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:07.662774 16570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
W20260709 12:26:07.668912 16465 consensus_peers.cc:597] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.668838 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:07.671643 16493 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.684000 16493 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:07.685271 17713 raft_consensus.cc:515] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:07.686256 16570 raft_consensus.cc:3060] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.689424 17713 leader_election.cc:290] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Requested vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917)
I20260709 12:26:07.689792 16614 leader_election.cc:304] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57226fc89069472b9311be6e596aa8ee, 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 
I20260709 12:26:07.691430 17765 raft_consensus.cc:2804] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:07.692107 17765 raft_consensus.cc:697] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:07.693230 17765 consensus_queue.cc:237] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:07.694559 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:07.697293 16570 raft_consensus.cc:2468] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
I20260709 12:26:07.700306 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957637a18e91481fb00d24ee6684e679" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "57226fc89069472b9311be6e596aa8ee"
I20260709 12:26:07.701164 16493 raft_consensus.cc:2368] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 3. Current term is 4.
I20260709 12:26:07.702570 16540 leader_election.cc:400] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 3. Current term is 4.
I20260709 12:26:07.702906 16540 leader_election.cc:403] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:07.703907 17713 raft_consensus.cc:2749] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585) with higher term. Message: Invalid argument: T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9579e506d72842a9a847d0498878c3fd for earlier term 3. Current term is 4.
I20260709 12:26:07.722150 16322 catalog_manager.cc:5697] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:08.006806 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.018400 16465 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.137765 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.187775 16493 raft_consensus.cc:1275] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:08.191088 17765 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:08.218137 16540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111) [suppressed 368 similar messages]
I20260709 12:26:08.227236 16572 raft_consensus.cc:1275] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:08.230024 17722 consensus_queue.cc:1048] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:08.370697 16465 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.409706 17859 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.412842 17859 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:08.417332 16541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.132:43917, user_credentials={real_user=slave}} blocked reactor thread for 81655.5us
I20260709 12:26:08.448076 17859 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:08.460035 16644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" is_pre_election: true
I20260709 12:26:08.461445 16644 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 3.
W20260709 12:26:08.470005 16465 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:08.495982 16540 consensus_peers.cc:597] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:08.496870 16540 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:08.517634 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.518537 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.526186 16541 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
W20260709 12:26:08.537176 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.556918 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.561368 17773 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:08.561981 17773 raft_consensus.cc:493] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.562477 17773 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:08.568521 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.584532 17773 raft_consensus.cc:515] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:08.590085 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a476f9e5784529a3f8e75fed90d096" candidate_uuid: "9579e506d72842a9a847d0498878c3fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "736f96578e2c4a2fb240e98ccdce0fb5"
I20260709 12:26:08.590591 17773 leader_election.cc:290] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Requested vote from peers 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132:43917), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:08.591151 16640 raft_consensus.cc:3060] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:08.595973 16540 leader_election.cc:336] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:08.599858  6874 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17411)
I20260709 12:26:08.605281 16640 raft_consensus.cc:2468] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9579e506d72842a9a847d0498878c3fd in term 4.
I20260709 12:26:08.606961 16541 leader_election.cc:304] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:08.607826 17773 raft_consensus.cc:2804] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:08.608428 17773 raft_consensus.cc:697] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Becoming Leader. State: Replica: 9579e506d72842a9a847d0498878c3fd, State: Running, Role: LEADER
I20260709 12:26:08.609876 17773 consensus_queue.cc:237] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:08.635929 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.651155 16322 catalog_manager.cc:5697] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 9579e506d72842a9a847d0498878c3fd (127.6.182.131). New cstate: current_term: 4 leader_uuid: "9579e506d72842a9a847d0498878c3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.672466 17861 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:08.670934 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.674630 17861 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:08.677971 17861 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
I20260709 12:26:08.683888 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd" is_pre_election: true
I20260709 12:26:08.684866 16567 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 3.
I20260709 12:26:08.691481 16615 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: 
I20260709 12:26:08.692950 17863 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:08.693429 17863 raft_consensus.cc:493] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.693818 17863 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:08.700776 16614 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
I20260709 12:26:08.716825 17863 raft_consensus.cc:515] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
I20260709 12:26:08.731613 16567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020b055b364646c9b177588ef98ec412" candidate_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9579e506d72842a9a847d0498878c3fd"
I20260709 12:26:08.732448 16567 raft_consensus.cc:3060] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:08.751566 17863 leader_election.cc:290] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Requested vote from peers 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973), a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115)
W20260709 12:26:08.755892 16614 leader_election.cc:336] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:08.757591 16466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:41973, user_credentials={real_user=slave}} blocked reactor thread for 47070.1us
I20260709 12:26:08.775301 16567 raft_consensus.cc:2468] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 736f96578e2c4a2fb240e98ccdce0fb5 in term 4.
W20260709 12:26:08.777267 16465 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.777572 16615 leader_election.cc:304] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5, 9579e506d72842a9a847d0498878c3fd; no voters: a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:08.778908 17861 raft_consensus.cc:2804] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:08.780179 17861 raft_consensus.cc:697] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Becoming Leader. State: Replica: 736f96578e2c4a2fb240e98ccdce0fb5, State: Running, Role: LEADER
I20260709 12:26:08.781354 17861 consensus_queue.cc:237] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } }
W20260709 12:26:08.792099 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:08.811178 16322 catalog_manager.cc:5697] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 reported cstate change: term changed from 2 to 4, leader changed from a8133a8f49724a8897d8bc4f718d802d (127.6.182.129) to 736f96578e2c4a2fb240e98ccdce0fb5 (127.6.182.132). New cstate: current_term: 4 leader_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:08.826681 16465 consensus_peers.cc:597] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.881575 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.883386 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:08.886260 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:08.974859 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.000304 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.039772 16614 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.074868 16614 consensus_peers.cc:597] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:09.078457 16644 raft_consensus.cc:1275] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Refusing update from remote peer 9579e506d72842a9a847d0498878c3fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:09.080477 17773 consensus_queue.cc:1048] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:09.133572 16465 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.184218 16540 consensus_peers.cc:597] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:09.207103 16567 raft_consensus.cc:1275] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Refusing update from remote peer 736f96578e2c4a2fb240e98ccdce0fb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:09.209183 17863 consensus_queue.cc:1048] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:09.210995 16540 consensus_peers.cc:597] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.252661 16614 consensus_peers.cc:597] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.270517 16614 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.286422 16465 consensus_peers.cc:597] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.318729 16540 consensus_peers.cc:597] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.446979 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.512234 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.515892 16540 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.600504  6874 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 17411)
W20260709 12:26:09.686074 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.685602 16465 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.762370 16614 consensus_peers.cc:597] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.775689 16540 consensus_peers.cc:597] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.789392 16614 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:09.821132 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.848387 16540 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:09.934759 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:10.010768 16465 consensus_peers.cc:597] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:10.068267 16465 consensus_peers.cc:597] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:10.130573 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:10.207293 16465 consensus_peers.cc:597] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:10.542830 16465 consensus_peers.cc:597] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:10.601086  6874 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 17411)
W20260709 12:26:10.651423 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:10.696033 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:10.976166 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:10.987430 16540 consensus_peers.cc:597] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:10.992651 16465 consensus_peers.cc:597] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:10.996912 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:10.999758 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.037751 16465 consensus_peers.cc:597] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.041172 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.097031 16465 consensus_peers.cc:597] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.125874 16465 consensus_peers.cc:597] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.127372 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.211248 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.217911 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.268656 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.378182 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.407348 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.488803 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.526561 16614 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.594239 16614 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.599329 16540 consensus_peers.cc:597] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:11.601703  6874 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 17411)
W20260709 12:26:11.614635 16614 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.656361 16614 consensus_peers.cc:597] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.717427 16465 consensus_peers.cc:597] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.742746 16540 consensus_peers.cc:597] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.747406 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.814615 16614 consensus_peers.cc:597] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:11.875869 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:11.894580 16540 consensus_peers.cc:597] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.912935 16614 consensus_peers.cc:597] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.966841 16465 consensus_peers.cc:597] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:11.978017 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:12.165351 16540 consensus_peers.cc:597] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:12.165985 16540 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.273775 16540 consensus_peers.cc:597] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.294198 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:12.382825 16465 consensus_peers.cc:597] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.383853 16614 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.468134 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:12.510954 16540 consensus_peers.cc:597] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:12.550498 16465 consensus_peers.cc:597] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.552045 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.559278 16465 consensus_peers.cc:597] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:12.602419  6874 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 17411)
W20260709 12:26:12.632561 16465 consensus_peers.cc:597] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:12.706790  6874 tablet_server.cc:196] TabletServer@127.6.182.129:35115 shutdown complete.
I20260709 12:26:12.867990  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:26:12.885056 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:12.886703 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:12.946252 16465 consensus_peers.cc:597] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:12.949127  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:12.949939 16465 consensus_peers.cc:597] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:12.952175  6874 tablet_replica.cc:333] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.953118  6874 raft_consensus.cc:2243] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.953687  6874 raft_consensus.cc:2272] T ee31b43a234a4568866bc7b687e42337 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.956018  6874 tablet_replica.cc:333] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.956766  6874 raft_consensus.cc:2243] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.957788  6874 raft_consensus.cc:2272] T 4a4d37de09ac428a9151d21ca953d08c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.960242  6874 tablet_replica.cc:333] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.960959  6874 raft_consensus.cc:2243] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.961472  6874 raft_consensus.cc:2272] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.963766  6874 tablet_replica.cc:333] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.964396  6874 raft_consensus.cc:2243] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.965389  6874 raft_consensus.cc:2272] T 440906c79bf64ae3bd7a7b15c6abba82 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.967651  6874 tablet_replica.cc:333] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.968271  6874 raft_consensus.cc:2243] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.969267  6874 raft_consensus.cc:2272] T 56252914f95a4889a4f744beb66359d2 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.972003  6874 tablet_replica.cc:333] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.972743  6874 raft_consensus.cc:2243] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.973336  6874 raft_consensus.cc:2272] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.977861  6874 tablet_replica.cc:333] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.978771  6874 raft_consensus.cc:2243] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.979346  6874 raft_consensus.cc:2272] T 71519fa014734fe68b4df3cea03ca766 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.982040  6874 tablet_replica.cc:333] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.982741  6874 raft_consensus.cc:2243] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.984063  6874 raft_consensus.cc:2272] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.987212  6874 tablet_replica.cc:333] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.988144  6874 raft_consensus.cc:2243] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.988780  6874 raft_consensus.cc:2272] T bddb5ffc80c04064b4a3b894023118d2 P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.991938  6874 tablet_replica.cc:333] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.992846  6874 raft_consensus.cc:2243] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.993458  6874 raft_consensus.cc:2272] T 957637a18e91481fb00d24ee6684e679 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:12.994336 16614 consensus_peers.cc:597] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.996555  6874 tablet_replica.cc:333] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:12.997627  6874 raft_consensus.cc:2243] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.998308  6874 raft_consensus.cc:2272] T 2855310d11c545378f19afd1715ebb47 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.001842  6874 tablet_replica.cc:333] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.002743  6874 raft_consensus.cc:2243] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.003934  6874 raft_consensus.cc:2272] T 229e66771a884b868626f2c5c0f7ce0e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.007040  6874 tablet_replica.cc:333] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.007913  6874 raft_consensus.cc:2243] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.008600  6874 raft_consensus.cc:2272] T f1fcca6ce8824a0884716942fc18ff9a P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.009102 16614 consensus_peers.cc:597] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.010510 16614 consensus_peers.cc:597] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.011685  6874 tablet_replica.cc:333] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.012773  6874 raft_consensus.cc:2243] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.014261  6874 raft_consensus.cc:2272] T b17303c99a9d4e87b2d1903bff808994 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.017796  6874 tablet_replica.cc:333] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.018509  6874 raft_consensus.cc:2243] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.019541  6874 raft_consensus.cc:2272] T 1ad58928df6e4de09d9efac2b2da0a2e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.022637  6874 tablet_replica.cc:333] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.023566  6874 raft_consensus.cc:2243] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.024273  6874 raft_consensus.cc:2272] T 6b09eddf44e747eb9bc7886771ea40fd P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.027518  6874 tablet_replica.cc:333] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.029578  6874 raft_consensus.cc:2243] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.030251  6874 raft_consensus.cc:2272] T 419069393a644530ac323793012d5f9c P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.032583 16614 consensus_peers.cc:597] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.034158  6874 tablet_replica.cc:333] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
W20260709 12:26:13.034399 16540 consensus_peers.cc:597] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.035377  6874 raft_consensus.cc:2243] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.036114  6874 raft_consensus.cc:2272] T bb9f76a3c6784d0f97f736edeb104e6b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.039556  6874 tablet_replica.cc:333] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.040462  6874 raft_consensus.cc:2243] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.041085  6874 raft_consensus.cc:2272] T 39b59162ae2d417092181b3f9198701e P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.044354  6874 tablet_replica.cc:333] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.045221  6874 raft_consensus.cc:2243] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.045814  6874 raft_consensus.cc:2272] T 9c6a412331894ae5b4797dbc5cdba9ba P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.049027  6874 tablet_replica.cc:333] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.049861  6874 raft_consensus.cc:2243] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.050438  6874 raft_consensus.cc:2272] T f6439a65987543bbb05819426afdf56f P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.053519  6874 tablet_replica.cc:333] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.054423  6874 raft_consensus.cc:2243] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.055009  6874 raft_consensus.cc:2272] T af5dd7018976414e8ed99fd67565655d P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.058228  6874 tablet_replica.cc:333] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.059314  6874 raft_consensus.cc:2243] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:26:13.061303 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.061360  6874 raft_consensus.cc:2272] T 89c18e43c84047efb66015470a2254ab P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.063342 16540 consensus_peers.cc:597] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.065706  6874 tablet_replica.cc:333] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.066671  6874 raft_consensus.cc:2243] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.067227  6874 raft_consensus.cc:2272] T e2f105035b4f4eda8c0fb001d571ddaa P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.070195  6874 tablet_replica.cc:333] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.071133  6874 raft_consensus.cc:2243] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.071734  6874 raft_consensus.cc:2272] T bb5374aa54af41848399d9477ec0fccf P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.074506 16614 consensus_peers.cc:597] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.076299  6874 tablet_replica.cc:333] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.078053  6874 raft_consensus.cc:2243] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.078704  6874 raft_consensus.cc:2272] T 8ab89972ea7341a79be8a760a43ccfcb P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.079206 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.081878  6874 tablet_replica.cc:333] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.083109  6874 raft_consensus.cc:2243] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.083829  6874 raft_consensus.cc:2272] T 0a637f29bcd04712ae40966d9b293303 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.086988  6874 tablet_replica.cc:333] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.087862  6874 raft_consensus.cc:2243] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.088515  6874 raft_consensus.cc:2272] T b875e4a6504b43ef98139d098839a56c P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.091807  6874 tablet_replica.cc:333] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.092757  6874 raft_consensus.cc:2243] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.093439  6874 raft_consensus.cc:2272] T c753e3027c7b414c9b0eb823b6c2893e P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.093842 16540 consensus_peers.cc:597] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.096992  6874 tablet_replica.cc:333] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.098079  6874 raft_consensus.cc:2243] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.099467  6874 raft_consensus.cc:2272] T 4ed76da550ea4f6690eb02f71843397a P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.103044  6874 tablet_replica.cc:333] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.104009  6874 raft_consensus.cc:2243] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.104702  6874 raft_consensus.cc:2272] T aea1365c62bb457f95eb3d1f583a6d7d P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.107865  6874 tablet_replica.cc:333] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.108711  6874 raft_consensus.cc:2243] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.110006  6874 raft_consensus.cc:2272] T 912f04f17584451592c26c403070693c P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.113232  6874 tablet_replica.cc:333] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.114189  6874 raft_consensus.cc:2243] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.115605  6874 raft_consensus.cc:2272] T 729d22f5fdb4470dbb68890b960a8395 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.119087  6874 tablet_replica.cc:333] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.120041  6874 raft_consensus.cc:2243] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.121362  6874 raft_consensus.cc:2272] T 459c4e3e74104556b0fdc8dbf900c78b P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.124485  6874 tablet_replica.cc:333] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.126050  6874 raft_consensus.cc:2243] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.126761  6874 raft_consensus.cc:2272] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.129583 16540 consensus_peers.cc:597] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.131089  6874 tablet_replica.cc:333] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.131810  6874 raft_consensus.cc:2243] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.132983  6874 raft_consensus.cc:2272] T 4d0af858657e45a992b1c1c0883e888f P 57226fc89069472b9311be6e596aa8ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.136060  6874 tablet_replica.cc:333] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.136971  6874 raft_consensus.cc:2243] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.137708  6874 raft_consensus.cc:2272] T 7c6984bac3db42cca9c8fb4969479f32 P 57226fc89069472b9311be6e596aa8ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.140878  6874 tablet_replica.cc:333] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.141672  6874 raft_consensus.cc:2243] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.142974  6874 raft_consensus.cc:2272] T 98012d4197b649e6be7f7df5d46b6218 P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.143299 16614 consensus_peers.cc:597] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.145116 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.146478  6874 tablet_replica.cc:333] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.147338  6874 raft_consensus.cc:2243] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.150279  6874 raft_consensus.cc:2272] T 25341f99080e43ab92f1b8ffdd24bd2b P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.154178  6874 tablet_replica.cc:333] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.155021  6874 raft_consensus.cc:2243] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.155694  6874 raft_consensus.cc:2272] T 9bd8dd213a384928ad8674ef30844b45 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.159255  6874 tablet_replica.cc:333] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
W20260709 12:26:13.159937 16540 consensus_peers.cc:597] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.160120  6874 raft_consensus.cc:2243] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.161521  6874 raft_consensus.cc:2272] T 52cfc56c2e6b47dca2c52bfe83853728 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.165129  6874 tablet_replica.cc:333] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.166039  6874 raft_consensus.cc:2243] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.167306  6874 raft_consensus.cc:2272] T a10685b118db4ae794b1ecf232267bb8 P 57226fc89069472b9311be6e596aa8ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.170703  6874 tablet_replica.cc:333] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.171497  6874 raft_consensus.cc:2243] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.172127  6874 raft_consensus.cc:2272] T cafc96e5f9404fd4be84ec37525a1b25 P 57226fc89069472b9311be6e596aa8ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.175285  6874 tablet_replica.cc:333] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee: stopping tablet replica
I20260709 12:26:13.176028  6874 raft_consensus.cc:2243] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.177335  6874 raft_consensus.cc:2272] T 2abf5d33e7a744ab8a191960f961bdcd P 57226fc89069472b9311be6e596aa8ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.180398 16540 consensus_peers.cc:597] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.232438 16614 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 466 similar messages]
W20260709 12:26:13.236172 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.254199 16614 consensus_peers.cc:597] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:13.256098 16614 connection.cc:573] client connection to 127.6.182.130:34585 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:26:13.264286  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
W20260709 12:26:13.267120 16614 consensus_peers.cc:597] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.267812 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.299831 16540 consensus_peers.cc:597] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.302471 16540 consensus_peers.cc:597] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.318934 16614 consensus_peers.cc:597] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.319288 16540 consensus_peers.cc:597] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.325191 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.332273 16614 consensus_peers.cc:597] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.388173  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:26:13.396994 16615 consensus_peers.cc:597] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.397616 16615 consensus_peers.cc:597] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.423871 16614 consensus_peers.cc:597] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:13.424520 16614 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:13.444015 16540 consensus_peers.cc:597] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd -> Peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Couldn't send request to peer 57226fc89069472b9311be6e596aa8ee. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.479993  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:13.481902 16615 consensus_peers.cc:597] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.482765  6874 tablet_replica.cc:333] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.484517  6874 raft_consensus.cc:2243] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.485567  6874 raft_consensus.cc:2272] T ee31b43a234a4568866bc7b687e42337 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.487913  6874 tablet_replica.cc:333] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.488582  6874 raft_consensus.cc:2243] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.489493  6874 raft_consensus.cc:2272] T 30c6323485424469a3be43cd3a647cad P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.492231  6874 tablet_replica.cc:333] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.493100  6874 raft_consensus.cc:2243] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.494187  6874 raft_consensus.cc:2272] T 607f98fb104d4e60bb399f4e52414dff P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.495850 16614 consensus_peers.cc:597] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.497095  6874 tablet_replica.cc:333] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.497813  6874 raft_consensus.cc:2243] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.498672  6874 raft_consensus.cc:2272] T 35263f5174d84840b741879f4ba4e980 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.501031  6874 tablet_replica.cc:333] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.501664  6874 raft_consensus.cc:2243] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.502125  6874 raft_consensus.cc:2272] T 56252914f95a4889a4f744beb66359d2 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.504598  6874 tablet_replica.cc:333] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.505288  6874 raft_consensus.cc:2243] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.505759  6874 raft_consensus.cc:2272] T 12bffdfc1b45484c9452392f860318fd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.508092  6874 tablet_replica.cc:333] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.508952  6874 raft_consensus.cc:2243] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.509567  6874 raft_consensus.cc:2272] T b17303c99a9d4e87b2d1903bff808994 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.513520  6874 tablet_replica.cc:333] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.514650  6874 raft_consensus.cc:2243] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.515372  6874 raft_consensus.cc:2272] T aea1365c62bb457f95eb3d1f583a6d7d P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.522156  6874 tablet_replica.cc:333] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.523386  6874 raft_consensus.cc:2243] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.524235  6874 raft_consensus.cc:2272] T 912f04f17584451592c26c403070693c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.527870  6874 tablet_replica.cc:333] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.528939  6874 raft_consensus.cc:2243] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.529699  6874 raft_consensus.cc:2272] T 957637a18e91481fb00d24ee6684e679 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.532605  6874 tablet_replica.cc:333] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.534119  6874 raft_consensus.cc:2243] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:13.534518 16614 consensus_peers.cc:597] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.534683  6874 raft_consensus.cc:2272] T 1ad58928df6e4de09d9efac2b2da0a2e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.534824 16615 consensus_peers.cc:597] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.537384  6874 tablet_replica.cc:333] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.538060  6874 raft_consensus.cc:2243] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.539063  6874 raft_consensus.cc:2272] T 2a2d3f30f6a6496fa42959f3adc78ff9 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.542107  6874 tablet_replica.cc:333] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.542909  6874 raft_consensus.cc:2243] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.544018  6874 raft_consensus.cc:2272] T bddb5ffc80c04064b4a3b894023118d2 P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.547277  6874 tablet_replica.cc:333] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.548151  6874 raft_consensus.cc:2243] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.548739  6874 raft_consensus.cc:2272] T af5dd7018976414e8ed99fd67565655d P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.551738  6874 tablet_replica.cc:333] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.552544  6874 raft_consensus.cc:2243] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.553277  6874 raft_consensus.cc:2272] T 06cf958045274e6f8c8b60508d68cf26 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.556216  6874 tablet_replica.cc:333] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
W20260709 12:26:13.556720 16614 consensus_peers.cc:597] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.557140  6874 raft_consensus.cc:2243] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.559144  6874 raft_consensus.cc:2272] T 2ef6c0d79aee443896c5b4c0cc5ea863 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.563331  6874 tablet_replica.cc:333] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.569258  6874 raft_consensus.cc:2243] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.570653  6874 raft_consensus.cc:2272] T 020b055b364646c9b177588ef98ec412 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.573464  6874 tablet_replica.cc:333] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.574191  6874 raft_consensus.cc:2243] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.574785  6874 raft_consensus.cc:2272] T f4d8cd99199d478e8112f6890e152dd7 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.579166  6874 tablet_replica.cc:333] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.581020  6874 raft_consensus.cc:2243] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.582232  6874 raft_consensus.cc:2272] T a8ad60577d0e48709e6040873bb43f0c P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.584879  6874 tablet_replica.cc:333] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.585705  6874 raft_consensus.cc:2243] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.586426  6874 raft_consensus.cc:2272] T 55bce0408d844486ae486633aad4bc7e P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.589277  6874 tablet_replica.cc:333] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.590080  6874 raft_consensus.cc:2243] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.590626  6874 raft_consensus.cc:2272] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.593446  6874 tablet_replica.cc:333] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.594211  6874 raft_consensus.cc:2243] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:13.594447 16615 consensus_peers.cc:597] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.594816  6874 raft_consensus.cc:2272] T 4e7e81a4e4bb44878fc114bec5022722 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.597570  6874 tablet_replica.cc:333] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.598214  6874 raft_consensus.cc:2243] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.598735  6874 raft_consensus.cc:2272] T 9c6a412331894ae5b4797dbc5cdba9ba P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.601016  6874 tablet_replica.cc:333] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.601619  6874 raft_consensus.cc:2243] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.602512  6874 raft_consensus.cc:2272] T bb9f76a3c6784d0f97f736edeb104e6b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.604853  6874 tablet_replica.cc:333] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.605544  6874 raft_consensus.cc:2243] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.606451  6874 raft_consensus.cc:2272] T 39b59162ae2d417092181b3f9198701e P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.608580  6874 tablet_replica.cc:333] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.609227  6874 raft_consensus.cc:2243] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.609772  6874 raft_consensus.cc:2272] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.612329  6874 tablet_replica.cc:333] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.613124  6874 raft_consensus.cc:2243] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.614127  6874 raft_consensus.cc:2272] T 09a476f9e5784529a3f8e75fed90d096 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.615929 16540 consensus_peers.cc:597] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.616581  6874 tablet_replica.cc:333] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.617439  6874 raft_consensus.cc:2243] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.618013  6874 raft_consensus.cc:2272] T 52cfc56c2e6b47dca2c52bfe83853728 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.620288  6874 tablet_replica.cc:333] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.620956  6874 raft_consensus.cc:2243] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.621470  6874 raft_consensus.cc:2272] T a10685b118db4ae794b1ecf232267bb8 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.623749  6874 tablet_replica.cc:333] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.624328  6874 raft_consensus.cc:2243] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.624915  6874 raft_consensus.cc:2272] T 89c18e43c84047efb66015470a2254ab P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.627131  6874 tablet_replica.cc:333] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.627730  6874 raft_consensus.cc:2243] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.628767  6874 raft_consensus.cc:2272] T e2f105035b4f4eda8c0fb001d571ddaa P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.630940  6874 tablet_replica.cc:333] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.631529  6874 raft_consensus.cc:2243] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.632128  6874 raft_consensus.cc:2272] T 2abf5d33e7a744ab8a191960f961bdcd P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.635174  6874 tablet_replica.cc:333] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.635926  6874 raft_consensus.cc:2243] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.637192  6874 raft_consensus.cc:2272] T 96e703662cca4f18a580ec34362c26ba P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.639657  6874 tablet_replica.cc:333] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.640288  6874 raft_consensus.cc:2243] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.641439  6874 raft_consensus.cc:2272] T 8ab89972ea7341a79be8a760a43ccfcb P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.643657  6874 tablet_replica.cc:333] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.644300  6874 raft_consensus.cc:2243] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.645354  6874 raft_consensus.cc:2272] T 0a637f29bcd04712ae40966d9b293303 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.650166  6874 tablet_replica.cc:333] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.650810  6874 raft_consensus.cc:2243] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.651973  6874 raft_consensus.cc:2272] T 7c6984bac3db42cca9c8fb4969479f32 P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.662906  6874 tablet_replica.cc:333] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.663726  6874 raft_consensus.cc:2243] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.664330  6874 raft_consensus.cc:2272] T 98012d4197b649e6be7f7df5d46b6218 P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.665457 16614 consensus_peers.cc:597] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.667402  6874 tablet_replica.cc:333] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.668119  6874 raft_consensus.cc:2243] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.668673  6874 raft_consensus.cc:2272] T 002181790b60483db2f0b175ffa46e97 P 9579e506d72842a9a847d0498878c3fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.671933  6874 tablet_replica.cc:333] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.672699  6874 raft_consensus.cc:2243] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.673287  6874 raft_consensus.cc:2272] T 25341f99080e43ab92f1b8ffdd24bd2b P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.673349 16615 consensus_peers.cc:597] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.674069 16615 consensus_peers.cc:597] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.676373  6874 tablet_replica.cc:333] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.677192  6874 raft_consensus.cc:2243] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.677825  6874 raft_consensus.cc:2272] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.680335 16614 consensus_peers.cc:597] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.680601  6874 tablet_replica.cc:333] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.681334  6874 raft_consensus.cc:2243] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.681808  6874 raft_consensus.cc:2272] T 4d0af858657e45a992b1c1c0883e888f P 9579e506d72842a9a847d0498878c3fd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.683951  6874 tablet_replica.cc:333] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.684478  6874 raft_consensus.cc:2243] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.685330  6874 raft_consensus.cc:2272] T 2855310d11c545378f19afd1715ebb47 P 9579e506d72842a9a847d0498878c3fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.687479  6874 tablet_replica.cc:333] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.687963  6874 raft_consensus.cc:2243] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.688876  6874 raft_consensus.cc:2272] T 6271255b6fb24144ae8515a99a98297a P 9579e506d72842a9a847d0498878c3fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.691176  6874 tablet_replica.cc:333] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd: stopping tablet replica
I20260709 12:26:13.691727  6874 raft_consensus.cc:2243] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.692203  6874 raft_consensus.cc:2272] T 4ed76da550ea4f6690eb02f71843397a P 9579e506d72842a9a847d0498878c3fd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.695647 16615 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.705545 16615 consensus_peers.cc:597] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.707283 16615 consensus_peers.cc:597] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.743338 16615 consensus_peers.cc:597] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.737195 16614 consensus_peers.cc:597] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Couldn't send request to peer a8133a8f49724a8897d8bc4f718d802d. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:13.782500  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
W20260709 12:26:13.791648 16615 consensus_peers.cc:597] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.131:41973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.851023 16615 consensus_peers.cc:597] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.131:41973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.873207  6874 tablet_server.cc:179] TabletServer@127.6.182.132:0 shutting down...
W20260709 12:26:13.909544 16615 consensus_peers.cc:597] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 -> Peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Couldn't send request to peer 9579e506d72842a9a847d0498878c3fd. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.131:41973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.926728  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:13.927815  6874 tablet_replica.cc:333] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.928906  6874 raft_consensus.cc:2243] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.929571  6874 raft_consensus.cc:2272] T 607f98fb104d4e60bb399f4e52414dff P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.931752  6874 tablet_replica.cc:333] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.932333  6874 raft_consensus.cc:2243] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.932788  6874 raft_consensus.cc:2272] T 4a4d37de09ac428a9151d21ca953d08c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.934818  6874 tablet_replica.cc:333] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.935348  6874 raft_consensus.cc:2243] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.935726  6874 raft_consensus.cc:2272] T ee31b43a234a4568866bc7b687e42337 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.937747  6874 tablet_replica.cc:333] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.938246  6874 raft_consensus.cc:2243] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.939023  6874 raft_consensus.cc:2272] T 002181790b60483db2f0b175ffa46e97 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.941088  6874 tablet_replica.cc:333] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.941612  6874 raft_consensus.cc:2243] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.941983  6874 raft_consensus.cc:2272] T 35263f5174d84840b741879f4ba4e980 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.943861  6874 tablet_replica.cc:333] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.944386  6874 raft_consensus.cc:2243] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.944795  6874 raft_consensus.cc:2272] T 440906c79bf64ae3bd7a7b15c6abba82 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.946738  6874 tablet_replica.cc:333] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.947237  6874 raft_consensus.cc:2243] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.947607  6874 raft_consensus.cc:2272] T 89c18e43c84047efb66015470a2254ab P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.949559  6874 tablet_replica.cc:333] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.950037  6874 raft_consensus.cc:2243] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.950803  6874 raft_consensus.cc:2272] T 12bffdfc1b45484c9452392f860318fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.952582  6874 tablet_replica.cc:333] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.953137  6874 raft_consensus.cc:2243] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.953857  6874 raft_consensus.cc:2272] T 957637a18e91481fb00d24ee6684e679 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.955615  6874 tablet_replica.cc:333] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.956151  6874 raft_consensus.cc:2243] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.956586  6874 raft_consensus.cc:2272] T bddb5ffc80c04064b4a3b894023118d2 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.958527  6874 tablet_replica.cc:333] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.959034  6874 raft_consensus.cc:2243] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.960089  6874 raft_consensus.cc:2272] T 6b09eddf44e747eb9bc7886771ea40fd P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.962860  6874 tablet_replica.cc:333] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.963722  6874 raft_consensus.cc:2243] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.964818  6874 raft_consensus.cc:2272] T 419069393a644530ac323793012d5f9c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.966948  6874 tablet_replica.cc:333] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.967710  6874 raft_consensus.cc:2243] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.968779  6874 raft_consensus.cc:2272] T f1fcca6ce8824a0884716942fc18ff9a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.971333  6874 tablet_replica.cc:333] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.972106  6874 raft_consensus.cc:2243] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.972711  6874 raft_consensus.cc:2272] T b17303c99a9d4e87b2d1903bff808994 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.975484  6874 tablet_replica.cc:333] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.976263  6874 raft_consensus.cc:2243] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.977186  6874 raft_consensus.cc:2272] T b9ab7bf5977d4d7e9033989e7f6ddc3f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.979267  6874 tablet_replica.cc:333] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.979844  6874 raft_consensus.cc:2243] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.980701  6874 raft_consensus.cc:2272] T 4e7e81a4e4bb44878fc114bec5022722 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.982717  6874 tablet_replica.cc:333] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.983279  6874 raft_consensus.cc:2243] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.984061  6874 raft_consensus.cc:2272] T 9c6a412331894ae5b4797dbc5cdba9ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.986130  6874 tablet_replica.cc:333] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.986776  6874 raft_consensus.cc:2243] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.987563  6874 raft_consensus.cc:2272] T 71519fa014734fe68b4df3cea03ca766 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.989552  6874 tablet_replica.cc:333] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.990119  6874 raft_consensus.cc:2243] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.990981  6874 raft_consensus.cc:2272] T 020b055b364646c9b177588ef98ec412 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.993001  6874 tablet_replica.cc:333] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.993572  6874 raft_consensus.cc:2243] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.994385  6874 raft_consensus.cc:2272] T f4d8cd99199d478e8112f6890e152dd7 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.996343  6874 tablet_replica.cc:333] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:13.996948  6874 raft_consensus.cc:2243] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.997452  6874 raft_consensus.cc:2272] T a8ad60577d0e48709e6040873bb43f0c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.999629  6874 tablet_replica.cc:333] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.000483  6874 raft_consensus.cc:2243] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.001506  6874 raft_consensus.cc:2272] T 55bce0408d844486ae486633aad4bc7e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.003921  6874 tablet_replica.cc:333] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.004132 17880 raft_consensus.cc:493] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:14.004884  6874 raft_consensus.cc:2243] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.004748 17880 raft_consensus.cc:515] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } } peers { permanent_uuid: "9579e506d72842a9a847d0498878c3fd" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 41973 } } peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } }
I20260709 12:26:14.005625  6874 raft_consensus.cc:2272] T 96e703662cca4f18a580ec34362c26ba P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.007392 17880 leader_election.cc:290] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585), 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973)
I20260709 12:26:14.009153  6874 tablet_replica.cc:333] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.010013  6874 raft_consensus.cc:2243] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:14.011132 16614 leader_election.cc:336] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111)
I20260709 12:26:14.011178  6874 raft_consensus.cc:2272] T cafc96e5f9404fd4be84ec37525a1b25 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:14.011912 16615 leader_election.cc:336] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9579e506d72842a9a847d0498878c3fd (127.6.182.131:41973): Network error: Client connection negotiation failed: client connection to 127.6.182.131:41973: connect: Connection refused (error 111)
I20260709 12:26:14.012359 16615 leader_election.cc:304] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, 9579e506d72842a9a847d0498878c3fd
I20260709 12:26:14.013175 17880 raft_consensus.cc:2749] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:14.014410  6874 tablet_replica.cc:333] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.015121  6874 raft_consensus.cc:2243] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.015759 17880 raft_consensus.cc:493] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 57226fc89069472b9311be6e596aa8ee)
I20260709 12:26:14.016297  6874 raft_consensus.cc:2272] T f6439a65987543bbb05819426afdf56f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.016345 17880 raft_consensus.cc:515] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "736f96578e2c4a2fb240e98ccdce0fb5" member_type: VOTER last_known_addr { host: "127.6.182.132" port: 43917 } } peers { permanent_uuid: "a8133a8f49724a8897d8bc4f718d802d" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 35115 } } peers { permanent_uuid: "57226fc89069472b9311be6e596aa8ee" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34585 } }
I20260709 12:26:14.019075 17880 leader_election.cc:290] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115), 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585)
I20260709 12:26:14.019775  6874 tablet_replica.cc:333] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.020766  6874 raft_consensus.cc:2243] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.021761  6874 raft_consensus.cc:2272] T 06cf958045274e6f8c8b60508d68cf26 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:14.022909 16614 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a8133a8f49724a8897d8bc4f718d802d (127.6.182.129:35115): Network error: Client connection negotiation failed: client connection to 127.6.182.129:35115: connect: Connection refused (error 111)
W20260709 12:26:14.023618 16614 leader_election.cc:336] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 57226fc89069472b9311be6e596aa8ee (127.6.182.130:34585): Network error: Client connection negotiation failed: client connection to 127.6.182.130:34585: connect: Connection refused (error 111)
I20260709 12:26:14.023937 16614 leader_election.cc:304] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 736f96578e2c4a2fb240e98ccdce0fb5; no voters: 57226fc89069472b9311be6e596aa8ee, a8133a8f49724a8897d8bc4f718d802d
I20260709 12:26:14.024472  6874 tablet_replica.cc:333] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.024590 17880 raft_consensus.cc:2749] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:14.025485  6874 raft_consensus.cc:2243] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.026281  6874 raft_consensus.cc:2272] T af5dd7018976414e8ed99fd67565655d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.028246  6874 tablet_replica.cc:333] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.028851  6874 raft_consensus.cc:2243] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.029587  6874 raft_consensus.cc:2272] T 4ab5fdb3eb3e45b2a3b1acf9288fc9c5 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.031687  6874 tablet_replica.cc:333] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.032258  6874 raft_consensus.cc:2243] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.032720  6874 raft_consensus.cc:2272] T 459c4e3e74104556b0fdc8dbf900c78b P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.034719  6874 tablet_replica.cc:333] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.035238  6874 raft_consensus.cc:2243] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.036077  6874 raft_consensus.cc:2272] T aea1365c62bb457f95eb3d1f583a6d7d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.038169  6874 tablet_replica.cc:333] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.038681  6874 raft_consensus.cc:2243] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.039093  6874 raft_consensus.cc:2272] T 729d22f5fdb4470dbb68890b960a8395 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.041159  6874 tablet_replica.cc:333] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.041690  6874 raft_consensus.cc:2243] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.042460  6874 raft_consensus.cc:2272] T 2b6f61d9e2dc485baa469c1bcf3f9b6d P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.044438  6874 tablet_replica.cc:333] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.045014  6874 raft_consensus.cc:2243] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.045423  6874 raft_consensus.cc:2272] T 09a476f9e5784529a3f8e75fed90d096 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.047330  6874 tablet_replica.cc:333] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.047860  6874 raft_consensus.cc:2243] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.048601  6874 raft_consensus.cc:2272] T 9bd8dd213a384928ad8674ef30844b45 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.050586  6874 tablet_replica.cc:333] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.051106  6874 raft_consensus.cc:2243] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.051503  6874 raft_consensus.cc:2272] T 4ed76da550ea4f6690eb02f71843397a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.053426  6874 tablet_replica.cc:333] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.053922  6874 raft_consensus.cc:2243] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.054711  6874 raft_consensus.cc:2272] T c753e3027c7b414c9b0eb823b6c2893e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.056602  6874 tablet_replica.cc:333] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.057288  6874 raft_consensus.cc:2243] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.058055  6874 raft_consensus.cc:2272] T bb5374aa54af41848399d9477ec0fccf P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.059831  6874 tablet_replica.cc:333] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.060302  6874 raft_consensus.cc:2243] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.060767  6874 raft_consensus.cc:2272] T 8ab89972ea7341a79be8a760a43ccfcb P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.062695  6874 tablet_replica.cc:333] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.063122  6874 raft_consensus.cc:2243] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.063484  6874 raft_consensus.cc:2272] T 0a637f29bcd04712ae40966d9b293303 P 736f96578e2c4a2fb240e98ccdce0fb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.065485  6874 tablet_replica.cc:333] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.066133  6874 raft_consensus.cc:2243] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.066617  6874 raft_consensus.cc:2272] T 4d0af858657e45a992b1c1c0883e888f P 736f96578e2c4a2fb240e98ccdce0fb5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.068727  6874 tablet_replica.cc:333] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.069228  6874 raft_consensus.cc:2243] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.069674  6874 raft_consensus.cc:2272] T 30c6323485424469a3be43cd3a647cad P 736f96578e2c4a2fb240e98ccdce0fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.071600  6874 tablet_replica.cc:333] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.072074  6874 raft_consensus.cc:2243] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.072916  6874 raft_consensus.cc:2272] T b875e4a6504b43ef98139d098839a56c P 736f96578e2c4a2fb240e98ccdce0fb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.074959  6874 tablet_replica.cc:333] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.075461  6874 raft_consensus.cc:2243] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.075897  6874 raft_consensus.cc:2272] T 229e66771a884b868626f2c5c0f7ce0e P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.077838  6874 tablet_replica.cc:333] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5: stopping tablet replica
I20260709 12:26:14.078343  6874 raft_consensus.cc:2243] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.078743  6874 raft_consensus.cc:2272] T 6271255b6fb24144ae8515a99a98297a P 736f96578e2c4a2fb240e98ccdce0fb5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.149211  6874 tablet_server.cc:196] TabletServer@127.6.182.132:0 shutdown complete.
I20260709 12:26:14.220945  6874 master.cc:562] Master@127.6.182.190:41909 shutting down...
I20260709 12:26:14.252029  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:14.252708  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.253082  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a79cacc982a4a45b440e7b2dca25e43: stopping tablet replica
I20260709 12:26:14.299937  6874 master.cc:584] Master@127.6.182.190:41909 shutdown complete.
I20260709 12:26:14.337246  6874 test_util.cc:182] -----------------------------------------------
I20260709 12:26:14.337491  6874 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599585808757-6874-0
[  FAILED  ] LeaderRebalancerTest.RestartTserver (45680 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:26:14.340739  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:41201
I20260709 12:26:14.342020  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:14.347555 17883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.348313 17884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.349732 17886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.350000  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:14.351377  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:14.351562  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:14.351739  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599974351724 us; error 0 us; skew 500 ppm
I20260709 12:26:14.352339  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:14.359335  6874 webserver.cc:533] Webserver started at http://127.6.182.190:36561/ using document root <none> and password file <none>
I20260709 12:26:14.359877  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:14.360072  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:14.360374  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:14.361575  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "e23f960d6186423db68b369b23ab323a"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.366331  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:14.370448 17891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.371423  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:26:14.371781  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "e23f960d6186423db68b369b23ab323a"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.372036  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:14.391875  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:14.393213  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:14.432587  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:41201
I20260709 12:26:14.432868 17943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:41201 every 8 connection(s)
I20260709 12:26:14.436888 17944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.449069 17944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a: Bootstrap starting.
I20260709 12:26:14.454599 17944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.459316 17944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a: No bootstrap required, opened a new log
I20260709 12:26:14.461663 17944 raft_consensus.cc:359] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER }
I20260709 12:26:14.462064 17944 raft_consensus.cc:385] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.462270 17944 raft_consensus.cc:740] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23f960d6186423db68b369b23ab323a, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.462873 17944 consensus_queue.cc:260] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER }
I20260709 12:26:14.463296 17944 raft_consensus.cc:399] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:14.463488 17944 raft_consensus.cc:493] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:14.463696 17944 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.468542 17944 raft_consensus.cc:515] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER }
I20260709 12:26:14.469058 17944 leader_election.cc:304] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e23f960d6186423db68b369b23ab323a; no voters: 
I20260709 12:26:14.470206 17944 leader_election.cc:290] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:14.470691 17947 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.472215 17947 raft_consensus.cc:697] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 1 LEADER]: Becoming Leader. State: Replica: e23f960d6186423db68b369b23ab323a, State: Running, Role: LEADER
I20260709 12:26:14.472993 17947 consensus_queue.cc:237] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER }
I20260709 12:26:14.473245 17944 sys_catalog.cc:565] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:14.478246 17948 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e23f960d6186423db68b369b23ab323a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER } }
I20260709 12:26:14.478269 17949 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e23f960d6186423db68b369b23ab323a. Latest consensus state: current_term: 1 leader_uuid: "e23f960d6186423db68b369b23ab323a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23f960d6186423db68b369b23ab323a" member_type: VOTER } }
I20260709 12:26:14.479140 17949 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:14.479140 17948 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:14.485540 17954 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:14.492048 17954 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:14.493244  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:14.501511 17954 catalog_manager.cc:1383] Generated new cluster ID: c7e11f2188154ae2bfe5062ccaaad0e6
I20260709 12:26:14.501823 17954 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:14.522416 17954 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:14.523754 17954 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:14.540458 17954 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a: Generated new TSK 0
I20260709 12:26:14.541147 17954 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:14.561028  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:14.568807 17965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.570745 17966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.572943  6874 server_base.cc:1061] running on GCE node
W20260709 12:26:14.573280 17968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.576079  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:14.576411  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:14.576663  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599974576619 us; error 0 us; skew 500 ppm
I20260709 12:26:14.577579  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:14.581964  6874 webserver.cc:533] Webserver started at http://127.6.182.129:37581/ using document root <none> and password file <none>
I20260709 12:26:14.582787  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:14.583061  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:14.583415  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:14.585143  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "81be18a977274863852d38aa474220b3"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.591919  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:14.596097 17973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.597016  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:14.597393  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "81be18a977274863852d38aa474220b3"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.597741  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:14.610787  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:14.612144  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:14.614348  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:14.617125  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:14.617362  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.617653  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:14.617839  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.667341  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:36249
I20260709 12:26:14.667467 18035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:36249 every 8 connection(s)
I20260709 12:26:14.675132  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:14.681627 18040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.683314 18041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.686511  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:14.687184 18036 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41201
I20260709 12:26:14.687670 18036 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:14.688441 18043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.688565 18036 heartbeater.cc:507] Master 127.6.182.190:41201 requested a full tablet report, sending...
I20260709 12:26:14.689563  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:14.689829  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:14.690129  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599974690105 us; error 0 us; skew 500 ppm
I20260709 12:26:14.690872  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:14.691188 17908 ts_manager.cc:194] Registered new tserver with Master: 81be18a977274863852d38aa474220b3 (127.6.182.129:36249)
I20260709 12:26:14.693475 17908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54918
I20260709 12:26:14.694186  6874 webserver.cc:533] Webserver started at http://127.6.182.130:33441/ using document root <none> and password file <none>
I20260709 12:26:14.695125  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:14.695417  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:14.695699  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:14.697357  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "369f41941e2f42418050205d02be8cf2"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.702337  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:14.706311 18048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.707322  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:14.707698  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "369f41941e2f42418050205d02be8cf2"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.708045  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:14.731870  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:14.733299  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:14.734894  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:14.737412  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:14.737684  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.738030  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:14.738234  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.784863  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:44219
I20260709 12:26:14.785019 18111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:44219 every 8 connection(s)
I20260709 12:26:14.790432  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:14.799026 18115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.799324 18116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:14.803107 18118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:14.803560  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:14.804458 18112 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41201
I20260709 12:26:14.804800  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:14.804992 18112 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:14.805155  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:14.805444  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599974805420 us; error 0 us; skew 500 ppm
I20260709 12:26:14.806066 18112 heartbeater.cc:507] Master 127.6.182.190:41201 requested a full tablet report, sending...
I20260709 12:26:14.806350  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:14.808709 17908 ts_manager.cc:194] Registered new tserver with Master: 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:14.809453  6874 webserver.cc:533] Webserver started at http://127.6.182.131:36031/ using document root <none> and password file <none>
I20260709 12:26:14.810142  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:14.810334  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:14.810371 17908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54934
I20260709 12:26:14.810786  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:14.812292  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "bc670002c01040788f11bcea4901fdee"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.817178  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:14.820444 18123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.821348  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:14.821669  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "bc670002c01040788f11bcea4901fdee"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:14.821965  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:14.845469  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:14.846904  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:14.848580  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:14.851030  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:14.851296  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.851563  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:14.851761  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:14.900489  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:46153
I20260709 12:26:14.900617 18185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:46153 every 8 connection(s)
I20260709 12:26:14.919382 18186 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41201
I20260709 12:26:14.919842 18186 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:14.920610 18186 heartbeater.cc:507] Master 127.6.182.190:41201 requested a full tablet report, sending...
I20260709 12:26:14.922811 17908 ts_manager.cc:194] Registered new tserver with Master: bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:14.923873  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018693628s
I20260709 12:26:14.924430 17908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54938
I20260709 12:26:14.951341 17908 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54952:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:14.954669 17908 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:15.054001 18151 tablet_service.cc:1511] Processing CreateTablet for tablet e7fa3c55bfb443788761e818ae518eaf (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:15.055546 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fa3c55bfb443788761e818ae518eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.057078 18148 tablet_service.cc:1511] Processing CreateTablet for tablet 3637f864dc5949a48a1614a1787076f8 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:15.058125 18000 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1a6dac83041d6966c8bb936a98c39 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:15.059891 18000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1a6dac83041d6966c8bb936a98c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.060029 18149 tablet_service.cc:1511] Processing CreateTablet for tablet cd64f8d2e04f42ad86bfc022b29e189a (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:15.060319 17997 tablet_service.cc:1511] Processing CreateTablet for tablet cac88b0c03f9498fbdefd53694e2ce20 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:15.061904 17997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac88b0c03f9498fbdefd53694e2ce20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.062546 18150 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1a6dac83041d6966c8bb936a98c39 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:15.064842 18147 tablet_service.cc:1511] Processing CreateTablet for tablet cac88b0c03f9498fbdefd53694e2ce20 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:15.065994 17996 tablet_service.cc:1511] Processing CreateTablet for tablet 46cb18f906f64071ad64ad79848d8d76 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:15.062599 17999 tablet_service.cc:1511] Processing CreateTablet for tablet cd64f8d2e04f42ad86bfc022b29e189a (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:15.067553 17996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46cb18f906f64071ad64ad79848d8d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.063951 17998 tablet_service.cc:1511] Processing CreateTablet for tablet 3637f864dc5949a48a1614a1787076f8 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:15.058678 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637f864dc5949a48a1614a1787076f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.068969 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac88b0c03f9498fbdefd53694e2ce20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.068301 17999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd64f8d2e04f42ad86bfc022b29e189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.069940 18001 tablet_service.cc:1511] Processing CreateTablet for tablet e7fa3c55bfb443788761e818ae518eaf (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:15.071460 18001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fa3c55bfb443788761e818ae518eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.072990 17998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637f864dc5949a48a1614a1787076f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.073040 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd64f8d2e04f42ad86bfc022b29e189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.074543 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1a6dac83041d6966c8bb936a98c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.074092 17995 tablet_service.cc:1511] Processing CreateTablet for tablet 1b072e327da74003a0ad8f1ffa287876 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:15.076807 17995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b072e327da74003a0ad8f1ffa287876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.086591 18202 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.096835 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 46cb18f906f64071ad64ad79848d8d76 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:15.098380 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46cb18f906f64071ad64ad79848d8d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.102295 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 1b072e327da74003a0ad8f1ffa287876 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:15.103745 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b072e327da74003a0ad8f1ffa287876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.098008 18077 tablet_service.cc:1511] Processing CreateTablet for tablet e7fa3c55bfb443788761e818ae518eaf (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:15.107807 18077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fa3c55bfb443788761e818ae518eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.108814 18076 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1a6dac83041d6966c8bb936a98c39 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:15.109192 17994 tablet_service.cc:1511] Processing CreateTablet for tablet 18393d89c21841e08b43f6c5e7633e2b (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:15.110273 18076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1a6dac83041d6966c8bb936a98c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.110755 17994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18393d89c21841e08b43f6c5e7633e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.122643 18075 tablet_service.cc:1511] Processing CreateTablet for tablet cd64f8d2e04f42ad86bfc022b29e189a (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:15.124176 18075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd64f8d2e04f42ad86bfc022b29e189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.094682 18202 tablet_bootstrap.cc:654] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.130546 18074 tablet_service.cc:1511] Processing CreateTablet for tablet 3637f864dc5949a48a1614a1787076f8 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:15.132062 18074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637f864dc5949a48a1614a1787076f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.133581 17993 tablet_service.cc:1511] Processing CreateTablet for tablet e70af63b5a22462590e264ec0b7c4315 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:15.143381 17993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70af63b5a22462590e264ec0b7c4315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.147710 18145 tablet_service.cc:1511] Processing CreateTablet for tablet 18393d89c21841e08b43f6c5e7633e2b (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:15.148557 18073 tablet_service.cc:1511] Processing CreateTablet for tablet cac88b0c03f9498fbdefd53694e2ce20 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:15.149362 18145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18393d89c21841e08b43f6c5e7633e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.150045 18073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac88b0c03f9498fbdefd53694e2ce20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.154379 18072 tablet_service.cc:1511] Processing CreateTablet for tablet 46cb18f906f64071ad64ad79848d8d76 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:15.156617 18071 tablet_service.cc:1511] Processing CreateTablet for tablet 1b072e327da74003a0ad8f1ffa287876 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:15.159301 18070 tablet_service.cc:1511] Processing CreateTablet for tablet 18393d89c21841e08b43f6c5e7633e2b (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:15.161113 18070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18393d89c21841e08b43f6c5e7633e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.162137 18072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46cb18f906f64071ad64ad79848d8d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.165490 18071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b072e327da74003a0ad8f1ffa287876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.166585 17992 tablet_service.cc:1511] Processing CreateTablet for tablet b1860d58244841f98d448b19642baa77 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:15.168200 17992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1860d58244841f98d448b19642baa77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.173563 18146 tablet_service.cc:1511] Processing CreateTablet for tablet e70af63b5a22462590e264ec0b7c4315 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:15.173684 18069 tablet_service.cc:1511] Processing CreateTablet for tablet e70af63b5a22462590e264ec0b7c4315 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:15.175436 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70af63b5a22462590e264ec0b7c4315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.175537 18069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70af63b5a22462590e264ec0b7c4315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.191660 18068 tablet_service.cc:1511] Processing CreateTablet for tablet b1860d58244841f98d448b19642baa77 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:15.193156 18068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1860d58244841f98d448b19642baa77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.204733 18204 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.213853 18204 tablet_bootstrap.cc:654] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.216990 18202 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.217582 18202 ts_tablet_manager.cc:1403] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
I20260709 12:26:15.218758 18144 tablet_service.cc:1511] Processing CreateTablet for tablet b1860d58244841f98d448b19642baa77 (DEFAULT_TABLE table=test-workload [id=3b3acd89d7e64bdda1f96afb1bc23b86]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:15.220342 18144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1860d58244841f98d448b19642baa77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.253106 18202 raft_consensus.cc:359] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.254053 18202 raft_consensus.cc:385] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.254386 18202 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.255424 18202 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.339840 18204 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.340449 18204 ts_tablet_manager.cc:1403] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.136s	user 0.034s	sys 0.059s
I20260709 12:26:15.342671 18202 ts_tablet_manager.cc:1434] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.125s	user 0.031s	sys 0.056s
I20260709 12:26:15.342834 18186 heartbeater.cc:499] Master 127.6.182.190:41201 was elected leader, sending a full tablet report...
I20260709 12:26:15.343856 18202 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.344161 18204 raft_consensus.cc:359] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.344949 18204 raft_consensus.cc:385] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.345224 18204 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.345983 18204 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.360713 18206 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.365415 18202 tablet_bootstrap.cc:654] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.369858 18036 heartbeater.cc:499] Master 127.6.182.190:41201 was elected leader, sending a full tablet report...
I20260709 12:26:15.370072 18206 tablet_bootstrap.cc:654] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.370223 18204 ts_tablet_manager.cc:1434] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 12:26:15.371464 18204 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.378064 18204 tablet_bootstrap.cc:654] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.384848 18206 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.385687 18206 ts_tablet_manager.cc:1403] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 12:26:15.390923 18206 raft_consensus.cc:359] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.391918 18206 raft_consensus.cc:385] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.392302 18206 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.393298 18206 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.395349 18204 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.395574 18202 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.395982 18204 ts_tablet_manager.cc:1403] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 12:26:15.396895 18202 ts_tablet_manager.cc:1403] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.007s
I20260709 12:26:15.399473 18204 raft_consensus.cc:359] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.400275 18204 raft_consensus.cc:385] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.399926 18202 raft_consensus.cc:359] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.400606 18204 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.401104 18202 raft_consensus.cc:385] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.401803 18202 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.402282 18206 ts_tablet_manager.cc:1434] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 12:26:15.403097 18112 heartbeater.cc:499] Master 127.6.182.190:41201 was elected leader, sending a full tablet report...
I20260709 12:26:15.402709 18202 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.402325 18204 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.405576 18204 ts_tablet_manager.cc:1434] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:26:15.406598 18204 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
W20260709 12:26:15.411194 18187 tablet.cc:2406] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:15.414207 18204 tablet_bootstrap.cc:654] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.420840 18202 ts_tablet_manager.cc:1434] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:15.421121 18204 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.421721 18204 ts_tablet_manager.cc:1403] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:26:15.423166 18206 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.427100 18204 raft_consensus.cc:359] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.427945 18204 raft_consensus.cc:385] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.428267 18204 raft_consensus.cc:740] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.429651 18202 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.429270 18204 consensus_queue.cc:260] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.430776 18206 tablet_bootstrap.cc:654] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.433847 18204 ts_tablet_manager.cc:1434] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:15.434959 18204 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.437369 18202 tablet_bootstrap.cc:654] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.441596 18204 tablet_bootstrap.cc:654] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.443989 18206 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.444615 18206 ts_tablet_manager.cc:1403] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:26:15.449343 18206 raft_consensus.cc:359] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.450050 18206 raft_consensus.cc:385] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.450342 18206 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.451030 18206 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.451982 18202 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.452226 18204 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.452688 18202 ts_tablet_manager.cc:1403] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:26:15.452747 18204 ts_tablet_manager.cc:1403] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 12:26:15.453212 18206 ts_tablet_manager.cc:1434] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:26:15.454291 18206 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.456054 18204 raft_consensus.cc:359] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.456279 18202 raft_consensus.cc:359] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.456911 18204 raft_consensus.cc:385] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.457206 18202 raft_consensus.cc:385] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.457309 18204 raft_consensus.cc:740] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.457762 18202 raft_consensus.cc:740] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.458446 18204 consensus_queue.cc:260] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.458783 18202 consensus_queue.cc:260] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.461539 18206 tablet_bootstrap.cc:654] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.463778 18202 ts_tablet_manager.cc:1434] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:15.465226 18202 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.468678 18206 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.469201 18206 ts_tablet_manager.cc:1403] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 12:26:15.471447 18206 raft_consensus.cc:359] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.463778 18204 ts_tablet_manager.cc:1434] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:26:15.471961 18202 tablet_bootstrap.cc:654] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.472025 18206 raft_consensus.cc:385] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.472616 18206 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.473583 18206 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.476114 18204 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.476223 18206 ts_tablet_manager.cc:1434] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:15.477670 18206 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.484084 18204 tablet_bootstrap.cc:654] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.484084 18206 tablet_bootstrap.cc:654] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:15.488801 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:15.490383 18202 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.491025 18202 ts_tablet_manager.cc:1403] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 12:26:15.493853 18202 raft_consensus.cc:359] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.494475 18202 raft_consensus.cc:385] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.494731 18202 raft_consensus.cc:740] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.495489 18202 consensus_queue.cc:260] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.497748 18206 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.497943 18202 ts_tablet_manager.cc:1434] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:15.498302 18204 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.498368 18206 ts_tablet_manager.cc:1403] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 12:26:15.499089 18204 ts_tablet_manager.cc:1403] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.015s
I20260709 12:26:15.499135 18202 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.501927 18206 raft_consensus.cc:359] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.502732 18206 raft_consensus.cc:385] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.502336 18204 raft_consensus.cc:359] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.503119 18206 raft_consensus.cc:740] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.503234 18204 raft_consensus.cc:385] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.503856 18204 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.504276 18206 consensus_queue.cc:260] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.504812 18204 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.507510 18202 tablet_bootstrap.cc:654] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.508939 18206 ts_tablet_manager.cc:1434] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:26:15.510684 18206 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.512276 18204 ts_tablet_manager.cc:1434] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:15.513439 18204 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.517369 18206 tablet_bootstrap.cc:654] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.526532 18204 tablet_bootstrap.cc:654] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.529313 18206 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.529759 18202 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.529911 18206 ts_tablet_manager.cc:1403] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 12:26:15.530732 18208 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.531440 18208 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.534004 18206 raft_consensus.cc:359] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.534758 18206 raft_consensus.cc:385] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.534932 18208 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.535082 18206 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.536067 18202 ts_tablet_manager.cc:1403] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.019s
I20260709 12:26:15.536217 18206 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.539729 18204 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.539510 18202 raft_consensus.cc:359] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.540347 18204 ts_tablet_manager.cc:1403] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 12:26:15.540382 18202 raft_consensus.cc:385] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.540940 18202 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.541787 18202 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.543440 18206 ts_tablet_manager.cc:1434] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:26:15.544095 18204 raft_consensus.cc:359] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.544734 18206 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.544922 18204 raft_consensus.cc:385] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.545387 18204 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.546252 18204 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.547180 18202 ts_tablet_manager.cc:1434] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.007s
I20260709 12:26:15.548273 18202 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.551638 18204 ts_tablet_manager.cc:1434] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:15.551836 18206 tablet_bootstrap.cc:654] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.552951 18204 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.555034 18202 tablet_bootstrap.cc:654] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.561282 18204 tablet_bootstrap.cc:654] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.572140 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
W20260709 12:26:15.574086 17976 leader_election.cc:343] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.576251 18204 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.577157 18204 ts_tablet_manager.cc:1403] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.014s
I20260709 12:26:15.581113 18204 raft_consensus.cc:359] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.582080 18204 raft_consensus.cc:385] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.582425 18204 raft_consensus.cc:740] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.582296 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.583212 18161 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.584227 18204 consensus_queue.cc:260] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.584443 18202 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.584841 18206 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.585502 18202 ts_tablet_manager.cc:1403] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.014s
I20260709 12:26:15.585517 18206 ts_tablet_manager.cc:1403] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.041s	user 0.002s	sys 0.011s
I20260709 12:26:15.586863 18204 ts_tablet_manager.cc:1434] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:15.588205 18204 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.589216 18202 raft_consensus.cc:359] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.589497 18206 raft_consensus.cc:359] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.590123 18202 raft_consensus.cc:385] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.590344 18206 raft_consensus.cc:385] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.590518 18202 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.590802 18206 raft_consensus.cc:740] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.591610 18202 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.591882 18206 consensus_queue.cc:260] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.594419 18202 ts_tablet_manager.cc:1434] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:15.595783 18202 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.598171 18206 ts_tablet_manager.cc:1434] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:15.599526 18206 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.599684 18204 tablet_bootstrap.cc:654] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.607002 18206 tablet_bootstrap.cc:654] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.608716 18202 tablet_bootstrap.cc:654] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.616142 18204 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.616763 18204 ts_tablet_manager.cc:1403] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.005s
I20260709 12:26:15.584523 17976 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2
I20260709 12:26:15.619597 18208 raft_consensus.cc:2804] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.619973 18208 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.620317 18208 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.620786 18204 raft_consensus.cc:359] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.621171 18206 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.621620 18204 raft_consensus.cc:385] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.622061 18204 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.622184 18206 ts_tablet_manager.cc:1403] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:26:15.622970 18204 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.626998 18206 raft_consensus.cc:359] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.629292 18206 raft_consensus.cc:385] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.629623 18206 raft_consensus.cc:740] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.630653 18202 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.630497 18206 consensus_queue.cc:260] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
W20260709 12:26:15.630167 17976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.131:46153, user_credentials={real_user=slave}} blocked reactor thread for 45736.1us
I20260709 12:26:15.631676 18202 ts_tablet_manager.cc:1403] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.036s	user 0.002s	sys 0.027s
I20260709 12:26:15.632978 18204 ts_tablet_manager.cc:1434] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:26:15.631706 18208 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.633934 18232 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.634981 18202 raft_consensus.cc:359] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.634958 18204 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.635932 18202 raft_consensus.cc:385] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.636301 18202 raft_consensus.cc:740] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.637135 18202 consensus_queue.cc:260] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.639379 18206 ts_tablet_manager.cc:1434] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:26:15.639523 18202 ts_tablet_manager.cc:1434] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:15.640543 18206 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.640540 18202 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.635463 18232 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.646245 18232 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.646850 18232 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.647357 18232 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.655988 18232 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.656252 18206 tablet_bootstrap.cc:654] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.658586 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.658944 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.659965 18161 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.648934 18202 tablet_bootstrap.cc:654] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.653313 18204 tablet_bootstrap.cc:654] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.661505 18212 raft_consensus.cc:493] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.661587 18232 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.662010 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.662132 18212 raft_consensus.cc:515] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.662307 18232 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.662786 18161 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.664791 18232 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.665704 18208 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.666126 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.667012 18087 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.672088 18212 leader_election.cc:290] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.674572 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.675681 18087 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.676725 18207 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.677413 18207 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.682776 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.683727 18086 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.685604 18207 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:15.687373 18202 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.688084 18202 ts_tablet_manager.cc:1403] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 12:26:15.691424 18202 raft_consensus.cc:359] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.692195 18202 raft_consensus.cc:385] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.692615 18202 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.694267 18087 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.695371 18202 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.698771 18202 ts_tablet_manager.cc:1434] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 12:26:15.700768 18202 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.706889 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.708061 18161 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.716055 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.717125 18161 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.707142 18204 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.718815 18204 ts_tablet_manager.cc:1403] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.008s
I20260709 12:26:15.722307 18204 raft_consensus.cc:359] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.727366 18204 raft_consensus.cc:385] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.727703 18204 raft_consensus.cc:740] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.728457 18204 consensus_queue.cc:260] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.724225 17976 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.732235 17976 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.733172 17976 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.733217 18232 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.733673 18208 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.733898 18232 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:15.734118 17976 leader_election.cc:343] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.734190 18208 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.734457 18232 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.734861 18208 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.735299 18233 raft_consensus.cc:2804] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.735771 18233 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.736107 18233 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.739288 18202 tablet_bootstrap.cc:654] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.743499 18204 ts_tablet_manager.cc:1434] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 12:26:15.745190 18204 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:15.747408 18233 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.749087 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:15.749583 18207 raft_consensus.cc:493] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.749833 18011 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 0.
I20260709 12:26:15.750347 18207 raft_consensus.cc:515] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.750921 18232 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.753553 18207 leader_election.cc:290] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:15.754436 18049 leader_election.cc:304] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:15.756204 18212 raft_consensus.cc:2804] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.756572 18212 raft_consensus.cc:493] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.757006 18212 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.757023 18161 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.736366 17976 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:15.767706 18204 tablet_bootstrap.cc:654] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.771003 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.771132 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.773850 18086 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 0.
I20260709 12:26:15.774520 18087 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 0.
I20260709 12:26:15.779495 18126 leader_election.cc:304] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.762812 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.757483 18208 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.780437 18207 raft_consensus.cc:2804] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.781723 18126 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.785741 18207 raft_consensus.cc:493] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.777418 18212 raft_consensus.cc:515] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.786791 18207 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.788908 18212 leader_election.cc:290] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.789567 18212 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.790045 18212 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.790472 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.792541 18212 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc670002c01040788f11bcea4901fdee (127.6.182.131:46153), 81be18a977274863852d38aa474220b3 (127.6.182.129:36249)
W20260709 12:26:15.799784 18051 leader_election.cc:343] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc670002c01040788f11bcea4901fdee (127.6.182.131:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.801743 18208 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
W20260709 12:26:15.802009 17976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:44219, user_credentials={real_user=slave}} blocked reactor thread for 65713.5us
I20260709 12:26:15.802414 18245 raft_consensus.cc:2804] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.803017 18245 raft_consensus.cc:697] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
I20260709 12:26:15.803982 18245 consensus_queue.cc:237] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.805639 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.806669 18085 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.809288 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.810118 18086 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.811789 18204 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: No bootstrap required, opened a new log
I20260709 12:26:15.812507 18204 ts_tablet_manager.cc:1403] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.014s
I20260709 12:26:15.812356 18087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.815531 18204 raft_consensus.cc:359] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.816210 18204 raft_consensus.cc:385] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.816484 18204 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.785485 18233 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.823239 18204 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.825052 18206 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:15.828701 18206 ts_tablet_manager.cc:1403] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.188s	user 0.048s	sys 0.028s
I20260709 12:26:15.793139 18232 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.826547 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.827203 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.825353 18247 raft_consensus.cc:2804] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.826406 18248 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:15.827446 17976 leader_election.cc:343] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.836961 18160 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.836776 18161 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.836426 18247 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:15.840345 18051 leader_election.cc:343] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc670002c01040788f11bcea4901fdee (127.6.182.131:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.842531 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:15.842864 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.843159 18009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:15.849857 18086 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.843693 18008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:15.842392 18247 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.841018 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.853492 18159 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.854274 18202 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.854826 18202 ts_tablet_manager.cc:1403] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.016s
I20260709 12:26:15.846544 18010 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 0.
I20260709 12:26:15.858629 18206 raft_consensus.cc:359] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.859376 18206 raft_consensus.cc:385] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.843843 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:15.859712 18206 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.860181 18011 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.857983 18008 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 0.
I20260709 12:26:15.860699 18206 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.861246 18207 raft_consensus.cc:515] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.863070 18202 raft_consensus.cc:359] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.863828 18202 raft_consensus.cc:385] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:15.864006 18207 leader_election.cc:290] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:15.864166 18202 raft_consensus.cc:740] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:15.864729 18207 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.865170 17976 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:15.865866 18049 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:15.866187 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:15.867857 18243 raft_consensus.cc:2804] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.868259 18010 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.868337 18243 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.868906 18243 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.870093 18160 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
W20260709 12:26:15.873862 18126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:44219, user_credentials={real_user=slave}} blocked reactor thread for 93381.8us
I20260709 12:26:15.875437 18206 ts_tablet_manager.cc:1434] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:26:15.838764 18248 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.876219 18208 raft_consensus.cc:2804] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.866859 18159 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.877550 18202 consensus_queue.cc:260] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.875573 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.878178 18208 raft_consensus.cc:697] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
I20260709 12:26:15.882604 18202 ts_tablet_manager.cc:1434] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:26:15.881235 18011 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 1.
I20260709 12:26:15.879578 17976 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2
I20260709 12:26:15.878522 18206 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:15.881534 18010 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:15.885257 18085 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.884898 18208 consensus_queue.cc:237] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.890221 18243 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.885792 18086 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.894694 18202 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: Bootstrap starting.
I20260709 12:26:15.893666 17906 catalog_manager.cc:5697] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.896266 18049 leader_election.cc:304] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: bc670002c01040788f11bcea4901fdee
I20260709 12:26:15.897128 18248 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.897724 18248 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.897775 18212 raft_consensus.cc:2804] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.898355 18248 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.905656 18206 tablet_bootstrap.cc:654] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.894040 18161 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:15.909993 18232 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.914453 18232 raft_consensus.cc:697] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
I20260709 12:26:15.915542 18232 consensus_queue.cc:237] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.914321 18124 leader_election.cc:304] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:15.917972 18250 raft_consensus.cc:2804] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.918524 18250 raft_consensus.cc:697] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:15.919080 17976 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:15.877596 18207 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.911784 18243 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Requested vote from peers bc670002c01040788f11bcea4901fdee (127.6.182.131:46153), 81be18a977274863852d38aa474220b3 (127.6.182.129:36249)
I20260709 12:26:15.924948 18202 tablet_bootstrap.cc:654] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:15.919451 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.930128 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.919512 18250 consensus_queue.cc:237] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.931066 18208 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:15.931703 18208 raft_consensus.cc:697] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
I20260709 12:26:15.932819 18208 consensus_queue.cc:237] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.936345 18248 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:15.913667 18212 raft_consensus.cc:697] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:15.928665 18204 ts_tablet_manager.cc:1434] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.007s
I20260709 12:26:15.926702 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:15.933405 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:15.939787 18010 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:15.947002 18207 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:15.941459 18161 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.947348 18247 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:15.950608 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.959080 18158 raft_consensus.cc:2393] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369f41941e2f42418050205d02be8cf2 in current term 1: Already voted for candidate bc670002c01040788f11bcea4901fdee in this term.
W20260709 12:26:15.965387 18126 leader_election.cc:343] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:15.967648 17976 leader_election.cc:343] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.968077 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:15.973461 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:15.974390 18011 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 0.
I20260709 12:26:15.975793 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:15.976564 18161 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 0.
I20260709 12:26:15.956287 18212 consensus_queue.cc:237] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.977113 18247 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:15.978303 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:15.979036 18085 raft_consensus.cc:2393] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc670002c01040788f11bcea4901fdee in current term 1: Already voted for candidate 369f41941e2f42418050205d02be8cf2 in this term.
I20260709 12:26:15.986092 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:15.968514 17976 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2
I20260709 12:26:15.990792 18124 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2
W20260709 12:26:15.991616 17976 leader_election.cc:343] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:15.994726 18086 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:15.997807 18202 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: No bootstrap required, opened a new log
I20260709 12:26:15.998723 18202 ts_tablet_manager.cc:1403] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.017s
I20260709 12:26:15.998960 18247 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.999619 18247 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.000042 18247 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.003290 18202 raft_consensus.cc:359] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:15.998482 18232 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:15.997452 17976 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2
I20260709 12:26:16.009359 18232 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.011698 18010 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 1.
I20260709 12:26:16.004415 18202 raft_consensus.cc:385] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:16.012418 18202 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.013008 18049 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: bc670002c01040788f11bcea4901fdee
I20260709 12:26:16.013955 18212 raft_consensus.cc:2804] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:16.014511 18212 raft_consensus.cc:697] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:16.013269 18202 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.015524 18212 consensus_queue.cc:237] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:16.010061 18252 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:16.017907 18252 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.017953 18202 ts_tablet_manager.cc:1434] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:26:16.018273 18252 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.009920 18232 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.017976 17904 catalog_manager.cc:5697] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.019944 18247 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.027419 18206 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:16.028275 18206 ts_tablet_manager.cc:1403] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.011s
I20260709 12:26:16.031670 18247 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:16.033123 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:16.034936 18206 raft_consensus.cc:359] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
W20260709 12:26:16.034543 18126 leader_election.cc:343] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:16.035835 18206 raft_consensus.cc:385] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:16.036206 18206 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.036684 18253 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.037225 18253 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.037810 18252 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.039839 18253 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.040179 18252 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.041175 18206 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.042668 18124 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3
I20260709 12:26:16.043715 18206 ts_tablet_manager.cc:1434] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:16.044943 18206 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: Bootstrap starting.
I20260709 12:26:16.045073 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:16.045114 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:16.045800 18161 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.046116 18086 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.053332 18247 raft_consensus.cc:2749] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.054157 18010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:16.055995 18161 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:16.056427 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:16.062930 18232 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.063293 17907 catalog_manager.cc:5697] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 0 to 1, leader changed from <none> to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 1 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.064919 17976 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:16.063038 18206 tablet_bootstrap.cc:654] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:16.067682 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:16.068682 18252 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:16.069317 18252 raft_consensus.cc:697] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
W20260709 12:26:16.069401 17976 leader_election.cc:343] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:16.070295 18252 consensus_queue.cc:237] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.072011 18011 raft_consensus.cc:2393] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc670002c01040788f11bcea4901fdee in current term 1: Already voted for candidate 81be18a977274863852d38aa474220b3 in this term.
I20260709 12:26:16.072373 18232 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.073027 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:16.074522 18161 raft_consensus.cc:2393] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81be18a977274863852d38aa474220b3 in current term 1: Already voted for candidate bc670002c01040788f11bcea4901fdee in this term.
I20260709 12:26:16.075625 17976 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81be18a977274863852d38aa474220b3; no voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee
I20260709 12:26:16.076433 18232 raft_consensus.cc:2749] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.077167 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:16.078320 18158 raft_consensus.cc:2393] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369f41941e2f42418050205d02be8cf2 in current term 1: Already voted for candidate 81be18a977274863852d38aa474220b3 in this term.
I20260709 12:26:16.079582 18212 raft_consensus.cc:493] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.080261 18212 raft_consensus.cc:515] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.082227 18124 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3
I20260709 12:26:16.083253 18051 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:16.085618 18253 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.086252 18247 raft_consensus.cc:2749] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.102689 18212 leader_election.cc:290] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.103657 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1860d58244841f98d448b19642baa77" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:16.104416 18206 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: No bootstrap required, opened a new log
I20260709 12:26:16.104491 18011 raft_consensus.cc:2468] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 0.
I20260709 12:26:16.105113 18206 ts_tablet_manager.cc:1403] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.001s
I20260709 12:26:16.106360 18049 leader_election.cc:304] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:16.106632 18253 raft_consensus.cc:2749] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.107349 18212 raft_consensus.cc:2804] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:16.107739 18212 raft_consensus.cc:493] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.108090 18212 raft_consensus.cc:3060] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.108250 18206 raft_consensus.cc:359] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.108667 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1860d58244841f98d448b19642baa77" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:16.109110 18206 raft_consensus.cc:385] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:16.109422 18158 raft_consensus.cc:2468] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 0.
I20260709 12:26:16.109472 18206 raft_consensus.cc:740] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.110476 18206 consensus_queue.cc:260] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.111371 18086 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:16.112818 18206 ts_tablet_manager.cc:1434] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:16.114741 17906 catalog_manager.cc:5697] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.116770 17906 catalog_manager.cc:5697] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.118472 17906 catalog_manager.cc:5697] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.118353 18212 raft_consensus.cc:515] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.121889 18212 leader_election.cc:290] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.122037 17907 catalog_manager.cc:5697] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.123860 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1860d58244841f98d448b19642baa77" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:16.124570 18011 raft_consensus.cc:3060] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.127527 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1860d58244841f98d448b19642baa77" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:16.128298 18158 raft_consensus.cc:3060] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.132805 18011 raft_consensus.cc:2468] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 1.
I20260709 12:26:16.134187 18049 leader_election.cc:304] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:16.135099 18212 raft_consensus.cc:2804] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:16.135636 18212 raft_consensus.cc:697] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:16.136130 18158 raft_consensus.cc:2468] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 1.
I20260709 12:26:16.136545 18212 consensus_queue.cc:237] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.144173 17906 catalog_manager.cc:5697] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.145305 17907 catalog_manager.cc:5697] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.246843 18252 consensus_queue.cc:1048] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.262208 18252 consensus_queue.cc:1048] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.277777 18247 raft_consensus.cc:493] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.278301 18247 raft_consensus.cc:515] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.280025 18247 leader_election.cc:290] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:16.281164 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:16.281201 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:16.282176 18011 raft_consensus.cc:2393] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc670002c01040788f11bcea4901fdee in current term 1: Already voted for candidate 369f41941e2f42418050205d02be8cf2 in this term.
I20260709 12:26:16.283097 18124 leader_election.cc:304] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3
I20260709 12:26:16.283766 18247 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.289517 18247 raft_consensus.cc:2749] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.301075 18212 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.301743 18212 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:16.303876 18212 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:16.304723 18011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81be18a977274863852d38aa474220b3" is_pre_election: true
I20260709 12:26:16.305025 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:16.305678 18011 raft_consensus.cc:2393] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369f41941e2f42418050205d02be8cf2 in current term 1: Already voted for candidate 81be18a977274863852d38aa474220b3 in this term.
I20260709 12:26:16.305861 18158 raft_consensus.cc:2393] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369f41941e2f42418050205d02be8cf2 in current term 1: Already voted for candidate bc670002c01040788f11bcea4901fdee in this term.
I20260709 12:26:16.307160 18051 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:16.307934 18212 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:16.314134 18212 raft_consensus.cc:2749] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:16.319409 18252 consensus_queue.cc:1048] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.331382 18232 consensus_queue.cc:1048] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.346531 18252 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.357663 18252 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.380267 18212 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.392078 18212 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:16.434959 18247 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.446339 18255 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:16.458267 18252 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:16.473649 18252 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.491437 18212 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:16.494952 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:16.503185 18243 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:16.528709 18253 consensus_queue.cc:1048] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.540958 18287 consensus_queue.cc:1048] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:16.623548 18252 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:16.635439 18232 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:17.500806 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:18.285223 18292 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.285816 18292 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:18.287779 18292 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:18.288563 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:18.288808 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:18.289366 18086 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:18.289518 18158 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 1.
I20260709 12:26:18.290673 17976 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:18.291416 18292 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.291791 18292 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.292129 18292 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.297385 18292 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:18.299230 18292 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 2 election: Requested vote from peers 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:18.299971 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:18.300450 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "81be18a977274863852d38aa474220b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:18.300697 18086 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.301113 18158 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.308264 18158 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 2.
I20260709 12:26:18.308264 18086 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81be18a977274863852d38aa474220b3 in term 2.
I20260709 12:26:18.309713 17976 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:18.310527 18292 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.311046 18292 raft_consensus.cc:697] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 LEADER]: Becoming Leader. State: Replica: 81be18a977274863852d38aa474220b3, State: Running, Role: LEADER
I20260709 12:26:18.311872 18292 consensus_queue.cc:237] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:18.319661 17907 catalog_manager.cc:5697] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 81be18a977274863852d38aa474220b3 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "81be18a977274863852d38aa474220b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.452450  6874 ts_manager.cc:295] Set tserver state for 81be18a977274863852d38aa474220b3 to MAINTENANCE_MODE
I20260709 12:26:18.453717  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:26:18.489933 18049 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
W20260709 12:26:18.494863 18049 consensus_peers.cc:597] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.498445  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:18.499594  6874 tablet_replica.cc:333] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.501101  6874 raft_consensus.cc:2243] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.502398  6874 raft_consensus.cc:2272] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:18.502533 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:18.506264  6874 tablet_replica.cc:333] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.507310  6874 raft_consensus.cc:2243] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.508085  6874 raft_consensus.cc:2272] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.511174  6874 tablet_replica.cc:333] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.512144  6874 raft_consensus.cc:2243] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.512838  6874 raft_consensus.cc:2272] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.515465  6874 tablet_replica.cc:333] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.516327  6874 raft_consensus.cc:2243] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.517978  6874 raft_consensus.cc:2272] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.522128  6874 tablet_replica.cc:333] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.523033  6874 raft_consensus.cc:2243] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.524887  6874 pending_rounds.cc:70] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Trying to abort 1 pending ops.
I20260709 12:26:18.525228  6874 pending_rounds.cc:77] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7305625511172681728 op_type: NO_OP noop_request { }
I20260709 12:26:18.525898  6874 raft_consensus.cc:2889] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:18.526393  6874 raft_consensus.cc:2272] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.530306  6874 tablet_replica.cc:333] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.531124  6874 raft_consensus.cc:2243] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.532641  6874 raft_consensus.cc:2272] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.535987  6874 tablet_replica.cc:333] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.536904  6874 raft_consensus.cc:2243] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.537859  6874 raft_consensus.cc:2272] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.542028  6874 tablet_replica.cc:333] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.542662  6874 raft_consensus.cc:2243] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.544102  6874 raft_consensus.cc:2272] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.547155  6874 tablet_replica.cc:333] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.547786  6874 raft_consensus.cc:2243] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.549149  6874 raft_consensus.cc:2272] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.552004  6874 tablet_replica.cc:333] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: stopping tablet replica
I20260709 12:26:18.552659  6874 raft_consensus.cc:2243] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.553833  6874 raft_consensus.cc:2272] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.593086  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
W20260709 12:26:18.630679 18049 consensus_peers.cc:597] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:18.760123 18124 consensus_peers.cc:597] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:18.776719 18049 consensus_peers.cc:597] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.503729 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:19.569216 18303 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.570091 18303 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.572508 18303 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.574270 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
W20260709 12:26:19.577039 18049 leader_election.cc:336] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.577461 18049 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:19.578212 18303 raft_consensus.cc:2749] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.669646 18306 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.670406 18306 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.672463 18306 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.673185 18305 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.674018 18305 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.674326 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:19.676714 18305 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
W20260709 12:26:19.677356 18124 leader_election.cc:336] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.677850 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:19.677902 18124 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc670002c01040788f11bcea4901fdee; no voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3
I20260709 12:26:19.678797 18086 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:19.679086 18305 raft_consensus.cc:2749] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.680253 18126 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:19.681345 18305 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:19.681782 18305 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81be18a977274863852d38aa474220b3)
W20260709 12:26:19.681883 18124 leader_election.cc:336] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.682153 18305 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.690286 18305 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.692194 18305 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.693586 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:19.694335 18086 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.696913 18124 leader_election.cc:336] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.702196 18086 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:19.703459 18126 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:19.704311 18305 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.704850 18305 raft_consensus.cc:697] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:19.705909 18305 consensus_queue.cc:237] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.714888 18303 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.714442 17907 catalog_manager.cc:5697] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.715669 18303 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.718581 18303 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.720009 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
W20260709 12:26:19.723704 18049 leader_election.cc:336] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.724273 18049 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:19.725152 18303 raft_consensus.cc:2749] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.778034 18303 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.778688 18303 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.780704 18303 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.782105 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:19.782851 18158 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 1.
I20260709 12:26:19.784070 18051 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:19.784992 18303 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:19.785240 18049 leader_election.cc:336] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.785403 18303 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.785923 18303 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.793098 18303 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.794986 18303 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.796231 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:19.796921 18158 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.798936 18049 leader_election.cc:336] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.803561 18158 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 2.
I20260709 12:26:19.804730 18051 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:19.805449 18303 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.806378 18303 raft_consensus.cc:697] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:19.807356 18303 consensus_queue.cc:237] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.816454 18305 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.817121 18305 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.819119 18305 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.820274 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:19.820937 18086 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:19.821954 18126 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:19.822625 18305 raft_consensus.cc:2804] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:19.823027 18124 leader_election.cc:336] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.822445 17907 catalog_manager.cc:5697] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 1 to 2, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.823089 18305 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.824393 18305 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.831606 18305 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.833798 18305 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.835423 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:19.836058 18086 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.838065 18124 leader_election.cc:336] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.842218 18086 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:19.843309 18126 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:19.844038 18305 raft_consensus.cc:2804] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.844518 18305 raft_consensus.cc:697] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:19.845479 18305 consensus_queue.cc:237] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.853545 17907 catalog_manager.cc:5697] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.858438 18303 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.859176 18303 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.861542 18303 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.862807 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
W20260709 12:26:19.865640 18049 leader_election.cc:336] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.866060 18049 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:19.866726 18303 raft_consensus.cc:2749] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.876859 18303 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.877446 18303 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.879412 18303 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:19.880748 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
W20260709 12:26:19.883284 18049 leader_election.cc:336] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.883718 18049 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369f41941e2f42418050205d02be8cf2; no voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee
I20260709 12:26:19.884407 18303 raft_consensus.cc:2749] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.942816 18305 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.943365 18305 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.945346 18305 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.946696 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:19.947459 18086 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:19.948597 18126 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:19.949334 18305 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:19.949522 18124 leader_election.cc:336] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.949646 18305 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:19.950235 18305 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.955641 18305 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.957405 18305 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:19.958599 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:19.959163 18086 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.961081 18124 leader_election.cc:336] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:19.964344 18086 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:19.965505 18126 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:19.966167 18305 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.966603 18305 raft_consensus.cc:697] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:19.967546 18305 consensus_queue.cc:237] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:19.979024 17907 catalog_manager.cc:5697] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.040565 18305 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:20.041208 18305 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.043072 18305 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:20.044356 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2" is_pre_election: true
I20260709 12:26:20.045104 18086 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 1.
I20260709 12:26:20.046249 18126 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:20.047118 18305 raft_consensus.cc:2804] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:20.047302 18124 leader_election.cc:336] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:20.047544 18305 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81be18a977274863852d38aa474220b3)
I20260709 12:26:20.047961 18305 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.053537 18305 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.055383 18305 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:20.056668 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:20.057337 18086 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:20.059216 18124 leader_election.cc:336] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:20.063329 18086 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:20.064420 18126 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:20.065208 18305 raft_consensus.cc:2804] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:20.065618 18305 raft_consensus.cc:697] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:20.066594 18305 consensus_queue.cc:237] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.073900 17907 catalog_manager.cc:5697] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:20.200736 18049 consensus_peers.cc:597] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.231745 18124 consensus_peers.cc:597] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.285231 18158 raft_consensus.cc:1275] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.286803 18303 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.331794 18086 raft_consensus.cc:1275] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.333153 18305 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:20.433545 18124 consensus_peers.cc:597] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.434823 18086 raft_consensus.cc:1275] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.436133 18305 consensus_queue.cc:1048] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:20.475088 18124 consensus_peers.cc:597] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.504841 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:20.510761 18124 consensus_peers.cc:597] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.538630 18086 raft_consensus.cc:1275] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.540470 18305 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.560540 18303 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.561065 18303 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.562784 18303 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:20.563987 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee" is_pre_election: true
I20260709 12:26:20.564751 18161 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 2.
I20260709 12:26:20.565691 18051 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
W20260709 12:26:20.566326 18049 leader_election.cc:336] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:20.566368 18303 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.566799 18303 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.567077 18303 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.572984 18303 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.574826 18303 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:20.575935 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:20.576578 18161 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:20.578744 18049 leader_election.cc:336] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111)
I20260709 12:26:20.583729 18161 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:20.585004 18051 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 81be18a977274863852d38aa474220b3
I20260709 12:26:20.585783 18303 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:20.586285 18303 raft_consensus.cc:697] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:20.587257 18303 consensus_queue.cc:237] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:20.593940 17907 catalog_manager.cc:5697] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from 81be18a977274863852d38aa474220b3 (127.6.182.129) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.658115 18086 raft_consensus.cc:1275] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.659824 18305 consensus_queue.cc:1048] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:20.762244 18049 consensus_peers.cc:597] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.003801 18049 consensus_peers.cc:597] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:21.059321 18049 consensus_peers.cc:597] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.200408 18124 consensus_peers.cc:597] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.206524 18161 raft_consensus.cc:1275] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
W20260709 12:26:21.206876 18049 consensus_peers.cc:597] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:21.208020 18314 consensus_queue.cc:1048] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:21.506022 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:22.395502 18049 consensus_peers.cc:597] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.507064 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:22.875984 18124 consensus_peers.cc:597] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.973954 18124 consensus_peers.cc:597] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.061007 18124 consensus_peers.cc:597] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.080133 18124 consensus_peers.cc:597] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.188421 18049 consensus_peers.cc:597] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.460951 18049 consensus_peers.cc:597] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.482492 18124 consensus_peers.cc:597] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.508162 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:23.509649 18124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 12:26:23.548321 18049 consensus_peers.cc:597] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.637295  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:23.645776 18336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:23.647055 18337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:23.648239 18339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:23.652097  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:23.654045  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:23.654269  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:23.654443  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599983654429 us; error 0 us; skew 500 ppm
I20260709 12:26:23.655011  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:23.658313  6874 webserver.cc:533] Webserver started at http://127.6.182.129:37581/ using document root <none> and password file <none>
I20260709 12:26:23.659062  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:23.659337  6874 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:23.665077  6874 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
W20260709 12:26:23.667232 18049 consensus_peers.cc:597] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:23.669478 18344 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:23.670499  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:23.670884  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "81be18a977274863852d38aa474220b3"
format_stamp: "Formatted at 2026-07-09 12:26:14 on dist-test-slave-lgtn"
I20260709 12:26:23.671280  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:23.703120  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:23.704990  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:23.706681  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:23.710830 18351 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:26:23.764145  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:26:23.764608  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.001s	sys 0.002s
I20260709 12:26:23.765064  6874 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:26:23.770485 18351 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.786418 18351 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.787541 18351 tablet_bootstrap.cc:492] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.788340 18351 ts_tablet_manager.cc:1403] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.013s
I20260709 12:26:23.792104 18351 raft_consensus.cc:359] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.792770 18351 raft_consensus.cc:740] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.793560 18351 consensus_queue.cc:260] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.796083 18351 ts_tablet_manager.cc:1434] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:23.796947 18351 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.812077 18351 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:23.813324 18351 tablet_bootstrap.cc:492] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.814070  6874 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:26:23.814096 18351 ts_tablet_manager.cc:1403] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:26:23.814673  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.050s	user 0.044s	sys 0.003s
I20260709 12:26:23.818130 18351 raft_consensus.cc:359] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.819348 18351 raft_consensus.cc:740] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.820299 18351 consensus_queue.cc:260] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.822942 18351 ts_tablet_manager.cc:1434] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:26:23.824026 18351 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.845888 18351 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.846769 18351 tablet_bootstrap.cc:492] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.847404 18351 ts_tablet_manager.cc:1403] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:26:23.850239 18351 raft_consensus.cc:359] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.852133 18351 raft_consensus.cc:740] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.852926 18351 consensus_queue.cc:260] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.854485 18351 ts_tablet_manager.cc:1434] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:23.855268 18351 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.868252 18351 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.869256 18351 tablet_bootstrap.cc:492] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.870030 18351 ts_tablet_manager.cc:1403] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:26:23.872792 18351 raft_consensus.cc:359] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.873430 18351 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.874265 18351 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.876288 18351 ts_tablet_manager.cc:1434] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:23.877153 18351 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.880981  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:36249
I20260709 12:26:23.881176 18412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:36249 every 8 connection(s)
I20260709 12:26:23.886160  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.914438 18351 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.915568 18351 tablet_bootstrap.cc:492] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.916293 18351 ts_tablet_manager.cc:1403] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.013s
I20260709 12:26:23.920234 18351 raft_consensus.cc:359] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.922180 18351 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.925776 18351 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.926218 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:23.927071 18161 raft_consensus.cc:606] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:23.928768 18413 heartbeater.cc:344] Connected to a master server at 127.6.182.190:41201
I20260709 12:26:23.929199 18413 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:23.930495 18413 heartbeater.cc:507] Master 127.6.182.190:41201 requested a full tablet report, sending...
I20260709 12:26:23.930755 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:23.931352 18351 ts_tablet_manager.cc:1434] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:23.931444 18161 raft_consensus.cc:606] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:23.932463 18351 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.932325 18387 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.938354 18386 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.946102 18387 pending_rounds.cc:85] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Aborting all ops after (but not including) 0
I20260709 12:26:23.947153 18387 pending_rounds.cc:107] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 12:26:23.947651 18387 raft_consensus.cc:2889] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:23.964119 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:23.965030 18086 raft_consensus.cc:606] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:23.966848  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:23.967605  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.968413  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.971349 18351 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.972491 18351 tablet_bootstrap.cc:492] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.973428 18351 ts_tablet_manager.cc:1403] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.015s
I20260709 12:26:23.975284 17904 ts_manager.cc:194] Re-registered known tserver with Master: 81be18a977274863852d38aa474220b3 (127.6.182.129:36249)
I20260709 12:26:23.976061 18351 raft_consensus.cc:359] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.976735 18351 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.977649 18351 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.979486 18351 ts_tablet_manager.cc:1434] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:23.980348 18351 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:23.986876 17904 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46620
I20260709 12:26:23.991079 18413 heartbeater.cc:499] Master 127.6.182.190:41201 was elected leader, sending a full tablet report...
I20260709 12:26:23.994834 18351 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.995991 18351 tablet_bootstrap.cc:492] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:23.996716 18351 ts_tablet_manager.cc:1403] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:26:23.998845 18351 raft_consensus.cc:359] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:23.999445 18351 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.000094 18351 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.001663 18351 ts_tablet_manager.cc:1434] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:24.002419 18351 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:24.016120 18351 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.016885 18351 tablet_bootstrap.cc:492] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:24.017447 18351 ts_tablet_manager.cc:1403] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:26:24.019299 18351 raft_consensus.cc:359] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:24.019805 18351 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.020437 18351 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:24.022145 18351 ts_tablet_manager.cc:1434] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:24.022720 18387 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.023111 18351 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:24.039801 18351 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.040709 18351 tablet_bootstrap.cc:492] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:24.041291 18351 ts_tablet_manager.cc:1403] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:26:24.043411 18351 raft_consensus.cc:359] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.043924 18351 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.044474 18351 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.046119 18351 ts_tablet_manager.cc:1434] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:24.046905 18351 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Bootstrap starting.
I20260709 12:26:24.059100 18351 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.059845 18351 tablet_bootstrap.cc:492] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Bootstrap complete.
I20260709 12:26:24.060395 18351 ts_tablet_manager.cc:1403] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:26:24.062291 18351 raft_consensus.cc:359] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.062805 18351 raft_consensus.cc:740] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81be18a977274863852d38aa474220b3, State: Initialized, Role: FOLLOWER
I20260709 12:26:24.063369 18351 consensus_queue.cc:260] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.064976 18351 ts_tablet_manager.cc:1434] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:26:24.089319 18306 raft_consensus.cc:993] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:24.089915 18433 raft_consensus.cc:1081] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:24.091539 18086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:24.091971 18086 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.092233 18086 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.097270 18086 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.098831 18086 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:24.099978 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:24.099973 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:24.100798 18161 raft_consensus.cc:3055] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:24.100862 18387 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.101166 18161 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:24.102083 18161 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.103185 18161 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.106356 18387 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:24.107551 18049 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:24.108436 18332 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.109943 18332 raft_consensus.cc:697] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:24.110962 18332 consensus_queue.cc:237] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.110954 18161 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:24.118896 17904 catalog_manager.cc:5697] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.249251 18332 raft_consensus.cc:993] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:24.249950 18434 raft_consensus.cc:1081] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:24.251724 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:24.252377 18161 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.252774 18161 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.259156 18161 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:24.261103 18161 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:24.262037 18387 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.262176 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:24.262331 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:24.262899 18386 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.263090 18086 raft_consensus.cc:3055] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.263619 18086 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:24.264400 18086 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:24.265650 18086 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.270406 18386 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:24.271420 18086 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:24.271989 18124 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:24.273983 18433 raft_consensus.cc:2804] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.274593 18433 raft_consensus.cc:697] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:24.275756 18433 consensus_queue.cc:237] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:24.287897 17907 catalog_manager.cc:5697] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.310840 18441 raft_consensus.cc:993] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:24.311363 18441 raft_consensus.cc:1081] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:24.313074 18086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:24.313642 18086 raft_consensus.cc:493] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.314010 18086 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.320135 18086 raft_consensus.cc:515] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.321956 18086 leader_election.cc:290] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:24.322799 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:24.323513 18387 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.323405 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac88b0c03f9498fbdefd53694e2ce20" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:24.324179 18161 raft_consensus.cc:3055] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:24.324542 18161 raft_consensus.cc:740] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:24.325443 18161 consensus_queue.cc:260] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.326741 18161 raft_consensus.cc:3060] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.331214 18387 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:24.332536 18049 leader_election.cc:304] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:24.333458 18434 raft_consensus.cc:2804] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.334026 18434 raft_consensus.cc:697] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:24.334241 18161 raft_consensus.cc:2468] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:24.335057 18434 consensus_queue.cc:237] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:24.342722 17907 catalog_manager.cc:5697] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.420104 18387 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:24.509423 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:24.527549 18161 raft_consensus.cc:1275] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.529211 18434 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.540050 18387 raft_consensus.cc:1275] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.541949 18443 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:24.713233 18086 raft_consensus.cc:1275] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.714521 18441 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.722474 18387 raft_consensus.cc:1275] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.724470 18441 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:24.808825 18161 raft_consensus.cc:1275] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.810478 18434 consensus_queue.cc:1048] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.820513 18387 raft_consensus.cc:1275] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.823742 18434 consensus_queue.cc:1048] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.978485  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.986055 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:24.986666 18086 raft_consensus.cc:606] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:24.989497 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:24.990053 18161 raft_consensus.cc:606] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:24.992529 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:24.993028 18086 raft_consensus.cc:606] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:24.994129  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:24.994709  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.995446  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.199434 18443 raft_consensus.cc:993] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:25.199980 18434 raft_consensus.cc:1081] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:25.201522 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:25.202088 18161 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.202477 18161 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.208465 18161 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.210530 18161 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:25.211321 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:25.211618 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:25.212088 18387 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.212191 18086 raft_consensus.cc:3055] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.212595 18086 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:25.213420 18086 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.214799 18086 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.219934 18387 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 3.
I20260709 12:26:25.221376 18124 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:25.221691 18086 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 3.
I20260709 12:26:25.222138 18433 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.222815 18433 raft_consensus.cc:697] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:25.223999 18433 consensus_queue.cc:237] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.232892 17904 catalog_manager.cc:5697] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 2 to 3, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 3 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.309523 18434 raft_consensus.cc:993] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:25.310060 18443 raft_consensus.cc:1081] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:25.311576 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:25.312176 18161 raft_consensus.cc:493] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.312484 18161 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.317245 18161 raft_consensus.cc:515] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.318748 18161 leader_election.cc:290] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:25.319725 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:25.319919 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46cb18f906f64071ad64ad79848d8d76" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:25.320406 18387 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.320423 18086 raft_consensus.cc:3055] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:25.321080 18086 raft_consensus.cc:740] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:25.321877 18086 consensus_queue.cc:260] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.323114 18086 raft_consensus.cc:3060] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.328217 18387 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:25.329584 18124 leader_election.cc:304] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:25.330372 18433 raft_consensus.cc:2804] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:25.330953 18433 raft_consensus.cc:697] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:25.330891 18086 raft_consensus.cc:2468] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:25.332073 18433 consensus_queue.cc:237] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.339497 17904 catalog_manager.cc:5697] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 3 to 4, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 4 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.420701 18441 raft_consensus.cc:993] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:25.421380 18433 raft_consensus.cc:1081] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:25.423080 18086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:25.423570 18086 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.423807 18086 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.429046 18086 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.430519 18086 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:25.431592 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:25.431569 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:25.432437 18161 raft_consensus.cc:3055] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.432492 18387 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.432835 18161 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:25.433636 18161 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.434726 18161 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.438155 18387 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:25.439316 18049 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:25.440021 18443 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.440135 18161 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:25.440500 18443 raft_consensus.cc:697] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:25.442147 18443 consensus_queue.cc:237] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:25.450621 17904 catalog_manager.cc:5697] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:25.510594 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:25.782528 18387 raft_consensus.cc:1275] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:25.784101 18433 consensus_queue.cc:1048] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.796904 18086 raft_consensus.cc:1275] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:25.798771 18463 consensus_queue.cc:1048] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.818638 18086 raft_consensus.cc:1275] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.819990 18441 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.822904 18387 raft_consensus.cc:1275] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.823105 18386 raft_consensus.cc:1275] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.824520 18443 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.825129 18463 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.843973 18161 raft_consensus.cc:1275] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.846942 18443 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:26.002892  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.010759 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:26.011350 18086 raft_consensus.cc:606] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:26.014099 18158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:26.014654 18158 raft_consensus.cc:606] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:26.017807 18158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:26.018368 18158 raft_consensus.cc:606] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:26.019536  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:26.020066  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.020671  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.027400 18463 raft_consensus.cc:993] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:26.027979 18433 raft_consensus.cc:1081] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:26.029446 18086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:26.029844 18086 raft_consensus.cc:493] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.030071 18086 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.035257 18086 raft_consensus.cc:515] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.036801 18086 leader_election.cc:290] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:26.037974 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:26.037863 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:26.038728 18158 raft_consensus.cc:3055] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.038770 18386 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.039186 18158 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:26.040107 18158 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.041525 18158 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.046681 18386 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 2.
I20260709 12:26:26.048058 18049 leader_election.cc:304] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:26.048909 18434 raft_consensus.cc:2804] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:26.049178 18158 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 2.
I20260709 12:26:26.049389 18434 raft_consensus.cc:697] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:26.050523 18434 consensus_queue.cc:237] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.058610 17906 catalog_manager.cc:5697] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 1 to 2, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.132328 18463 raft_consensus.cc:993] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:26.132889 18433 raft_consensus.cc:1081] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:26.134498 18086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:26.134991 18086 raft_consensus.cc:493] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.135250 18086 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.140870 18086 raft_consensus.cc:515] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:26.142467 18086 leader_election.cc:290] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers bc670002c01040788f11bcea4901fdee (127.6.182.131:46153), 81be18a977274863852d38aa474220b3 (127.6.182.129:36249)
I20260709 12:26:26.143399 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:26.143643 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fa3c55bfb443788761e818ae518eaf" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:26.144076 18158 raft_consensus.cc:3055] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.144428 18386 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.144548 18158 raft_consensus.cc:740] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:26.145607 18158 consensus_queue.cc:260] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:26.146692 18158 raft_consensus.cc:3060] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.150857 18386 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:26.152087 18158 raft_consensus.cc:2468] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:26.152094 18049 leader_election.cc:304] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:26.153122 18434 raft_consensus.cc:2804] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.153574 18434 raft_consensus.cc:697] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:26.154259 18434 consensus_queue.cc:237] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } }
I20260709 12:26:26.162550 17906 catalog_manager.cc:5697] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.289363 18470 raft_consensus.cc:993] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:26.289876 18434 raft_consensus.cc:1081] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:26.291584 18158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:26.292237 18158 raft_consensus.cc:493] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.292560 18158 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.297528 18158 raft_consensus.cc:515] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.299292 18158 leader_election.cc:290] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:26.299933 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:26.300405 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18393d89c21841e08b43f6c5e7633e2b" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:26.300760 18386 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.301054 18086 raft_consensus.cc:3055] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:26.301393 18086 raft_consensus.cc:740] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:26.301983 18086 consensus_queue.cc:260] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.302870 18086 raft_consensus.cc:3060] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.306241 18386 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:26.307478 18124 leader_election.cc:304] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:26.308225 18086 raft_consensus.cc:2468] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:26.308265 18433 raft_consensus.cc:2804] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.309026 18433 raft_consensus.cc:697] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:26.309791 18433 consensus_queue.cc:237] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:26.317165 17906 catalog_manager.cc:5697] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 3 to 4, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 4 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.445384 18158 raft_consensus.cc:1275] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.447276 18434 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.458226 18386 raft_consensus.cc:1275] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.460683 18470 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:26.511518 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:26.623598 18158 raft_consensus.cc:1275] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.625207 18434 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.634838 18387 raft_consensus.cc:1275] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.637295 18470 consensus_queue.cc:1048] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.791582 18387 raft_consensus.cc:1275] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:26.793051 18433 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:26.803552 18086 raft_consensus.cc:1275] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:26.805599 18487 consensus_queue.cc:1048] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:27.028445  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.037060 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:27.037720 18086 raft_consensus.cc:606] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:27.040616 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:27.041229 18161 raft_consensus.cc:606] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:27.043808 18086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:27.044412 18086 raft_consensus.cc:606] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:27.045686  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:27.046247  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:27.046957  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.343953 18443 raft_consensus.cc:993] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:27.344502 18470 raft_consensus.cc:1081] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:27.346112 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:27.346601 18161 raft_consensus.cc:493] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.346913 18161 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.353647 18161 raft_consensus.cc:515] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.353395 18489 raft_consensus.cc:993] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:27.355350 18490 raft_consensus.cc:1081] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:27.356571 18161 leader_election.cc:290] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:27.356738 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:27.357405 18387 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.357913 18086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:27.358503 18086 raft_consensus.cc:3055] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.358798 18086 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:27.359293 18085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:27.359552 18086 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.359959 18085 raft_consensus.cc:493] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.360533 18085 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.360898 18086 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.364444 18387 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:27.365676 18124 leader_election.cc:304] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:27.366510 18490 raft_consensus.cc:2804] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.367020 18490 raft_consensus.cc:697] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:27.367499 18086 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 2.
I20260709 12:26:27.366839 18085 raft_consensus.cc:515] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.368021 18490 consensus_queue.cc:237] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.370314 18085 leader_election.cc:290] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:27.370479 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:27.370729 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637f864dc5949a48a1614a1787076f8" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:27.371248 18387 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.371321 18161 raft_consensus.cc:3055] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:27.371757 18161 raft_consensus.cc:740] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:27.372571 18161 consensus_queue.cc:260] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.373826 18161 raft_consensus.cc:3060] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.379386 18387 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:27.380687 18161 raft_consensus.cc:2468] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:27.382180 18051 leader_election.cc:304] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:27.382997 18470 raft_consensus.cc:2804] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.383558 18470 raft_consensus.cc:697] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:27.384377 18470 consensus_queue.cc:237] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.385218 17904 catalog_manager.cc:5697] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 1 to 2, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 2 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:27.393606 17906 catalog_manager.cc:5697] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.510107 18443 raft_consensus.cc:993] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:27.510702 18470 raft_consensus.cc:1081] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
W20260709 12:26:27.512485 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:27.512451 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:27.513077 18161 raft_consensus.cc:493] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.513398 18161 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.518433 18161 raft_consensus.cc:515] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.520082 18161 leader_election.cc:290] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:27.521229 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:27.521250 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b072e327da74003a0ad8f1ffa287876" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:27.521826 18387 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.522215 18085 raft_consensus.cc:3055] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:27.522594 18085 raft_consensus.cc:740] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:27.523442 18085 consensus_queue.cc:260] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.524616 18085 raft_consensus.cc:3060] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.527175 18387 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 3.
I20260709 12:26:27.528331 18124 leader_election.cc:304] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:27.529050 18490 raft_consensus.cc:2804] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.529510 18490 raft_consensus.cc:697] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:27.530244 18490 consensus_queue.cc:237] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:27.531390 18085 raft_consensus.cc:2468] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 3.
I20260709 12:26:27.537710 17906 catalog_manager.cc:5697] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 2 to 3, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 3 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:27.841478 18387 raft_consensus.cc:1275] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:27.842850 18470 consensus_queue.cc:1048] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.854279 18161 raft_consensus.cc:1275] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:27.855926 18443 consensus_queue.cc:1048] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.865417 18386 raft_consensus.cc:1275] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.868366 18489 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.875361 18085 raft_consensus.cc:1275] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.876982 18489 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.015107 18085 raft_consensus.cc:1275] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:28.016691 18505 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.026129 18387 raft_consensus.cc:1275] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:28.027732 18490 consensus_queue.cc:1048] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.053373  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.060894 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:28.061496 18161 raft_consensus.cc:606] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:28.064765 18085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
mode: GRACEFUL
new_leader_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:45036
I20260709 12:26:28.065325 18085 raft_consensus.cc:606] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Received request to transfer leadership to TS bc670002c01040788f11bcea4901fdee
I20260709 12:26:28.067793 18161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
mode: GRACEFUL
new_leader_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:40382
I20260709 12:26:28.068372 18161 raft_consensus.cc:606] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Received request to transfer leadership to TS 369f41941e2f42418050205d02be8cf2
I20260709 12:26:28.069382  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:28.069859  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.070379  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.224248 18490 raft_consensus.cc:993] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:28.224798 18489 raft_consensus.cc:1081] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:28.226367 18085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:28.226946 18085 raft_consensus.cc:493] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.227296 18085 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.234680 18085 raft_consensus.cc:515] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.236516 18085 leader_election.cc:290] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 4 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:28.237535 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:28.237704 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70af63b5a22462590e264ec0b7c4315" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:28.238365 18387 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.238423 18161 raft_consensus.cc:3055] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.238904 18161 raft_consensus.cc:740] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:28.239780 18161 consensus_queue.cc:260] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.241132 18161 raft_consensus.cc:3060] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.246270 18387 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 4.
I20260709 12:26:28.247582 18049 leader_election.cc:304] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:28.248383 18443 raft_consensus.cc:2804] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.248582 18161 raft_consensus.cc:2468] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 4.
I20260709 12:26:28.248936 18443 raft_consensus.cc:697] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 4 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:28.250025 18443 consensus_queue.cc:237] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.257118 17906 catalog_manager.cc:5697] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 3 to 4, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 4 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.337539 18490 raft_consensus.cc:993] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: : Instructing follower 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:28.338032 18489 raft_consensus.cc:1081] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Signalling peer 369f41941e2f42418050205d02be8cf2 to start an election
I20260709 12:26:28.339547 18085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39"
dest_uuid: "369f41941e2f42418050205d02be8cf2"
 from {username='slave'} at 127.0.0.1:45030
I20260709 12:26:28.340065 18085 raft_consensus.cc:493] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.340381 18085 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.345796 18085 raft_consensus.cc:515] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.347515 18085 leader_election.cc:290] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), bc670002c01040788f11bcea4901fdee (127.6.182.131:46153)
I20260709 12:26:28.348351 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:28.348536 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1a6dac83041d6966c8bb936a98c39" candidate_uuid: "369f41941e2f42418050205d02be8cf2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc670002c01040788f11bcea4901fdee"
I20260709 12:26:28.349030 18387 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.349253 18161 raft_consensus.cc:3055] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:28.349635 18161 raft_consensus.cc:740] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:28.350347 18161 consensus_queue.cc:260] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.351372 18161 raft_consensus.cc:3060] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.354440 18387 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:28.355518 18049 leader_election.cc:304] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369f41941e2f42418050205d02be8cf2, 81be18a977274863852d38aa474220b3; no voters: 
I20260709 12:26:28.356266 18513 raft_consensus.cc:2804] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.356443 18161 raft_consensus.cc:2468] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369f41941e2f42418050205d02be8cf2 in term 3.
I20260709 12:26:28.356700 18513 raft_consensus.cc:697] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:28.357723 18513 consensus_queue.cc:237] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.363714 17906 catalog_manager.cc:5697] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 reported cstate change: term changed from 2 to 3, leader changed from bc670002c01040788f11bcea4901fdee (127.6.182.131) to 369f41941e2f42418050205d02be8cf2 (127.6.182.130). New cstate: current_term: 3 leader_uuid: "369f41941e2f42418050205d02be8cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.391714 18443 raft_consensus.cc:993] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: : Instructing follower bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:28.392246 18513 raft_consensus.cc:1081] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Signalling peer bc670002c01040788f11bcea4901fdee to start an election
I20260709 12:26:28.393952 18161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a"
dest_uuid: "bc670002c01040788f11bcea4901fdee"
 from {username='slave'} at 127.0.0.1:40374
I20260709 12:26:28.394438 18161 raft_consensus.cc:493] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.394695 18161 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.400359 18161 raft_consensus.cc:515] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.401993 18161 leader_election.cc:290] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Requested vote from peers 81be18a977274863852d38aa474220b3 (127.6.182.129:36249), 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219)
I20260709 12:26:28.402885 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81be18a977274863852d38aa474220b3"
I20260709 12:26:28.403415 18085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd64f8d2e04f42ad86bfc022b29e189a" candidate_uuid: "bc670002c01040788f11bcea4901fdee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "369f41941e2f42418050205d02be8cf2"
I20260709 12:26:28.403506 18386 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.404050 18085 raft_consensus.cc:3055] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.404349 18085 raft_consensus.cc:740] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 369f41941e2f42418050205d02be8cf2, State: Running, Role: LEADER
I20260709 12:26:28.405093 18085 consensus_queue.cc:260] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.406069 18085 raft_consensus.cc:3060] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.410526 18386 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:28.412001 18124 leader_election.cc:304] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81be18a977274863852d38aa474220b3, bc670002c01040788f11bcea4901fdee; no voters: 
I20260709 12:26:28.412540 18085 raft_consensus.cc:2468] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc670002c01040788f11bcea4901fdee in term 4.
I20260709 12:26:28.412850 18489 raft_consensus.cc:2804] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.413527 18489 raft_consensus.cc:697] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Becoming Leader. State: Replica: bc670002c01040788f11bcea4901fdee, State: Running, Role: LEADER
I20260709 12:26:28.414433 18489 consensus_queue.cc:237] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } }
I20260709 12:26:28.422204 17906 catalog_manager.cc:5697] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee reported cstate change: term changed from 3 to 4, leader changed from 369f41941e2f42418050205d02be8cf2 (127.6.182.130) to bc670002c01040788f11bcea4901fdee (127.6.182.131). New cstate: current_term: 4 leader_uuid: "bc670002c01040788f11bcea4901fdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:28.513742 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:28.747618 18161 raft_consensus.cc:1275] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.749390 18513 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.759706 18161 raft_consensus.cc:1275] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:28.762815 18513 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc670002c01040788f11bcea4901fdee" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.767560 18386 raft_consensus.cc:1275] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.769775 18470 consensus_queue.cc:1048] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.777057 18387 raft_consensus.cc:1275] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Refusing update from remote peer 369f41941e2f42418050205d02be8cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:28.778990 18470 consensus_queue.cc:1048] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.844672 18085 raft_consensus.cc:1275] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.846601 18489 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "369f41941e2f42418050205d02be8cf2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.847966 18386 raft_consensus.cc:1275] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Refusing update from remote peer bc670002c01040788f11bcea4901fdee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.850070 18489 consensus_queue.cc:1048] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [LEADER]: Connected to new peer: Peer: permanent_uuid: "81be18a977274863852d38aa474220b3" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 36249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:29.078289  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:29.113037  6874 tablet_server.cc:179] TabletServer@127.6.182.129:36249 shutting down...
W20260709 12:26:29.120770 18049 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 12:26:29.125821 18049 consensus_peers.cc:597] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:29.151218 18124 consensus_peers.cc:597] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.162472  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:29.163499  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.164386  6874 raft_consensus.cc:2243] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.164947  6874 raft_consensus.cc:2272] T b1860d58244841f98d448b19642baa77 P 81be18a977274863852d38aa474220b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.167784  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.168501  6874 raft_consensus.cc:2243] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.169019  6874 raft_consensus.cc:2272] T e70af63b5a22462590e264ec0b7c4315 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.172147  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.172905  6874 raft_consensus.cc:2243] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.173565  6874 raft_consensus.cc:2272] T e7fa3c55bfb443788761e818ae518eaf P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.176321  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.177006  6874 raft_consensus.cc:2243] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.177615  6874 raft_consensus.cc:2272] T 1b072e327da74003a0ad8f1ffa287876 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.180123  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.180821  6874 raft_consensus.cc:2243] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.181437  6874 raft_consensus.cc:2272] T cac88b0c03f9498fbdefd53694e2ce20 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.184105  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.184731  6874 raft_consensus.cc:2243] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.185262  6874 raft_consensus.cc:2272] T 18393d89c21841e08b43f6c5e7633e2b P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.188220  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.188841  6874 raft_consensus.cc:2243] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.189354  6874 raft_consensus.cc:2272] T 46cb18f906f64071ad64ad79848d8d76 P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.191813  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.192354  6874 raft_consensus.cc:2243] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.192859  6874 raft_consensus.cc:2272] T cd64f8d2e04f42ad86bfc022b29e189a P 81be18a977274863852d38aa474220b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.196039  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.196592  6874 raft_consensus.cc:2243] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.197070  6874 raft_consensus.cc:2272] T b2a1a6dac83041d6966c8bb936a98c39 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.199906  6874 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:29.200457  6874 raft_consensus.cc:2243] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.201047  6874 raft_consensus.cc:2272] T 3637f864dc5949a48a1614a1787076f8 P 81be18a977274863852d38aa474220b3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:29.208572 18049 consensus_peers.cc:597] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.241523  6874 tablet_server.cc:196] TabletServer@127.6.182.129:36249 shutdown complete.
I20260709 12:26:29.284198  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:26:29.289217 18049 consensus_peers.cc:597] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:29.297242 18126 consensus_peers.cc:597] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee -> Peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Couldn't send request to peer 369f41941e2f42418050205d02be8cf2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.318430  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:29.319408  6874 tablet_replica.cc:333] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.320428  6874 raft_consensus.cc:2243] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.321501  6874 raft_consensus.cc:2272] T e70af63b5a22462590e264ec0b7c4315 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.325044  6874 tablet_replica.cc:333] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.325834  6874 raft_consensus.cc:2243] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.326932  6874 raft_consensus.cc:2272] T b1860d58244841f98d448b19642baa77 P 369f41941e2f42418050205d02be8cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.330011  6874 tablet_replica.cc:333] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.330664  6874 raft_consensus.cc:2243] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.331252  6874 raft_consensus.cc:2272] T 18393d89c21841e08b43f6c5e7633e2b P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.333936  6874 tablet_replica.cc:333] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.334514  6874 raft_consensus.cc:2243] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.335486  6874 raft_consensus.cc:2272] T cac88b0c03f9498fbdefd53694e2ce20 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.338174  6874 tablet_replica.cc:333] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.338742  6874 raft_consensus.cc:2243] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.339285  6874 raft_consensus.cc:2272] T 46cb18f906f64071ad64ad79848d8d76 P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.341953  6874 tablet_replica.cc:333] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.342562  6874 raft_consensus.cc:2243] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.343055  6874 raft_consensus.cc:2272] T cd64f8d2e04f42ad86bfc022b29e189a P 369f41941e2f42418050205d02be8cf2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.346021  6874 tablet_replica.cc:333] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.346695  6874 raft_consensus.cc:2243] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.347728  6874 raft_consensus.cc:2272] T 3637f864dc5949a48a1614a1787076f8 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.350224  6874 tablet_replica.cc:333] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.350904  6874 raft_consensus.cc:2243] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.351810  6874 raft_consensus.cc:2272] T b2a1a6dac83041d6966c8bb936a98c39 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.354833  6874 tablet_replica.cc:333] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.355420  6874 raft_consensus.cc:2243] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.356000  6874 raft_consensus.cc:2272] T 1b072e327da74003a0ad8f1ffa287876 P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.359562  6874 tablet_replica.cc:333] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2: stopping tablet replica
I20260709 12:26:29.360234  6874 raft_consensus.cc:2243] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.361693  6874 raft_consensus.cc:2272] T e7fa3c55bfb443788761e818ae518eaf P 369f41941e2f42418050205d02be8cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:29.364310 18124 consensus_peers.cc:597] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee -> Peer 81be18a977274863852d38aa474220b3 (127.6.182.129:36249): Couldn't send request to peer 81be18a977274863852d38aa474220b3. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:36249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.401113  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
W20260709 12:26:29.415686 18126 consensus_peers.cc:597] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee -> Peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Couldn't send request to peer 369f41941e2f42418050205d02be8cf2. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:29.418591 18126 consensus_peers.cc:597] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee -> Peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Couldn't send request to peer 369f41941e2f42418050205d02be8cf2. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.440613  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:26:29.471273 18126 consensus_peers.cc:597] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee -> Peer 369f41941e2f42418050205d02be8cf2 (127.6.182.130:44219): Couldn't send request to peer 369f41941e2f42418050205d02be8cf2. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:29.475298  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:29.476238  6874 tablet_replica.cc:333] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.477068  6874 raft_consensus.cc:2243] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.477648  6874 raft_consensus.cc:2272] T b1860d58244841f98d448b19642baa77 P bc670002c01040788f11bcea4901fdee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.480095  6874 tablet_replica.cc:333] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.480787  6874 raft_consensus.cc:2243] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.481257  6874 raft_consensus.cc:2272] T e70af63b5a22462590e264ec0b7c4315 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.484066  6874 tablet_replica.cc:333] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.484668  6874 raft_consensus.cc:2243] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.485194  6874 raft_consensus.cc:2272] T cac88b0c03f9498fbdefd53694e2ce20 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.487912  6874 tablet_replica.cc:333] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.488564  6874 raft_consensus.cc:2243] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.489593  6874 raft_consensus.cc:2272] T 18393d89c21841e08b43f6c5e7633e2b P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.491931  6874 tablet_replica.cc:333] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.492453  6874 raft_consensus.cc:2243] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.493446  6874 raft_consensus.cc:2272] T 46cb18f906f64071ad64ad79848d8d76 P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.495605  6874 tablet_replica.cc:333] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.496192  6874 raft_consensus.cc:2243] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.497035  6874 raft_consensus.cc:2272] T cd64f8d2e04f42ad86bfc022b29e189a P bc670002c01040788f11bcea4901fdee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.500288  6874 tablet_replica.cc:333] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.500932  6874 raft_consensus.cc:2243] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.501408  6874 raft_consensus.cc:2272] T b2a1a6dac83041d6966c8bb936a98c39 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.504058  6874 tablet_replica.cc:333] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.504698  6874 raft_consensus.cc:2243] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.505234  6874 raft_consensus.cc:2272] T 3637f864dc5949a48a1614a1787076f8 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.507593  6874 tablet_replica.cc:333] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.508129  6874 raft_consensus.cc:2243] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.509136  6874 raft_consensus.cc:2272] T 1b072e327da74003a0ad8f1ffa287876 P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.511528  6874 tablet_replica.cc:333] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee: stopping tablet replica
I20260709 12:26:29.512056  6874 raft_consensus.cc:2243] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:29.512552  6874 raft_consensus.cc:2272] T e7fa3c55bfb443788761e818ae518eaf P bc670002c01040788f11bcea4901fdee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:29.515209 17957 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:29.546500  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:26:29.575115  6874 master.cc:562] Master@127.6.182.190:41201 shutting down...
I20260709 12:26:29.597689  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:29.598402  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:29.598793  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P e23f960d6186423db68b369b23ab323a: stopping tablet replica
I20260709 12:26:29.622431  6874 master.cc:584] Master@127.6.182.190:41201 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15333 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:26:29.674719  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:46373
I20260709 12:26:29.675982  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.682367 18534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.682403 18533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.683569 18536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.684504  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:29.685883  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.686127  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.686312  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599989686286 us; error 0 us; skew 500 ppm
I20260709 12:26:29.686890  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.689674  6874 webserver.cc:533] Webserver started at http://127.6.182.190:46509/ using document root <none> and password file <none>
I20260709 12:26:29.690253  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.690474  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.690784  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.692096  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "f768233f82de4066bb7e7a5db6c9d906"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-lgtn"
I20260709 12:26:29.697471  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:26:29.701371 18541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.702422  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:26:29.702715  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "f768233f82de4066bb7e7a5db6c9d906"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-lgtn"
I20260709 12:26:29.702996  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.719597  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.721035  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.766305  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:46373
I20260709 12:26:29.766443 18592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:46373 every 8 connection(s)
I20260709 12:26:29.770694 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:29.785018 18593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906: Bootstrap starting.
I20260709 12:26:29.790390 18593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:29.795255 18593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906: No bootstrap required, opened a new log
I20260709 12:26:29.797721 18593 raft_consensus.cc:359] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER }
I20260709 12:26:29.798142 18593 raft_consensus.cc:385] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:29.798321 18593 raft_consensus.cc:740] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f768233f82de4066bb7e7a5db6c9d906, State: Initialized, Role: FOLLOWER
I20260709 12:26:29.798934 18593 consensus_queue.cc:260] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER }
I20260709 12:26:29.799378 18593 raft_consensus.cc:399] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:29.799571 18593 raft_consensus.cc:493] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:29.799778 18593 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:29.805639 18593 raft_consensus.cc:515] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER }
I20260709 12:26:29.806142 18593 leader_election.cc:304] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f768233f82de4066bb7e7a5db6c9d906; no voters: 
I20260709 12:26:29.807304 18593 leader_election.cc:290] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:29.807806 18596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:29.809434 18596 raft_consensus.cc:697] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 1 LEADER]: Becoming Leader. State: Replica: f768233f82de4066bb7e7a5db6c9d906, State: Running, Role: LEADER
I20260709 12:26:29.810209 18596 consensus_queue.cc:237] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER }
I20260709 12:26:29.810355 18593 sys_catalog.cc:565] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:29.815546 18597 sys_catalog.cc:455] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f768233f82de4066bb7e7a5db6c9d906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER } }
I20260709 12:26:29.816305 18597 sys_catalog.cc:458] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:29.816039 18598 sys_catalog.cc:455] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f768233f82de4066bb7e7a5db6c9d906. Latest consensus state: current_term: 1 leader_uuid: "f768233f82de4066bb7e7a5db6c9d906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f768233f82de4066bb7e7a5db6c9d906" member_type: VOTER } }
I20260709 12:26:29.817853 18598 sys_catalog.cc:458] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:29.819682 18602 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:29.828948 18602 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:29.830032  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:29.839393 18602 catalog_manager.cc:1383] Generated new cluster ID: 39d92b3e78494bed9e7cf57cfc6c4e72
I20260709 12:26:29.839767 18602 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:29.857411 18602 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:29.858784 18602 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:29.876307 18602 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906: Generated new TSK 0
I20260709 12:26:29.877048 18602 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:29.897073  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:29.903796 18614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:29.905041 18615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.907227  6874 server_base.cc:1061] running on GCE node
W20260709 12:26:29.908458 18617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:29.909726  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:29.909935  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:29.910074  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599989910063 us; error 0 us; skew 500 ppm
I20260709 12:26:29.910627  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:29.913262  6874 webserver.cc:533] Webserver started at http://127.6.182.129:41053/ using document root <none> and password file <none>
I20260709 12:26:29.913722  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:29.913883  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:29.914086  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:29.915196  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "c77bc55acf5241e88ec7ad9c46439781"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-lgtn"
I20260709 12:26:29.920204  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:29.923966 18622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.924855  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:26:29.925127  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "c77bc55acf5241e88ec7ad9c46439781"
format_stamp: "Formatted at 2026-07-09 12:26:29 on dist-test-slave-lgtn"
I20260709 12:26:29.925413  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:29.934576  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:29.935719  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:29.937292  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:29.939610  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:29.939791  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.940099  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:29.940271  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:29.987774  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:33221
I20260709 12:26:29.987879 18685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:33221 every 8 connection(s)
I20260709 12:26:29.993739  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:30.002604 18690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:30.006845 18691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:30.008993 18693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:30.009753  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:30.010741 18686 heartbeater.cc:344] Connected to a master server at 127.6.182.190:46373
I20260709 12:26:30.011236 18686 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:30.011404  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:30.011781  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:30.012068  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599990012046 us; error 0 us; skew 500 ppm
I20260709 12:26:30.012233 18686 heartbeater.cc:507] Master 127.6.182.190:46373 requested a full tablet report, sending...
I20260709 12:26:30.012882  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:30.015098 18558 ts_manager.cc:194] Registered new tserver with Master: c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221)
I20260709 12:26:30.016022  6874 webserver.cc:533] Webserver started at http://127.6.182.130:38659/ using document root <none> and password file <none>
I20260709 12:26:30.016686  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:30.016932  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:30.017225  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:30.017577 18558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42060
I20260709 12:26:30.018704  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "9806063f12d04cb9a2949869ee8aa647"
format_stamp: "Formatted at 2026-07-09 12:26:30 on dist-test-slave-lgtn"
I20260709 12:26:30.023753  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:30.027985 18698 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.029085  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:30.029387  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "9806063f12d04cb9a2949869ee8aa647"
format_stamp: "Formatted at 2026-07-09 12:26:30 on dist-test-slave-lgtn"
I20260709 12:26:30.029655  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:30.043349  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:30.044850  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:30.046492  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:30.049139  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:30.049350  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.049688  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:30.049849  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.096194  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:34167
I20260709 12:26:30.096310 18760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:34167 every 8 connection(s)
I20260709 12:26:30.101939  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:30.110353 18764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:30.112679 18765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:30.115636 18767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:30.116914 18761 heartbeater.cc:344] Connected to a master server at 127.6.182.190:46373
I20260709 12:26:30.117386 18761 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:30.117398  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:30.118430 18761 heartbeater.cc:507] Master 127.6.182.190:46373 requested a full tablet report, sending...
I20260709 12:26:30.118597  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:30.119005  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:30.119220  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599990119199 us; error 0 us; skew 500 ppm
I20260709 12:26:30.119907  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:30.120998 18558 ts_manager.cc:194] Registered new tserver with Master: 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.123054  6874 webserver.cc:533] Webserver started at http://127.6.182.131:34425/ using document root <none> and password file <none>
I20260709 12:26:30.123258 18558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42072
I20260709 12:26:30.123833  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:30.124120  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:30.124507  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:30.125989  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "b96db19b2b2148c6ace78f4a2156357e"
format_stamp: "Formatted at 2026-07-09 12:26:30 on dist-test-slave-lgtn"
I20260709 12:26:30.131088  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:30.134784 18772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.135780  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:26:30.136199  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "b96db19b2b2148c6ace78f4a2156357e"
format_stamp: "Formatted at 2026-07-09 12:26:30 on dist-test-slave-lgtn"
I20260709 12:26:30.136606  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:30.156095  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:30.157667  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:30.159379  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:30.162092  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:30.162379  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.162665  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:30.162876  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:30.209674  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:40859
I20260709 12:26:30.209765 18834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:40859 every 8 connection(s)
I20260709 12:26:30.224845 18835 heartbeater.cc:344] Connected to a master server at 127.6.182.190:46373
I20260709 12:26:30.225247 18835 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:30.225970 18835 heartbeater.cc:507] Master 127.6.182.190:46373 requested a full tablet report, sending...
I20260709 12:26:30.227970 18558 ts_manager.cc:194] Registered new tserver with Master: b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859)
I20260709 12:26:30.228464  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014853697s
I20260709 12:26:30.229467 18558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42078
I20260709 12:26:30.256114 18558 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42086:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:30.258615 18558 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:30.306432 18800 tablet_service.cc:1511] Processing CreateTablet for tablet 998ede11fa1e4ce68881deee742cb1b8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.308012 18800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998ede11fa1e4ce68881deee742cb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.307643 18799 tablet_service.cc:1511] Processing CreateTablet for tablet a136b61dc2024b5aa9880c04d0315e1c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.309201 18799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a136b61dc2024b5aa9880c04d0315e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.317826 18651 tablet_service.cc:1511] Processing CreateTablet for tablet 998ede11fa1e4ce68881deee742cb1b8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.318109 18650 tablet_service.cc:1511] Processing CreateTablet for tablet a136b61dc2024b5aa9880c04d0315e1c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.319324 18651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998ede11fa1e4ce68881deee742cb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.321538 18650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a136b61dc2024b5aa9880c04d0315e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.334622 18850 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: Bootstrap starting.
I20260709 12:26:30.335537 18726 tablet_service.cc:1511] Processing CreateTablet for tablet 998ede11fa1e4ce68881deee742cb1b8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.352497 18851 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: Bootstrap starting.
I20260709 12:26:30.351411 18726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998ede11fa1e4ce68881deee742cb1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.352922 18725 tablet_service.cc:1511] Processing CreateTablet for tablet a136b61dc2024b5aa9880c04d0315e1c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=709c75d3752d489f9f612c62cb30ae81]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.354436 18725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a136b61dc2024b5aa9880c04d0315e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.360193 18850 tablet_bootstrap.cc:654] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.363662 18851 tablet_bootstrap.cc:654] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.379104 18850 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: No bootstrap required, opened a new log
I20260709 12:26:30.379652 18850 ts_tablet_manager.cc:1403] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.022s
I20260709 12:26:30.382186 18851 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: No bootstrap required, opened a new log
I20260709 12:26:30.383060 18851 ts_tablet_manager.cc:1403] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.005s
I20260709 12:26:30.382958 18850 raft_consensus.cc:359] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.383713 18850 raft_consensus.cc:385] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.383991 18850 raft_consensus.cc:740] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.384752 18850 consensus_queue.cc:260] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.385783 18854 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: Bootstrap starting.
I20260709 12:26:30.386595 18851 raft_consensus.cc:359] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.387388 18835 heartbeater.cc:499] Master 127.6.182.190:46373 was elected leader, sending a full tablet report...
I20260709 12:26:30.387459 18851 raft_consensus.cc:385] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.388079 18851 raft_consensus.cc:740] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.389084 18850 ts_tablet_manager.cc:1434] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:30.389098 18851 consensus_queue.cc:260] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.390403 18850 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: Bootstrap starting.
I20260709 12:26:30.396658 18854 tablet_bootstrap.cc:654] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.400384 18850 tablet_bootstrap.cc:654] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.401257 18686 heartbeater.cc:499] Master 127.6.182.190:46373 was elected leader, sending a full tablet report...
I20260709 12:26:30.401826 18851 ts_tablet_manager.cc:1434] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.014s
I20260709 12:26:30.408140 18854 tablet_bootstrap.cc:492] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: No bootstrap required, opened a new log
I20260709 12:26:30.408828 18854 ts_tablet_manager.cc:1403] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 12:26:30.411391 18851 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: Bootstrap starting.
I20260709 12:26:30.411654 18854 raft_consensus.cc:359] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.412771 18854 raft_consensus.cc:385] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.413169 18854 raft_consensus.cc:740] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806063f12d04cb9a2949869ee8aa647, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.414196 18854 consensus_queue.cc:260] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.420511 18761 heartbeater.cc:499] Master 127.6.182.190:46373 was elected leader, sending a full tablet report...
I20260709 12:26:30.420560 18851 tablet_bootstrap.cc:654] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.421190 18854 ts_tablet_manager.cc:1434] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.001s
I20260709 12:26:30.421839 18850 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: No bootstrap required, opened a new log
I20260709 12:26:30.422451 18850 ts_tablet_manager.cc:1403] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.010s
I20260709 12:26:30.423295 18854 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: Bootstrap starting.
I20260709 12:26:30.425848 18850 raft_consensus.cc:359] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.426638 18850 raft_consensus.cc:385] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.429137 18850 raft_consensus.cc:740] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.429945 18850 consensus_queue.cc:260] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.431340 18854 tablet_bootstrap.cc:654] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.432258 18850 ts_tablet_manager.cc:1434] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:30.432834 18851 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: No bootstrap required, opened a new log
I20260709 12:26:30.433377 18851 ts_tablet_manager.cc:1403] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 12:26:30.436528 18851 raft_consensus.cc:359] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.437474 18851 raft_consensus.cc:385] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.437925 18851 raft_consensus.cc:740] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.440011 18854 tablet_bootstrap.cc:492] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: No bootstrap required, opened a new log
I20260709 12:26:30.440011 18851 consensus_queue.cc:260] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.440984 18854 ts_tablet_manager.cc:1403] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 12:26:30.442437 18851 ts_tablet_manager.cc:1434] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:26:30.444082 18854 raft_consensus.cc:359] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.444767 18854 raft_consensus.cc:385] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.445029 18854 raft_consensus.cc:740] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806063f12d04cb9a2949869ee8aa647, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.445747 18854 consensus_queue.cc:260] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.447840 18854 ts_tablet_manager.cc:1434] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:30.461398 18856 raft_consensus.cc:493] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.462024 18856 raft_consensus.cc:515] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.464717 18856 leader_election.cc:290] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.475332 18810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998ede11fa1e4ce68881deee742cb1b8" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b96db19b2b2148c6ace78f4a2156357e" is_pre_election: true
I20260709 12:26:30.476153 18810 raft_consensus.cc:2468] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 0.
I20260709 12:26:30.477411 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998ede11fa1e4ce68881deee742cb1b8" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647" is_pre_election: true
I20260709 12:26:30.477588 18624 leader_election.cc:304] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.478132 18736 raft_consensus.cc:2468] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 0.
I20260709 12:26:30.478570 18856 raft_consensus.cc:2804] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.479020 18856 raft_consensus.cc:493] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.479415 18856 raft_consensus.cc:3060] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.485997 18856 raft_consensus.cc:515] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.488025 18856 leader_election.cc:290] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 1 election: Requested vote from peers b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.488610 18810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998ede11fa1e4ce68881deee742cb1b8" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
I20260709 12:26:30.489095 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998ede11fa1e4ce68881deee742cb1b8" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:30.489394 18810 raft_consensus.cc:3060] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.489737 18736 raft_consensus.cc:3060] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.497747 18736 raft_consensus.cc:2468] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 1.
I20260709 12:26:30.497747 18810 raft_consensus.cc:2468] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 1.
I20260709 12:26:30.499079 18624 leader_election.cc:304] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.499715 18856 raft_consensus.cc:2804] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.500901 18856 raft_consensus.cc:697] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 1 LEADER]: Becoming Leader. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Running, Role: LEADER
I20260709 12:26:30.501827 18856 consensus_queue.cc:237] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } }
I20260709 12:26:30.510407 18556 catalog_manager.cc:5697] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 reported cstate change: term changed from 0 to 1, leader changed from <none> to c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "c77bc55acf5241e88ec7ad9c46439781" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.514470 18855 raft_consensus.cc:493] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.515007 18855 raft_consensus.cc:515] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.517400 18855 leader_election.cc:290] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.528362 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781" is_pre_election: true
I20260709 12:26:30.529305 18661 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.530656 18774 leader_election.cc:304] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.531124 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647" is_pre_election: true
I20260709 12:26:30.531788 18855 raft_consensus.cc:2804] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.531905 18736 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.532287 18855 raft_consensus.cc:493] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.532858 18855 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.539292 18855 raft_consensus.cc:515] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.541218 18855 leader_election.cc:290] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Requested vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.542155 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
I20260709 12:26:30.542300 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:30.542732 18661 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.542976 18736 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.548602 18661 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.549319 18736 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.550045 18774 leader_election.cc:304] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.550926 18855 raft_consensus.cc:2804] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.551859 18855 raft_consensus.cc:697] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Leader. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:30.552860 18855 consensus_queue.cc:237] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.560921 18556 catalog_manager.cc:5697] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e reported cstate change: term changed from 0 to 1, leader changed from <none> to b96db19b2b2148c6ace78f4a2156357e (127.6.182.131). New cstate: current_term: 1 leader_uuid: "b96db19b2b2148c6ace78f4a2156357e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.598340 18556 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:30.600416 18556 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:30.625121 18651 tablet_service.cc:1511] Processing CreateTablet for tablet 6469b6f3623c41c4b99ee0a5888eb7c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.626538 18651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469b6f3623c41c4b99ee0a5888eb7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.626360 18725 tablet_service.cc:1511] Processing CreateTablet for tablet 6469b6f3623c41c4b99ee0a5888eb7c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.627774 18725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469b6f3623c41c4b99ee0a5888eb7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.628293 18799 tablet_service.cc:1511] Processing CreateTablet for tablet 6469b6f3623c41c4b99ee0a5888eb7c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:30.629576 18799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469b6f3623c41c4b99ee0a5888eb7c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.631362 18726 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ca6cc44bb48c2893f48ba2e31121b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.632680 18726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ca6cc44bb48c2893f48ba2e31121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.633057 18800 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ca6cc44bb48c2893f48ba2e31121b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.634356 18800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ca6cc44bb48c2893f48ba2e31121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.638464 18650 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ca6cc44bb48c2893f48ba2e31121b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=df312051b222427682cdbe0ae5ce6769]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:30.639801 18650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ca6cc44bb48c2893f48ba2e31121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:30.644382 18851 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: Bootstrap starting.
I20260709 12:26:30.650676 18850 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Bootstrap starting.
I20260709 12:26:30.650974 18851 tablet_bootstrap.cc:654] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.665613 18850 tablet_bootstrap.cc:654] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.677594 18854 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: Bootstrap starting.
I20260709 12:26:30.679404 18850 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: No bootstrap required, opened a new log
I20260709 12:26:30.679998 18850 ts_tablet_manager.cc:1403] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 12:26:30.684161 18851 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: No bootstrap required, opened a new log
I20260709 12:26:30.683826 18850 raft_consensus.cc:359] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.684909 18850 raft_consensus.cc:385] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.684921 18851 ts_tablet_manager.cc:1403] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.017s
I20260709 12:26:30.685438 18850 raft_consensus.cc:740] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.685752 18854 tablet_bootstrap.cc:654] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.686607 18850 consensus_queue.cc:260] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.688519 18851 raft_consensus.cc:359] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.689383 18851 raft_consensus.cc:385] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.689746 18851 raft_consensus.cc:740] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.690025 18850 ts_tablet_manager.cc:1434] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:26:30.691385 18850 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: Bootstrap starting.
I20260709 12:26:30.690708 18851 consensus_queue.cc:260] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.696745 18851 ts_tablet_manager.cc:1434] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:26:30.697907 18851 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: Bootstrap starting.
I20260709 12:26:30.702683 18850 tablet_bootstrap.cc:654] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.704783 18851 tablet_bootstrap.cc:654] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.716961 18851 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: No bootstrap required, opened a new log
I20260709 12:26:30.717567 18851 ts_tablet_manager.cc:1403] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:26:30.720728 18851 raft_consensus.cc:359] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.721571 18851 raft_consensus.cc:385] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.721915 18851 raft_consensus.cc:740] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.722746 18851 consensus_queue.cc:260] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.725411 18851 ts_tablet_manager.cc:1434] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:30.733412 18854 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: No bootstrap required, opened a new log
I20260709 12:26:30.733412 18850 tablet_bootstrap.cc:492] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: No bootstrap required, opened a new log
I20260709 12:26:30.734376 18854 ts_tablet_manager.cc:1403] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.034s
I20260709 12:26:30.734494 18850 ts_tablet_manager.cc:1403] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.035s
I20260709 12:26:30.737643 18854 raft_consensus.cc:359] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.737854 18850 raft_consensus.cc:359] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.738425 18854 raft_consensus.cc:385] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.738689 18850 raft_consensus.cc:385] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.738876 18854 raft_consensus.cc:740] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806063f12d04cb9a2949869ee8aa647, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.739398 18850 raft_consensus.cc:740] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.740044 18854 consensus_queue.cc:260] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.740371 18850 consensus_queue.cc:260] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.742815 18850 ts_tablet_manager.cc:1434] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:30.742998 18854 ts_tablet_manager.cc:1434] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:30.744172 18854 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: Bootstrap starting.
I20260709 12:26:30.750895 18854 tablet_bootstrap.cc:654] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:30.755784 18854 tablet_bootstrap.cc:492] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: No bootstrap required, opened a new log
I20260709 12:26:30.756395 18854 ts_tablet_manager.cc:1403] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:26:30.757635 18855 raft_consensus.cc:493] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.758203 18855 raft_consensus.cc:515] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.759255 18854 raft_consensus.cc:359] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.760058 18854 raft_consensus.cc:385] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:30.760339 18854 raft_consensus.cc:740] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806063f12d04cb9a2949869ee8aa647, State: Initialized, Role: FOLLOWER
I20260709 12:26:30.760530 18855 leader_election.cc:290] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.761237 18854 consensus_queue.cc:260] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.761818 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781" is_pre_election: true
I20260709 12:26:30.762006 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647" is_pre_election: true
I20260709 12:26:30.762599 18661 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.762713 18736 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.763954 18854 ts_tablet_manager.cc:1434] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:26:30.764096 18774 leader_election.cc:304] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.765072 18866 raft_consensus.cc:2804] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.765415 18866 raft_consensus.cc:493] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.765750 18866 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.772250 18866 raft_consensus.cc:515] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.774187 18866 leader_election.cc:290] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Requested vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.774971 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
I20260709 12:26:30.775256 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:30.775593 18661 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.775851 18736 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.777038 18866 raft_consensus.cc:493] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.777616 18866 raft_consensus.cc:515] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.779825 18866 leader_election.cc:290] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.781114 18735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647" is_pre_election: true
I20260709 12:26:30.782004 18735 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.781082 18660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781" is_pre_election: true
I20260709 12:26:30.782821 18661 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.783027 18660 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 0.
I20260709 12:26:30.783358 18774 leader_election.cc:304] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806063f12d04cb9a2949869ee8aa647, b96db19b2b2148c6ace78f4a2156357e; no voters: 
I20260709 12:26:30.784245 18866 raft_consensus.cc:2804] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:30.784389 18774 leader_election.cc:304] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.784724 18866 raft_consensus.cc:493] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.784662 18736 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.785290 18855 raft_consensus.cc:2804] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.785564 18866 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.786821 18855 raft_consensus.cc:697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Leader. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:30.787817 18855 consensus_queue.cc:237] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.793731 18866 raft_consensus.cc:515] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.796006 18866 leader_election.cc:290] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Requested vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:30.796759 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
I20260709 12:26:30.797015 18736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:30.797391 18661 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.797775 18736 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:30.798269 18556 catalog_manager.cc:5697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e reported cstate change: term changed from 0 to 1, leader changed from <none> to b96db19b2b2148c6ace78f4a2156357e (127.6.182.131). New cstate: current_term: 1 leader_uuid: "b96db19b2b2148c6ace78f4a2156357e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.803875 18661 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.804296 18736 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 1.
I20260709 12:26:30.805301 18774 leader_election.cc:304] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96db19b2b2148c6ace78f4a2156357e, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:30.806118 18866 raft_consensus.cc:2804] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:30.806597 18866 raft_consensus.cc:697] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Leader. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:30.807420 18866 consensus_queue.cc:237] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:30.814977 18556 catalog_manager.cc:5697] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e reported cstate change: term changed from 0 to 1, leader changed from <none> to b96db19b2b2148c6ace78f4a2156357e (127.6.182.131). New cstate: current_term: 1 leader_uuid: "b96db19b2b2148c6ace78f4a2156357e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.879531 18810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c"
dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
mode: GRACEFUL
new_leader_uuid: "9806063f12d04cb9a2949869ee8aa647"
 from {username='slave'} at 127.0.0.1:35038
I20260709 12:26:30.880172 18810 raft_consensus.cc:606] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Received request to transfer leadership to TS 9806063f12d04cb9a2949869ee8aa647
I20260709 12:26:30.886720 18810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1"
dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
mode: GRACEFUL
new_leader_uuid: "c77bc55acf5241e88ec7ad9c46439781"
 from {username='slave'} at 127.0.0.1:35038
I20260709 12:26:30.887290 18810 raft_consensus.cc:606] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Received request to transfer leadership to TS c77bc55acf5241e88ec7ad9c46439781
I20260709 12:26:30.893047 18810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b"
dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
mode: GRACEFUL
new_leader_uuid: "c77bc55acf5241e88ec7ad9c46439781"
 from {username='slave'} at 127.0.0.1:35038
I20260709 12:26:30.893574 18810 raft_consensus.cc:606] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Received request to transfer leadership to TS c77bc55acf5241e88ec7ad9c46439781
I20260709 12:26:30.988256 18856 consensus_queue.cc:1048] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.002620 18863 consensus_queue.cc:1048] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:31.138100 18866 consensus_queue.cc:1048] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.143965 18866 consensus_queue.cc:1048] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.146682 18855 raft_consensus.cc:993] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: : Instructing follower 9806063f12d04cb9a2949869ee8aa647 to start an election
I20260709 12:26:31.147311 18879 raft_consensus.cc:1081] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Signalling peer 9806063f12d04cb9a2949869ee8aa647 to start an election
I20260709 12:26:31.154760 18735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c"
dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
 from {username='slave'} at 127.0.0.1:52216
I20260709 12:26:31.155434 18735 raft_consensus.cc:493] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.155853 18735 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.165181 18735 raft_consensus.cc:515] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.167879 18735 leader_election.cc:290] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [CANDIDATE]: Term 2 election: Requested vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859)
I20260709 12:26:31.181219 18661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "9806063f12d04cb9a2949869ee8aa647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
I20260709 12:26:31.181892 18661 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.181916 18810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a136b61dc2024b5aa9880c04d0315e1c" candidate_uuid: "9806063f12d04cb9a2949869ee8aa647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
I20260709 12:26:31.182734 18810 raft_consensus.cc:3055] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.183161 18810 raft_consensus.cc:740] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:31.184080 18810 consensus_queue.cc:260] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.185556 18810 raft_consensus.cc:3060] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.190455 18661 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9806063f12d04cb9a2949869ee8aa647 in term 2.
I20260709 12:26:31.191715 18700 leader_election.cc:304] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806063f12d04cb9a2949869ee8aa647, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:31.192682 18859 raft_consensus.cc:2804] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.193497 18810 raft_consensus.cc:2468] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9806063f12d04cb9a2949869ee8aa647 in term 2.
I20260709 12:26:31.193933 18859 raft_consensus.cc:697] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 2 LEADER]: Becoming Leader. State: Replica: 9806063f12d04cb9a2949869ee8aa647, State: Running, Role: LEADER
I20260709 12:26:31.195047 18859 consensus_queue.cc:237] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.202857 18558 catalog_manager.cc:5697] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 reported cstate change: term changed from 1 to 2, leader changed from b96db19b2b2148c6ace78f4a2156357e (127.6.182.131) to 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "9806063f12d04cb9a2949869ee8aa647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.296753 18879 consensus_queue.cc:1048] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.303973 18866 raft_consensus.cc:993] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: : Instructing follower c77bc55acf5241e88ec7ad9c46439781 to start an election
I20260709 12:26:31.304502 18866 raft_consensus.cc:1081] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Signalling peer c77bc55acf5241e88ec7ad9c46439781 to start an election
I20260709 12:26:31.306212 18660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b"
dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
 from {username='slave'} at 127.0.0.1:53676
I20260709 12:26:31.307775 18866 consensus_queue.cc:1048] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.308310 18660 raft_consensus.cc:493] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.308846 18660 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.312690 18879 consensus_queue.cc:1048] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.317412 18660 raft_consensus.cc:515] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.324906 18660 leader_election.cc:290] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 2 election: Requested vote from peers 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167), b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859)
I20260709 12:26:31.328823 18810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
I20260709 12:26:31.329442 18810 raft_consensus.cc:3055] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.329772 18810 raft_consensus.cc:740] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:31.330528 18810 consensus_queue.cc:260] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.331656 18735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ca6cc44bb48c2893f48ba2e31121b" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:31.332321 18735 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.337105 18810 raft_consensus.cc:3060] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.337539 18866 consensus_queue.cc:1048] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:31.342306 18735 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 2.
I20260709 12:26:31.343878 18624 leader_election.cc:304] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806063f12d04cb9a2949869ee8aa647, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:31.345337 18856 raft_consensus.cc:2804] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.345953 18856 raft_consensus.cc:697] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Becoming Leader. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Running, Role: LEADER
I20260709 12:26:31.346889 18856 consensus_queue.cc:237] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.347642 18810 raft_consensus.cc:2468] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 2.
I20260709 12:26:31.353574 18866 raft_consensus.cc:993] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: : Instructing follower c77bc55acf5241e88ec7ad9c46439781 to start an election
I20260709 12:26:31.354045 18866 raft_consensus.cc:1081] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Signalling peer c77bc55acf5241e88ec7ad9c46439781 to start an election
I20260709 12:26:31.355686 18660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1"
dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
 from {username='slave'} at 127.0.0.1:53676
I20260709 12:26:31.356287 18660 raft_consensus.cc:493] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.356658 18660 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.362655 18660 raft_consensus.cc:515] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.364756 18660 leader_election.cc:290] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 2 election: Requested vote from peers 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167), b96db19b2b2148c6ace78f4a2156357e (127.6.182.131:40859)
I20260709 12:26:31.366323 18735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:31.366429 18810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "c77bc55acf5241e88ec7ad9c46439781" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
I20260709 12:26:31.367290 18735 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.367398 18810 raft_consensus.cc:3055] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.367910 18810 raft_consensus.cc:740] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:31.368880 18810 consensus_queue.cc:260] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.369266 18557 catalog_manager.cc:5697] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 reported cstate change: term changed from 1 to 2, leader changed from b96db19b2b2148c6ace78f4a2156357e (127.6.182.131) to c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "c77bc55acf5241e88ec7ad9c46439781" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.370302 18810 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.374677 18735 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 2.
I20260709 12:26:31.376053 18624 leader_election.cc:304] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806063f12d04cb9a2949869ee8aa647, c77bc55acf5241e88ec7ad9c46439781; no voters: 
I20260709 12:26:31.376358 18810 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c77bc55acf5241e88ec7ad9c46439781 in term 2.
I20260709 12:26:31.377072 18856 raft_consensus.cc:2804] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.377705 18856 raft_consensus.cc:697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Becoming Leader. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Running, Role: LEADER
I20260709 12:26:31.378425 18856 consensus_queue.cc:237] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.388252 18557 catalog_manager.cc:5697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 reported cstate change: term changed from 1 to 2, leader changed from b96db19b2b2148c6ace78f4a2156357e (127.6.182.131) to c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "c77bc55acf5241e88ec7ad9c46439781" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.640338 18660 raft_consensus.cc:1275] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Refusing update from remote peer 9806063f12d04cb9a2949869ee8aa647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.641846 18894 consensus_queue.cc:1048] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.643149 18810 raft_consensus.cc:1275] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Refusing update from remote peer 9806063f12d04cb9a2949869ee8aa647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.644749 18894 consensus_queue.cc:1048] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.650152  6874 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:26:31.653029  6874 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:26:31.653663  6874 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:26:31.677165 18660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1"
dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
mode: GRACEFUL
new_leader_uuid: "b96db19b2b2148c6ace78f4a2156357e"
 from {username='slave'} at 127.0.0.1:53690
I20260709 12:26:31.677731 18660 raft_consensus.cc:606] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Received request to transfer leadership to TS b96db19b2b2148c6ace78f4a2156357e
I20260709 12:26:31.678923  6874 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:26:31.854539 18810 raft_consensus.cc:1275] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Refusing update from remote peer c77bc55acf5241e88ec7ad9c46439781: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.856153 18856 consensus_queue.cc:1048] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.863878 18735 raft_consensus.cc:1275] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Refusing update from remote peer c77bc55acf5241e88ec7ad9c46439781: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.865862 18856 consensus_queue.cc:1048] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.950261 18735 raft_consensus.cc:1275] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Refusing update from remote peer c77bc55acf5241e88ec7ad9c46439781: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.951596 18856 consensus_queue.cc:1048] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.961285 18810 raft_consensus.cc:1275] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Refusing update from remote peer c77bc55acf5241e88ec7ad9c46439781: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.962792 18856 consensus_queue.cc:1048] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.969583 18856 raft_consensus.cc:993] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: : Instructing follower b96db19b2b2148c6ace78f4a2156357e to start an election
I20260709 12:26:31.970058 18901 raft_consensus.cc:1081] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Signalling peer b96db19b2b2148c6ace78f4a2156357e to start an election
I20260709 12:26:31.971778 18810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1"
dest_uuid: "b96db19b2b2148c6ace78f4a2156357e"
 from {username='slave'} at 127.0.0.1:35026
I20260709 12:26:31.972322 18810 raft_consensus.cc:493] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.972745 18810 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.978628 18810 raft_consensus.cc:515] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.980778 18810 leader_election.cc:290] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 3 election: Requested vote from peers c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221), 9806063f12d04cb9a2949869ee8aa647 (127.6.182.130:34167)
I20260709 12:26:31.981528 18660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c77bc55acf5241e88ec7ad9c46439781"
I20260709 12:26:31.982031 18735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469b6f3623c41c4b99ee0a5888eb7c1" candidate_uuid: "b96db19b2b2148c6ace78f4a2156357e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9806063f12d04cb9a2949869ee8aa647"
I20260709 12:26:31.982244 18660 raft_consensus.cc:3055] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.982620 18660 raft_consensus.cc:740] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c77bc55acf5241e88ec7ad9c46439781, State: Running, Role: LEADER
I20260709 12:26:31.982702 18735 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.983505 18660 consensus_queue.cc:260] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:31.984894 18660 raft_consensus.cc:3060] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.990723 18735 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 3.
I20260709 12:26:31.992164 18774 leader_election.cc:304] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9806063f12d04cb9a2949869ee8aa647, b96db19b2b2148c6ace78f4a2156357e; no voters: 
I20260709 12:26:31.992419 18660 raft_consensus.cc:2468] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96db19b2b2148c6ace78f4a2156357e in term 3.
I20260709 12:26:31.993129 18866 raft_consensus.cc:2804] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:31.994189 18866 raft_consensus.cc:697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 LEADER]: Becoming Leader. State: Replica: b96db19b2b2148c6ace78f4a2156357e, State: Running, Role: LEADER
I20260709 12:26:31.995208 18866 consensus_queue.cc:237] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } }
I20260709 12:26:32.002784 18558 catalog_manager.cc:5697] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e reported cstate change: term changed from 2 to 3, leader changed from c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129) to b96db19b2b2148c6ace78f4a2156357e (127.6.182.131). New cstate: current_term: 3 leader_uuid: "b96db19b2b2148c6ace78f4a2156357e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bc55acf5241e88ec7ad9c46439781" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 33221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9806063f12d04cb9a2949869ee8aa647" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96db19b2b2148c6ace78f4a2156357e" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 40859 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.035728  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:26:32.042976 18700 consensus_peers.cc:597] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 -> Peer c77bc55acf5241e88ec7ad9c46439781 (127.6.182.129:33221): Couldn't send request to peer c77bc55acf5241e88ec7ad9c46439781. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.060817  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:32.061625  6874 tablet_replica.cc:333] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781: stopping tablet replica
I20260709 12:26:32.062252  6874 raft_consensus.cc:2243] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.063153  6874 raft_consensus.cc:2272] T 8a8ca6cc44bb48c2893f48ba2e31121b P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.066200  6874 tablet_replica.cc:333] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781: stopping tablet replica
I20260709 12:26:32.066840  6874 raft_consensus.cc:2243] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.067417  6874 raft_consensus.cc:2272] T 6469b6f3623c41c4b99ee0a5888eb7c1 P c77bc55acf5241e88ec7ad9c46439781 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.070382  6874 tablet_replica.cc:333] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781: stopping tablet replica
I20260709 12:26:32.070968  6874 raft_consensus.cc:2243] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.072136  6874 raft_consensus.cc:2272] T 998ede11fa1e4ce68881deee742cb1b8 P c77bc55acf5241e88ec7ad9c46439781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.074751  6874 tablet_replica.cc:333] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781: stopping tablet replica
I20260709 12:26:32.075276  6874 raft_consensus.cc:2243] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.075721  6874 raft_consensus.cc:2272] T a136b61dc2024b5aa9880c04d0315e1c P c77bc55acf5241e88ec7ad9c46439781 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.099459  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
I20260709 12:26:32.113077  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
I20260709 12:26:32.131553  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:32.132323  6874 tablet_replica.cc:333] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647: stopping tablet replica
I20260709 12:26:32.132992  6874 raft_consensus.cc:2243] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.133493  6874 raft_consensus.cc:2272] T 6469b6f3623c41c4b99ee0a5888eb7c1 P 9806063f12d04cb9a2949869ee8aa647 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.135910  6874 tablet_replica.cc:333] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647: stopping tablet replica
I20260709 12:26:32.136467  6874 raft_consensus.cc:2243] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.136981  6874 raft_consensus.cc:2272] T 8a8ca6cc44bb48c2893f48ba2e31121b P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.139453  6874 tablet_replica.cc:333] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647: stopping tablet replica
I20260709 12:26:32.139992  6874 raft_consensus.cc:2243] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.140442  6874 raft_consensus.cc:2272] T 998ede11fa1e4ce68881deee742cb1b8 P 9806063f12d04cb9a2949869ee8aa647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.142329  6874 tablet_replica.cc:333] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647: stopping tablet replica
I20260709 12:26:32.142809  6874 raft_consensus.cc:2243] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.143617  6874 raft_consensus.cc:2272] T a136b61dc2024b5aa9880c04d0315e1c P 9806063f12d04cb9a2949869ee8aa647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.167299  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
I20260709 12:26:32.181620  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
I20260709 12:26:32.199975  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:32.200583  6874 tablet_replica.cc:333] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e: stopping tablet replica
I20260709 12:26:32.201259  6874 raft_consensus.cc:2243] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.201727  6874 raft_consensus.cc:2272] T 8a8ca6cc44bb48c2893f48ba2e31121b P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.204110  6874 tablet_replica.cc:333] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: stopping tablet replica
I20260709 12:26:32.204818  6874 raft_consensus.cc:2243] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.205554  6874 pending_rounds.cc:70] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Trying to abort 1 pending ops.
I20260709 12:26:32.205765  6874 pending_rounds.cc:77] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625567220457472 op_type: NO_OP noop_request { }
I20260709 12:26:32.206084  6874 raft_consensus.cc:2889] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:32.206375  6874 raft_consensus.cc:2272] T 6469b6f3623c41c4b99ee0a5888eb7c1 P b96db19b2b2148c6ace78f4a2156357e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.209159  6874 tablet_replica.cc:333] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e: stopping tablet replica
I20260709 12:26:32.209693  6874 raft_consensus.cc:2243] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.210124  6874 raft_consensus.cc:2272] T 998ede11fa1e4ce68881deee742cb1b8 P b96db19b2b2148c6ace78f4a2156357e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.212137  6874 tablet_replica.cc:333] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e: stopping tablet replica
I20260709 12:26:32.212610  6874 raft_consensus.cc:2243] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.213104  6874 raft_consensus.cc:2272] T a136b61dc2024b5aa9880c04d0315e1c P b96db19b2b2148c6ace78f4a2156357e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.225997  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:26:32.240978  6874 master.cc:562] Master@127.6.182.190:46373 shutting down...
I20260709 12:26:32.258131  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.258711  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.259064  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P f768233f82de4066bb7e7a5db6c9d906: stopping tablet replica
I20260709 12:26:32.277663  6874 master.cc:584] Master@127.6.182.190:46373 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2633 ms)
[----------] 6 tests from LeaderRebalancerTest (406327 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:26:32.307360  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:38101
I20260709 12:26:32.308396  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:32.313580 18909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.313652 18910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.315280 18912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:32.318567  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:32.320230  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:32.320412  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:32.320518  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599992320508 us; error 0 us; skew 500 ppm
I20260709 12:26:32.321079  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:32.323407  6874 webserver.cc:533] Webserver started at http://127.6.182.190:34621/ using document root <none> and password file <none>
I20260709 12:26:32.323889  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:32.324077  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:32.324360  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:32.325465  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "08b2e9a7180c4656afb76a7942afc51b"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.329815  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:32.333348 18917 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.334201  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:32.334527  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "08b2e9a7180c4656afb76a7942afc51b"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.334806  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:32.353340  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:32.354414  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:32.389921  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:38101
I20260709 12:26:32.390029 18968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:38101 every 8 connection(s)
I20260709 12:26:32.394080 18969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.405340 18969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: Bootstrap starting.
I20260709 12:26:32.410084 18969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:32.414379 18969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: No bootstrap required, opened a new log
I20260709 12:26:32.416774 18969 raft_consensus.cc:359] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER }
I20260709 12:26:32.417234 18969 raft_consensus.cc:385] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:32.417459 18969 raft_consensus.cc:740] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2e9a7180c4656afb76a7942afc51b, State: Initialized, Role: FOLLOWER
I20260709 12:26:32.418144 18969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER }
I20260709 12:26:32.418629 18969 raft_consensus.cc:399] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:32.418879 18969 raft_consensus.cc:493] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:32.419157 18969 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:32.424238 18969 raft_consensus.cc:515] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER }
I20260709 12:26:32.424855 18969 leader_election.cc:304] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08b2e9a7180c4656afb76a7942afc51b; no voters: 
I20260709 12:26:32.425998 18969 leader_election.cc:290] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:32.426353 18972 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:32.427796 18972 raft_consensus.cc:697] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 1 LEADER]: Becoming Leader. State: Replica: 08b2e9a7180c4656afb76a7942afc51b, State: Running, Role: LEADER
I20260709 12:26:32.428488 18972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER }
I20260709 12:26:32.429047 18969 sys_catalog.cc:565] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:32.431406 18973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08b2e9a7180c4656afb76a7942afc51b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER } }
I20260709 12:26:32.431418 18974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b2e9a7180c4656afb76a7942afc51b. Latest consensus state: current_term: 1 leader_uuid: "08b2e9a7180c4656afb76a7942afc51b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2e9a7180c4656afb76a7942afc51b" member_type: VOTER } }
I20260709 12:26:32.432539 18973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:32.432561 18974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:32.435456 18978 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:32.440372 18978 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:32.445103  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:32.449640 18978 catalog_manager.cc:1383] Generated new cluster ID: 179e1cedc39040389c6d96c340180ad5
I20260709 12:26:32.449934 18978 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:32.472139 18978 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:32.473516 18978 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:32.488988 18978 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: Generated new TSK 0
I20260709 12:26:32.489634 18978 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:32.513136  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:32.519378 18990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.520753 18991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:32.524055  6874 server_base.cc:1061] running on GCE node
W20260709 12:26:32.524086 18993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:32.525341  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:32.525535  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:32.525665  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599992525654 us; error 0 us; skew 500 ppm
I20260709 12:26:32.526167  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:32.528491  6874 webserver.cc:533] Webserver started at http://127.6.182.129:33195/ using document root <none> and password file <none>
I20260709 12:26:32.528995  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:32.529165  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:32.529381  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:32.530435  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "d1c90202bd65484886d7280434e09778"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.535159  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:32.539328 18998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.540244  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:26:32.540582  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "d1c90202bd65484886d7280434e09778"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.541059  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:32.556041  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:32.557278  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:32.558732  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:32.561108  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:32.561350  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.561607  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:32.561791  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.604259  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:39559
I20260709 12:26:32.604349 19060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:39559 every 8 connection(s)
I20260709 12:26:32.609838  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:32.618269 19065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.620172 19066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.622126 19068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:32.623260  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:32.625305 19061 heartbeater.cc:344] Connected to a master server at 127.6.182.190:38101
I20260709 12:26:32.625459  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:32.625830 19061 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:32.625845  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:32.626246  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599992626224 us; error 0 us; skew 500 ppm
I20260709 12:26:32.626860 19061 heartbeater.cc:507] Master 127.6.182.190:38101 requested a full tablet report, sending...
I20260709 12:26:32.626955  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:32.629488 18934 ts_manager.cc:194] Registered new tserver with Master: d1c90202bd65484886d7280434e09778 (127.6.182.129:39559)
I20260709 12:26:32.630159  6874 webserver.cc:533] Webserver started at http://127.6.182.130:39795/ using document root <none> and password file <none>
I20260709 12:26:32.630833  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:32.631095  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:32.631421  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:32.631537 18934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56918
I20260709 12:26:32.632863  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "bc7db1d10d934fe78d833139b8501fa2"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.637719  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:32.641340 19073 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.642148  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:32.642592  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "bc7db1d10d934fe78d833139b8501fa2"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.643100  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:32.670972  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:32.672076  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:32.673573  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:32.675767  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:32.675997  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.676234  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:32.676402  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.717016  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:43605
I20260709 12:26:32.717139 19135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:43605 every 8 connection(s)
I20260709 12:26:32.722024  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:32.729451 19139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.730497 19140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:32.734117 19142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:32.735531  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:32.735836 19136 heartbeater.cc:344] Connected to a master server at 127.6.182.190:38101
I20260709 12:26:32.736407 19136 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:32.736768  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:32.737249  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:32.737478  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783599992737457 us; error 0 us; skew 500 ppm
I20260709 12:26:32.737551 19136 heartbeater.cc:507] Master 127.6.182.190:38101 requested a full tablet report, sending...
I20260709 12:26:32.738152  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:32.740269 18934 ts_manager.cc:194] Registered new tserver with Master: bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:32.741286  6874 webserver.cc:533] Webserver started at http://127.6.182.131:45821/ using document root <none> and password file <none>
I20260709 12:26:32.741993  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:32.742228  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:32.742277 18934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56934
I20260709 12:26:32.742642  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:32.744094  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.748744  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:26:32.752158 19147 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.753046  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:26:32.753364  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
format_stamp: "Formatted at 2026-07-09 12:26:32 on dist-test-slave-lgtn"
I20260709 12:26:32.753640  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:32.787107  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:32.788328  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:32.789986  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:32.792505  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:32.792824  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:32.793111  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:32.793337  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:32.836843  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:46741
I20260709 12:26:32.837044 19209 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:46741 every 8 connection(s)
I20260709 12:26:32.852026 19210 heartbeater.cc:344] Connected to a master server at 127.6.182.190:38101
I20260709 12:26:32.852555 19210 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:32.853478 19210 heartbeater.cc:507] Master 127.6.182.190:38101 requested a full tablet report, sending...
I20260709 12:26:32.855863 18934 ts_manager.cc:194] Registered new tserver with Master: b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:32.856875  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01643254s
I20260709 12:26:32.857753 18934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56948
I20260709 12:26:32.885262 18934 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56952:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:32.887987 18934 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:32.961127 19175 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7e9528f07a423f867a4b37f70f393a (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:32.962657 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7e9528f07a423f867a4b37f70f393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.971520 19174 tablet_service.cc:1511] Processing CreateTablet for tablet 3df35678fd6c405d968fc783932e2c31 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:32.973160 19174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df35678fd6c405d968fc783932e2c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.975971 19101 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7e9528f07a423f867a4b37f70f393a (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:32.979775 19100 tablet_service.cc:1511] Processing CreateTablet for tablet 3df35678fd6c405d968fc783932e2c31 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:32.981710 19093 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ce722544245dfabfd354155e2e37c (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:32.982267 19099 tablet_service.cc:1511] Processing CreateTablet for tablet bc50e64f9ea84679bbf186590aa95b5d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:32.983995 19098 tablet_service.cc:1511] Processing CreateTablet for tablet 8716512dd5a1460e9865680c5a01d1ac (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:32.985570 19101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7e9528f07a423f867a4b37f70f393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.983995 19094 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7a7625e5d4a34aa9e149add99c8bc (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:32.986553 19096 tablet_service.cc:1511] Processing CreateTablet for tablet c58ca828778f47f7aff3dbdd982bfeff (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:32.987290 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7a7625e5d4a34aa9e149add99c8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.985188 19095 tablet_service.cc:1511] Processing CreateTablet for tablet bfd127126b6741ceb829596fc15c2608 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:32.988762 19097 tablet_service.cc:1511] Processing CreateTablet for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:32.989816 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd127126b6741ceb829596fc15c2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.990482 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8716512dd5a1460e9865680c5a01d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.992684 19099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc50e64f9ea84679bbf186590aa95b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.995018 19173 tablet_service.cc:1511] Processing CreateTablet for tablet bc50e64f9ea84679bbf186590aa95b5d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:32.996500 19173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc50e64f9ea84679bbf186590aa95b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.996546 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ce722544245dfabfd354155e2e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.997298 19100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df35678fd6c405d968fc783932e2c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.999224 19097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.001024 19096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58ca828778f47f7aff3dbdd982bfeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.001763 19172 tablet_service.cc:1511] Processing CreateTablet for tablet 8716512dd5a1460e9865680c5a01d1ac (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:33.003201 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8716512dd5a1460e9865680c5a01d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.029598 19225 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.034324 19175 tablet_service.cc:1511] Processing CreateTablet for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:33.035969 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.042528 19174 tablet_service.cc:1511] Processing CreateTablet for tablet c58ca828778f47f7aff3dbdd982bfeff (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:33.044142 19174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58ca828778f47f7aff3dbdd982bfeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.047338 19226 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.048985 19225 tablet_bootstrap.cc:654] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.061053 19226 tablet_bootstrap.cc:654] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.063321 19171 tablet_service.cc:1511] Processing CreateTablet for tablet bfd127126b6741ceb829596fc15c2608 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:33.064845 19171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd127126b6741ceb829596fc15c2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.070011 19226 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.069875 19170 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7a7625e5d4a34aa9e149add99c8bc (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:33.070746 19226 ts_tablet_manager.cc:1403] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:26:33.071427 19170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7a7625e5d4a34aa9e149add99c8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.073773 19169 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ce722544245dfabfd354155e2e37c (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:33.074028 19226 raft_consensus.cc:359] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.075001 19226 raft_consensus.cc:385] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.075181 19169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ce722544245dfabfd354155e2e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.075400 19226 raft_consensus.cc:740] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.076578 19226 consensus_queue.cc:260] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.078336 19026 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7e9528f07a423f867a4b37f70f393a (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:33.079846 19022 tablet_service.cc:1511] Processing CreateTablet for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:33.081002 19136 heartbeater.cc:499] Master 127.6.182.190:38101 was elected leader, sending a full tablet report...
I20260709 12:26:33.081404 19025 tablet_service.cc:1511] Processing CreateTablet for tablet 3df35678fd6c405d968fc783932e2c31 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:33.082484 19021 tablet_service.cc:1511] Processing CreateTablet for tablet c58ca828778f47f7aff3dbdd982bfeff (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:33.083655 19024 tablet_service.cc:1511] Processing CreateTablet for tablet bc50e64f9ea84679bbf186590aa95b5d (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:33.084707 19020 tablet_service.cc:1511] Processing CreateTablet for tablet bfd127126b6741ceb829596fc15c2608 (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:33.086433 19023 tablet_service.cc:1511] Processing CreateTablet for tablet 8716512dd5a1460e9865680c5a01d1ac (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:33.087086 19019 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee7a7625e5d4a34aa9e149add99c8bc (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:33.088073 19225 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.079870 19026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7e9528f07a423f867a4b37f70f393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.088697 19225 ts_tablet_manager.cc:1403] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.007s
I20260709 12:26:33.089228 19023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8716512dd5a1460e9865680c5a01d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.090415 19018 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ce722544245dfabfd354155e2e37c (DEFAULT_TABLE table=test-workload [id=a95f40c8c0734ccc94e4c18a03273358]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:33.091697 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ce722544245dfabfd354155e2e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.092974 19025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df35678fd6c405d968fc783932e2c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.093591 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd127126b6741ceb829596fc15c2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.095011 19024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc50e64f9ea84679bbf186590aa95b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.096890 19225 raft_consensus.cc:359] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.097747 19225 raft_consensus.cc:385] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.098037 19225 raft_consensus.cc:740] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.098805 19225 consensus_queue.cc:260] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.100416 19021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58ca828778f47f7aff3dbdd982bfeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.101496 19226 ts_tablet_manager.cc:1434] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:26:33.102692 19226 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.105087 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee7a7625e5d4a34aa9e149add99c8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.108263 19022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7bd92848534ce6bcf9bdfdb96e3c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.113837 19226 tablet_bootstrap.cc:654] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.174616 19231 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.181946 19225 ts_tablet_manager.cc:1434] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.093s	user 0.031s	sys 0.025s
I20260709 12:26:33.183172 19225 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.183202 19210 heartbeater.cc:499] Master 127.6.182.190:38101 was elected leader, sending a full tablet report...
I20260709 12:26:33.188022 19226 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.188724 19226 ts_tablet_manager.cc:1403] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.011s
I20260709 12:26:33.189456 19225 tablet_bootstrap.cc:654] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.193569 19231 tablet_bootstrap.cc:654] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.192096 19226 raft_consensus.cc:359] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.195062 19226 raft_consensus.cc:385] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.195719 19226 raft_consensus.cc:740] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.196902 19226 consensus_queue.cc:260] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.198710 19231 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.199162 19231 ts_tablet_manager.cc:1403] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.008s
I20260709 12:26:33.199432 19226 ts_tablet_manager.cc:1434] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:33.200600 19226 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.202170 19231 raft_consensus.cc:359] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.203174 19231 raft_consensus.cc:385] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.203567 19231 raft_consensus.cc:740] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.204530 19231 consensus_queue.cc:260] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.208309 19226 tablet_bootstrap.cc:654] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.220613 19226 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.221294 19226 ts_tablet_manager.cc:1403] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 12:26:33.224735 19226 raft_consensus.cc:359] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.225692 19226 raft_consensus.cc:385] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.226047 19226 raft_consensus.cc:740] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.227208 19226 consensus_queue.cc:260] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.229777 19226 ts_tablet_manager.cc:1434] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:33.231037 19226 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.238054 19226 tablet_bootstrap.cc:654] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.250051 19226 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.250654 19226 ts_tablet_manager.cc:1403] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:26:33.254345 19226 raft_consensus.cc:359] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.255522 19229 raft_consensus.cc:493] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.256012 19226 raft_consensus.cc:385] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.256424 19226 raft_consensus.cc:740] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.256178 19229 raft_consensus.cc:515] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.257601 19226 consensus_queue.cc:260] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.260422 19225 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.262104 19061 heartbeater.cc:499] Master 127.6.182.190:38101 was elected leader, sending a full tablet report...
I20260709 12:26:33.262215 19225 ts_tablet_manager.cc:1403] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.048s
I20260709 12:26:33.262566 19231 ts_tablet_manager.cc:1434] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.063s	user 0.028s	sys 0.036s
I20260709 12:26:33.263681 19231 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.263598 19229 leader_election.cc:290] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.265825 19225 raft_consensus.cc:359] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.266695 19225 raft_consensus.cc:385] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.267088 19225 raft_consensus.cc:740] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.268172 19225 consensus_queue.cc:260] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.270156 19231 tablet_bootstrap.cc:654] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.270941 19225 ts_tablet_manager.cc:1434] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:33.272193 19225 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.272817 19226 ts_tablet_manager.cc:1434] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:26:33.274071 19226 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.280849 19226 tablet_bootstrap.cc:654] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.280911 19225 tablet_bootstrap.cc:654] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.293125 19226 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.293751 19226 ts_tablet_manager.cc:1403] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:26:33.296955 19226 raft_consensus.cc:359] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.297806 19226 raft_consensus.cc:385] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.298142 19226 raft_consensus.cc:740] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.299187 19226 consensus_queue.cc:260] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.302345 19226 ts_tablet_manager.cc:1434] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:33.303507 19226 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.310449 19226 tablet_bootstrap.cc:654] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.322677 19226 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.323283 19226 ts_tablet_manager.cc:1403] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:26:33.327030 19226 raft_consensus.cc:359] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.328114 19226 raft_consensus.cc:385] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.328538 19226 raft_consensus.cc:740] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.329875 19226 consensus_queue.cc:260] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.333000 19226 ts_tablet_manager.cc:1434] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:26:33.334199 19226 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.341899 19226 tablet_bootstrap.cc:654] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.354702 19226 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.355480 19226 ts_tablet_manager.cc:1403] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:26:33.359054 19226 raft_consensus.cc:359] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.360745 19226 raft_consensus.cc:385] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.361089 19226 raft_consensus.cc:740] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.362053 19226 consensus_queue.cc:260] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.363273 19238 raft_consensus.cc:493] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.364009 19238 raft_consensus.cc:515] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.366534 19226 ts_tablet_manager.cc:1434] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:33.366659 19238 leader_election.cc:290] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741), d1c90202bd65484886d7280434e09778 (127.6.182.129:39559)
I20260709 12:26:33.367709 19226 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.368465 19231 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.369052 19231 ts_tablet_manager.cc:1403] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.106s	user 0.033s	sys 0.067s
I20260709 12:26:33.370750 19225 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.371438 19225 ts_tablet_manager.cc:1403] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.062s
I20260709 12:26:33.372138 19231 raft_consensus.cc:359] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.372952 19231 raft_consensus.cc:385] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.373252 19231 raft_consensus.cc:740] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.374030 19231 consensus_queue.cc:260] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.374516 19226 tablet_bootstrap.cc:654] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.375365 19225 raft_consensus.cc:359] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.376305 19231 ts_tablet_manager.cc:1434] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:33.376317 19225 raft_consensus.cc:385] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.377478 19231 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.377559 19225 raft_consensus.cc:740] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.378734 19225 consensus_queue.cc:260] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.381521 19225 ts_tablet_manager.cc:1434] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:33.382701 19225 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.385639 19231 tablet_bootstrap.cc:654] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.386586 19226 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.387122 19226 ts_tablet_manager.cc:1403] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 12:26:33.390175 19225 tablet_bootstrap.cc:654] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.390430 19226 raft_consensus.cc:359] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.391435 19226 raft_consensus.cc:385] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.391786 19226 raft_consensus.cc:740] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.393057 19226 consensus_queue.cc:260] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.395860 19226 ts_tablet_manager.cc:1434] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:33.397104 19226 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:33.405179 19226 tablet_bootstrap.cc:654] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.408375 19238 raft_consensus.cc:493] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.409029 19238 raft_consensus.cc:515] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.411406 19238 leader_election.cc:290] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.418605 19226 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:33.419422 19226 ts_tablet_manager.cc:1403] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 12:26:33.422135 19238 raft_consensus.cc:493] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.422809 19238 raft_consensus.cc:515] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.425742 19238 leader_election.cc:290] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.428679 19226 raft_consensus.cc:359] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.430272 19226 raft_consensus.cc:385] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.430733 19226 raft_consensus.cc:740] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.431845 19226 consensus_queue.cc:260] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.432902 19035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.435212 19036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.436322 19036 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.438032 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.440140 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
W20260709 12:26:33.440585 18982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:33.441226 19034 raft_consensus.cc:2468] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.442044 19226 ts_tablet_manager.cc:1434] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.000s
W20260709 12:26:33.444161 19074 leader_election.cc:343] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.445290 19074 leader_election.cc:304] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.446491 19238 raft_consensus.cc:2804] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.447021 19238 raft_consensus.cc:493] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.447525 19238 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.452951 19231 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.453001 19225 tablet_bootstrap.cc:492] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.453868 19225 ts_tablet_manager.cc:1403] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.071s	user 0.030s	sys 0.033s
I20260709 12:26:33.453859 19231 ts_tablet_manager.cc:1403] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.046s
W20260709 12:26:33.454267 19074 leader_election.cc:343] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.455067 19074 leader_election.cc:304] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.455860 19229 raft_consensus.cc:2804] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.456233 19229 raft_consensus.cc:493] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.456573 19229 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.457289 19225 raft_consensus.cc:359] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.458092 19225 raft_consensus.cc:385] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.457844 19238 raft_consensus.cc:515] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.458455 19225 raft_consensus.cc:740] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.458328 19231 raft_consensus.cc:359] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.459729 19231 raft_consensus.cc:385] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.460177 19231 raft_consensus.cc:740] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.460182 19225 consensus_queue.cc:260] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.461926 19231 consensus_queue.cc:260] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.462770 19225 ts_tablet_manager.cc:1434] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:33.463881 19225 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.464984 19231 ts_tablet_manager.cc:1434] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:33.464761 19229 raft_consensus.cc:515] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.467121 19229 leader_election.cc:290] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.467890 19231 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.470636 19225 tablet_bootstrap.cc:654] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.471344 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.472005 19034 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.473996 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.474630 19033 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.477823 19231 tablet_bootstrap.cc:654] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.480363 19034 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.491775 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.493047 19185 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.497637 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.498351 19185 raft_consensus.cc:2468] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.499958 19185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.500715 19184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.500896 19074 leader_election.cc:304] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.501261 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.501962 19033 raft_consensus.cc:2468] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.460518 19238 leader_election.cc:290] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.502617 19074 leader_election.cc:304] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: d1c90202bd65484886d7280434e09778
I20260709 12:26:33.502869 19229 raft_consensus.cc:2804] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:33.503825 19074 leader_election.cc:343] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.502599 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.504815 19238 raft_consensus.cc:2804] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.504953 19074 leader_election.cc:304] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.505211 19183 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.505386 19238 raft_consensus.cc:493] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.506213 19238 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.516790 19229 raft_consensus.cc:697] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.517829 19252 raft_consensus.cc:2804] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.518487 19229 consensus_queue.cc:237] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.518627 19252 raft_consensus.cc:697] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.526014 19252 consensus_queue.cc:237] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.527386 19225 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.530200 19225 ts_tablet_manager.cc:1403] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.017s
W20260709 12:26:33.531244 19074 leader_election.cc:343] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.531379 19183 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.531807 19074 leader_election.cc:304] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2; no voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778
W20260709 12:26:33.533136 19074 leader_election.cc:343] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.533680 19253 raft_consensus.cc:2749] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:33.535653 19231 tablet_bootstrap.cc:492] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.536298 19231 ts_tablet_manager.cc:1403] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.029s
I20260709 12:26:33.536666 19225 raft_consensus.cc:359] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.537485 19225 raft_consensus.cc:385] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.537868 19225 raft_consensus.cc:740] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.538813 19225 consensus_queue.cc:260] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.540155 19231 raft_consensus.cc:359] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.541107 19231 raft_consensus.cc:385] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.541474 19231 raft_consensus.cc:740] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.541906 19225 ts_tablet_manager.cc:1434] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:26:33.541345 18933 catalog_manager.cc:5697] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.542429 19231 consensus_queue.cc:260] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.546963 19231 ts_tablet_manager.cc:1434] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:26:33.548053 19231 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.543340 19225 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.553161 19231 tablet_bootstrap.cc:654] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.554255 19238 raft_consensus.cc:515] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.564648 19225 tablet_bootstrap.cc:654] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.567934 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.570762 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.571448 19183 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.570530 19238 leader_election.cc:290] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741), d1c90202bd65484886d7280434e09778 (127.6.182.129:39559)
W20260709 12:26:33.573241 19074 leader_election.cc:343] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.583092 19183 raft_consensus.cc:2468] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.586536 19074 leader_election.cc:304] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: d1c90202bd65484886d7280434e09778
I20260709 12:26:33.587509 19238 raft_consensus.cc:2804] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.588109 19238 raft_consensus.cc:697] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.588133 19225 tablet_bootstrap.cc:492] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.589305 19225 ts_tablet_manager.cc:1403] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.011s
I20260709 12:26:33.589227 19238 consensus_queue.cc:237] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.591010 19231 tablet_bootstrap.cc:492] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.591657 19231 ts_tablet_manager.cc:1403] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.024s
I20260709 12:26:33.594898 19231 raft_consensus.cc:359] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.595153 19225 raft_consensus.cc:359] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.595671 19231 raft_consensus.cc:385] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.595898 19225 raft_consensus.cc:385] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.596009 19231 raft_consensus.cc:740] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.596364 19225 raft_consensus.cc:740] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.596977 19231 consensus_queue.cc:260] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.597301 19225 consensus_queue.cc:260] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.599695 19231 ts_tablet_manager.cc:1434] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:33.600754 19231 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.603965 19225 ts_tablet_manager.cc:1434] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:26:33.605257 19225 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.607494 19231 tablet_bootstrap.cc:654] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.613204 19225 tablet_bootstrap.cc:654] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.620033 19231 tablet_bootstrap.cc:492] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.620657 19231 ts_tablet_manager.cc:1403] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 12:26:33.623925 19231 raft_consensus.cc:359] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.624720 19231 raft_consensus.cc:385] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.625036 19231 raft_consensus.cc:740] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.625898 19231 consensus_queue.cc:260] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.629480 19231 ts_tablet_manager.cc:1434] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:26:33.629526 19238 raft_consensus.cc:493] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.630290 19238 raft_consensus.cc:515] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.630995 19231 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.629865 18931 catalog_manager.cc:5697] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.632611 19235 raft_consensus.cc:493] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.633158 19235 raft_consensus.cc:515] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.632889 18931 catalog_manager.cc:5697] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.634006 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.634755 19033 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.636261 19074 leader_election.cc:304] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.637264 19252 raft_consensus.cc:2804] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.637714 19252 raft_consensus.cc:493] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.638144 19252 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.638764 19238 leader_election.cc:290] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.639117 19231 tablet_bootstrap.cc:654] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.645409 19235 leader_election.cc:290] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.673265 19230 raft_consensus.cc:493] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.673992 19230 raft_consensus.cc:515] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.681609 19252 raft_consensus.cc:515] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.685101 19230 leader_election.cc:290] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:33.688038 19252 leader_election.cc:290] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.693060 19238 raft_consensus.cc:493] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.693919 19238 raft_consensus.cc:515] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.696856 19238 leader_election.cc:290] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.708076 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.708954 19033 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.711138 19225 tablet_bootstrap.cc:492] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.711350 19231 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.711850 19225 ts_tablet_manager.cc:1403] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.023s
I20260709 12:26:33.712170 19231 ts_tablet_manager.cc:1403] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.082s	user 0.037s	sys 0.043s
I20260709 12:26:33.715507 19231 raft_consensus.cc:359] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.716356 19231 raft_consensus.cc:385] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.715975 19225 raft_consensus.cc:359] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.716864 19231 raft_consensus.cc:740] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.716925 19225 raft_consensus.cc:385] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.717474 19225 raft_consensus.cc:740] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.718004 19231 consensus_queue.cc:260] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.718364 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7a7625e5d4a34aa9e149add99c8bc" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.719205 19034 raft_consensus.cc:2468] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.720386 19225 consensus_queue.cc:260] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.721251 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.721534 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.722016 19183 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:33.720715 19231 ts_tablet_manager.cc:1434] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:26:33.723325 18999 leader_election.cc:304] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.723831 19231 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.723480 19225 ts_tablet_manager.cc:1434] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 12:26:33.725240 19225 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.726022 19033 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.726657 19235 raft_consensus.cc:2764] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:33.727377 19252 raft_consensus.cc:493] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.727983 19252 raft_consensus.cc:515] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.730485 19252 leader_election.cc:290] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.732198 19225 tablet_bootstrap.cc:654] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.732223 19231 tablet_bootstrap.cc:654] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.734422 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7a7625e5d4a34aa9e149add99c8bc" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.735144 19183 raft_consensus.cc:2468] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.742553 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.744338 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.745021 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.745728 19182 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.747793 19238 raft_consensus.cc:493] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.748390 19238 raft_consensus.cc:515] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.750658 19238 leader_election.cc:290] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.751200 19238 raft_consensus.cc:493] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.751695 19238 raft_consensus.cc:515] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.753912 19238 leader_election.cc:290] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.755270 19235 raft_consensus.cc:493] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.755863 19235 raft_consensus.cc:515] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.760874 19235 leader_election.cc:290] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.764108 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
W20260709 12:26:33.765761 18999 leader_election.cc:343] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.768221 19230 raft_consensus.cc:493] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.768900 19230 raft_consensus.cc:515] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.771319 19230 leader_election.cc:290] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:33.762308 19074 leader_election.cc:304] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:33.774318 19252 raft_consensus.cc:2804] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.774726 19252 raft_consensus.cc:493] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.775099 19252 raft_consensus.cc:3060] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:33.781042 19074 leader_election.cc:343] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.781508 19182 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.782567 19074 leader_election.cc:304] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.783641 19238 raft_consensus.cc:2804] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.784427 19238 raft_consensus.cc:697] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.785329 19238 consensus_queue.cc:237] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.786653 19225 tablet_bootstrap.cc:492] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.787165 19225 ts_tablet_manager.cc:1403] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.062s	user 0.034s	sys 0.023s
I20260709 12:26:33.788573 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.789533 19034 raft_consensus.cc:2393] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b970a14f55ef43f79c3eccd96a59e1d0 in current term 1: Already voted for candidate bc7db1d10d934fe78d833139b8501fa2 in this term.
I20260709 12:26:33.789786 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.790118 19225 raft_consensus.cc:359] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.790972 19225 raft_consensus.cc:385] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.790659 19231 tablet_bootstrap.cc:492] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.791353 19225 raft_consensus.cc:740] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.792007 19231 ts_tablet_manager.cc:1403] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.028s
I20260709 12:26:33.793180 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:33.793493 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:33.794027 19111 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 0.
I20260709 12:26:33.794905 19231 raft_consensus.cc:359] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.795485 19150 leader_election.cc:304] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0; no voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778
I20260709 12:26:33.796638 19230 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.797329 19150 leader_election.cc:304] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:33.795707 19225 consensus_queue.cc:260] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.803696 18933 catalog_manager.cc:5697] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.795655 19231 raft_consensus.cc:385] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.808483 19231 raft_consensus.cc:740] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.809641 19231 consensus_queue.cc:260] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.812640 19231 ts_tablet_manager.cc:1434] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:26:33.814105 19276 raft_consensus.cc:2804] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.814570 19276 raft_consensus.cc:493] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.814915 19276 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.814989 19225 ts_tablet_manager.cc:1434] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.013s
I20260709 12:26:33.790575 19033 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 0.
W20260709 12:26:33.783716 19074 leader_election.cc:343] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:33.823113 19276 raft_consensus.cc:515] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.795360 19252 raft_consensus.cc:515] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.823760 19074 leader_election.cc:304] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2; no voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778
I20260709 12:26:33.824553 19230 raft_consensus.cc:2749] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:33.824753 19238 raft_consensus.cc:2749] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:33.826400 19252 leader_election.cc:290] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.826253 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58ca828778f47f7aff3dbdd982bfeff" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.827157 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:33.827502 19033 raft_consensus.cc:2468] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.827845 19034 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.830487 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:33.830858 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:33.831596 19110 raft_consensus.cc:2468] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:33.832494 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58ca828778f47f7aff3dbdd982bfeff" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.833317 19182 raft_consensus.cc:2468] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:33.823725 19225 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:33.834964 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.835403 19231 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:33.836973 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7a7625e5d4a34aa9e149add99c8bc" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.837347 19001 leader_election.cc:304] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:33.837750 19183 raft_consensus.cc:3060] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.838737 19235 raft_consensus.cc:2804] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.839136 19235 raft_consensus.cc:493] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.839495 19235 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.842393 19231 tablet_bootstrap.cc:654] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.843250 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee7a7625e5d4a34aa9e149add99c8bc" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.844002 19033 raft_consensus.cc:3060] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.848330 19074 leader_election.cc:304] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.849536 19252 raft_consensus.cc:2804] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.849681 19074 leader_election.cc:304] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.849942 19252 raft_consensus.cc:493] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.850297 19252 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.851574 19238 raft_consensus.cc:2804] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:33.852084 19238 raft_consensus.cc:493] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.852505 19238 raft_consensus.cc:3060] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.854576 19183 raft_consensus.cc:2468] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.854846 19235 raft_consensus.cc:515] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.858906 19033 raft_consensus.cc:2468] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.861132 19074 leader_election.cc:304] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.861394 19225 tablet_bootstrap.cc:654] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.861871 19253 raft_consensus.cc:2804] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.862375 19253 raft_consensus.cc:697] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.862805 19235 leader_election.cc:290] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.863306 19252 raft_consensus.cc:515] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.871940 19184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.864765 19253 consensus_queue.cc:237] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.873899 19231 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:33.874402 19231 ts_tablet_manager.cc:1403] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:26:33.865116 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.867250 19276 leader_election.cc:290] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:33.875901 19183 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.872556 19238 raft_consensus.cc:515] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.877398 19231 raft_consensus.cc:359] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.878116 19231 raft_consensus.cc:385] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.878386 19231 raft_consensus.cc:740] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.878935 19238 leader_election.cc:290] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.879189 19231 consensus_queue.cc:260] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.879684 19036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58ca828778f47f7aff3dbdd982bfeff" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.880334 19036 raft_consensus.cc:3060] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.867920 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:33.881421 19111 raft_consensus.cc:2393] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b970a14f55ef43f79c3eccd96a59e1d0 in current term 1: Already voted for candidate bc7db1d10d934fe78d833139b8501fa2 in this term.
I20260709 12:26:33.881742 19231 ts_tablet_manager.cc:1434] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:26:33.864007 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:33.883252 19110 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.870484 19252 leader_election.cc:290] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:33.871156 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.889098 19034 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.890800 19110 raft_consensus.cc:2468] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:33.891359 19183 raft_consensus.cc:2468] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:33.865649 19182 raft_consensus.cc:2393] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc7db1d10d934fe78d833139b8501fa2 in current term 1: Already voted for candidate b970a14f55ef43f79c3eccd96a59e1d0 in this term.
I20260709 12:26:33.892752 18999 leader_election.cc:304] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.893836 19235 raft_consensus.cc:2804] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.894174 19225 tablet_bootstrap.cc:492] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:33.894752 19225 ts_tablet_manager.cc:1403] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
I20260709 12:26:33.897639 19225 raft_consensus.cc:359] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.898280 19225 raft_consensus.cc:385] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.898636 19225 raft_consensus.cc:740] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.868037 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:33.899557 19225 consensus_queue.cc:260] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.899096 18933 catalog_manager.cc:5697] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.902607 19034 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.904738 19225 ts_tablet_manager.cc:1434] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:26:33.904872 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58ca828778f47f7aff3dbdd982bfeff" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:33.912293 19182 raft_consensus.cc:3060] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.887682 19036 raft_consensus.cc:2468] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.907629 19148 leader_election.cc:304] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0; no voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778
I20260709 12:26:33.914790 19235 raft_consensus.cc:697] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:33.915261 19276 raft_consensus.cc:2749] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:33.907505 19281 raft_consensus.cc:493] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.915822 19235 consensus_queue.cc:237] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.916561 19281 raft_consensus.cc:515] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:33.918169 19252 consensus_queue.cc:1048] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:33.919098 19281 leader_election.cc:290] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:33.919641 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:33.920450 19183 raft_consensus.cc:2393] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1c90202bd65484886d7280434e09778 in current term 1: Already voted for candidate bc7db1d10d934fe78d833139b8501fa2 in this term.
I20260709 12:26:33.913852 19074 leader_election.cc:304] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:33.925387 19182 raft_consensus.cc:2468] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:33.926429 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:33.927863 19074 leader_election.cc:304] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:33.928468 19252 raft_consensus.cc:2804] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.928797 19253 raft_consensus.cc:2804] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.929185 19252 raft_consensus.cc:697] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.930500 19001 leader_election.cc:304] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:33.931361 19235 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.929738 18931 catalog_manager.cc:5697] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.930918 19252 consensus_queue.cc:237] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.929454 19253 raft_consensus.cc:697] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:33.933399 19253 consensus_queue.cc:237] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:33.940384 19235 raft_consensus.cc:2749] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:33.959007 18931 catalog_manager.cc:5697] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.960848 18931 catalog_manager.cc:5697] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.962311 19252 consensus_queue.cc:1048] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:33.986515 19252 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:33.998476 19253 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.005299 19235 raft_consensus.cc:493] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.005887 19235 raft_consensus.cc:515] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.008314 19235 leader_election.cc:290] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.010016 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:34.010869 19110 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:34.012127 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:34.012308 19001 leader_election.cc:304] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.012876 19182 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:34.013422 19235 raft_consensus.cc:2804] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.013836 19235 raft_consensus.cc:493] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.014251 19235 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.020206 19235 raft_consensus.cc:515] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.022095 19235 leader_election.cc:290] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.022917 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.023187 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.023524 19110 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.023918 19182 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.029044 19110 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:34.030102 19182 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:34.030303 19001 leader_election.cc:304] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.031176 19235 raft_consensus.cc:2804] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:34.031663 19235 raft_consensus.cc:697] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.032469 19235 consensus_queue.cc:237] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.040020 18934 catalog_manager.cc:5697] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.152141 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:34.152709 19110 raft_consensus.cc:606] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:34.158424 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:34.159065 19110 raft_consensus.cc:606] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:34.159963 19252 consensus_queue.cc:1048] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.165388 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:34.165894 19110 raft_consensus.cc:606] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:34.167524 19238 raft_consensus.cc:993] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.167943 19238 raft_consensus.cc:1081] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.169557 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:34.170284 19034 raft_consensus.cc:493] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.170681 19034 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.176913 19253 consensus_queue.cc:1048] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.178447 19034 raft_consensus.cc:515] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:34.180858 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:34.183163 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.182160 19110 raft_consensus.cc:606] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:34.187687 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7e9528f07a423f867a4b37f70f393a" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.188362 19110 raft_consensus.cc:3055] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.188750 19110 raft_consensus.cc:740] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:34.189828 19110 consensus_queue.cc:260] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:34.191210 19110 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.192741 19034 leader_election.cc:290] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:34.200647 19110 raft_consensus.cc:2468] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.202867 19001 leader_election.cc:304] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:34.203722 19235 raft_consensus.cc:2804] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.204695 19235 raft_consensus.cc:697] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.205705 19235 consensus_queue.cc:237] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } }
I20260709 12:26:34.207274 19253 consensus_queue.cc:1048] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.207696 19034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:26:34.208465 19034 raft_consensus.cc:606] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Received request to transfer leadership to TS bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:34.214831 18931 catalog_manager.cc:5697] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.227653 19253 consensus_queue.cc:1048] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.229624 19034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:26:34.230470 19034 raft_consensus.cc:606] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:34.236527 19252 raft_consensus.cc:993] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.237056 19253 raft_consensus.cc:1081] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.238623 19036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:34.239221 19036 raft_consensus.cc:493] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.239650 19036 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.245976 19036 raft_consensus.cc:515] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.247959 19036 leader_election.cc:290] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.249104 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.249199 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc50e64f9ea84679bbf186590aa95b5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.249913 19182 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.249972 19110 raft_consensus.cc:3055] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.250398 19110 raft_consensus.cc:740] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:34.251188 19110 consensus_queue.cc:260] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.252202 19110 raft_consensus.cc:3060] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.257004 19253 consensus_queue.cc:1048] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:34.257551 19182 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.258771 19110 raft_consensus.cc:2468] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.258929 18999 leader_election.cc:304] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.260083 19235 raft_consensus.cc:2804] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.260654 19235 raft_consensus.cc:697] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.261636 19235 consensus_queue.cc:237] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.272962 19229 consensus_queue.cc:1048] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.275630 18934 catalog_manager.cc:5697] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.335909 19235 consensus_queue.cc:1048] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.343446 19281 raft_consensus.cc:993] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: : Instructing follower bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:34.344043 19280 raft_consensus.cc:1081] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Signalling peer bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:34.347126 19111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:33940
I20260709 12:26:34.347862 19111 raft_consensus.cc:493] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.348289 19111 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.349584 19281 consensus_queue.cc:1048] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:34.355963 19111 raft_consensus.cc:515] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.357628 19229 consensus_queue.cc:1048] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:34.361564 19036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:34.362143 19036 raft_consensus.cc:3055] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.362488 19036 raft_consensus.cc:740] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.363445 19036 consensus_queue.cc:260] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.364950 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd127126b6741ceb829596fc15c2608" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.365303 19036 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.365687 19183 raft_consensus.cc:3060] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.363901 19111 leader_election.cc:290] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.376550 19036 raft_consensus.cc:2468] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:34.377718 19074 leader_election.cc:304] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.378221 19183 raft_consensus.cc:2468] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:34.378592 19238 raft_consensus.cc:2804] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.379134 19238 raft_consensus.cc:697] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:34.380012 19238 consensus_queue.cc:237] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.387589 19238 consensus_queue.cc:1048] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.391116 18931 catalog_manager.cc:5697] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 1 to 2, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.397173 19229 raft_consensus.cc:993] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.397761 19238 raft_consensus.cc:1081] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.399477 19036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:34.400017 19036 raft_consensus.cc:493] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.400426 19036 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.405571 19036 raft_consensus.cc:515] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.408104 19036 leader_election.cc:290] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.408139 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.408378 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df35678fd6c405d968fc783932e2c31" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.408846 19111 raft_consensus.cc:3055] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.409104 19183 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.409289 19111 raft_consensus.cc:740] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:34.410215 19111 consensus_queue.cc:260] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.411240 19111 raft_consensus.cc:3060] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.417142 19183 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.418444 18999 leader_election.cc:304] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.419166 19281 raft_consensus.cc:2804] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.419615 19281 raft_consensus.cc:697] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.419680 19111 raft_consensus.cc:2468] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.420433 19281 consensus_queue.cc:237] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.427222 18934 catalog_manager.cc:5697] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.464442 19281 consensus_queue.cc:1048] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:34.471441 19235 raft_consensus.cc:993] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:34.472062 19235 raft_consensus.cc:1081] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:34.474946 19238 consensus_queue.cc:1048] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:34.478104 19183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37888
I20260709 12:26:34.479737 19183 raft_consensus.cc:493] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.480195 19183 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.478371 19281 consensus_queue.cc:1048] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:34.489039 19183 raft_consensus.cc:515] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.492728 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:34.493458 19034 raft_consensus.cc:3055] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.493830 19034 raft_consensus.cc:740] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.494726 19034 consensus_queue.cc:260] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.495754 19034 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.496052 19229 consensus_queue.cc:1048] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:34.506748 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ce722544245dfabfd354155e2e37c" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.507417 19111 raft_consensus.cc:3060] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.509577 19183 leader_election.cc:290] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:34.511142 19034 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:34.512585 19148 leader_election.cc:304] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.513504 19276 raft_consensus.cc:2804] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.516358 19276 raft_consensus.cc:697] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:34.517001 19111 raft_consensus.cc:2468] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:34.517414 19276 consensus_queue.cc:237] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.525525 18933 catalog_manager.cc:5697] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 1 to 2, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.599511 19253 raft_consensus.cc:993] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.600013 19229 raft_consensus.cc:1081] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:34.602033 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:34.602586 19034 raft_consensus.cc:493] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.602923 19034 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.608485 19034 raft_consensus.cc:515] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.610817 19034 leader_election.cc:290] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:34.611937 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:34.612535 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:34.612756 19182 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.613547 19111 raft_consensus.cc:3055] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.613903 19111 raft_consensus.cc:740] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:34.614718 19111 consensus_queue.cc:260] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.615659 19111 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.618312 19182 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.619436 18999 leader_election.cc:304] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:34.620200 19281 raft_consensus.cc:2804] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.620712 19281 raft_consensus.cc:697] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:34.621637 19111 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:34.621582 19281 consensus_queue.cc:237] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:34.629292 18933 catalog_manager.cc:5697] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.682108 19182 raft_consensus.cc:1275] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.683713 19281 consensus_queue.cc:1048] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.694871 19111 raft_consensus.cc:1275] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.696694 19235 consensus_queue.cc:1048] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:34.748090 19111 raft_consensus.cc:1275] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.749593 19235 consensus_queue.cc:1048] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.757568 19182 raft_consensus.cc:3060] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.766664 19182 raft_consensus.cc:1275] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.768034 19280 consensus_queue.cc:1048] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.772866 19183 raft_consensus.cc:1275] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.774497 19229 consensus_queue.cc:1048] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.783186 19034 raft_consensus.cc:1275] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.784945 19253 consensus_queue.cc:1048] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.905848 19182 raft_consensus.cc:1275] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.907302 19280 consensus_queue.cc:1048] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.915741 19111 raft_consensus.cc:1275] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.918195 19281 consensus_queue.cc:1048] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.937853 19034 raft_consensus.cc:1275] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.939231 19276 consensus_queue.cc:1048] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.948355 19111 raft_consensus.cc:1275] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.951599 19276 consensus_queue.cc:1048] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:35.004504 19111 raft_consensus.cc:1275] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.006081 19281 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:35.015704 19182 raft_consensus.cc:1275] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:35.017831 19235 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:37.259671 18933 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34010:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:37.261965 18933 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:37.318145 19018 tablet_service.cc:1511] Processing CreateTablet for tablet df680f08a2aa469c928b848030d5029d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:37.319634 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df680f08a2aa469c928b848030d5029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.319401 19100 tablet_service.cc:1511] Processing CreateTablet for tablet df680f08a2aa469c928b848030d5029d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:37.320835 19100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df680f08a2aa469c928b848030d5029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.324291 19169 tablet_service.cc:1511] Processing CreateTablet for tablet df680f08a2aa469c928b848030d5029d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:37.325613 19169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df680f08a2aa469c928b848030d5029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.327317 19095 tablet_service.cc:1511] Processing CreateTablet for tablet 6e918acb589c488282a71166310258b7 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:37.328684 19095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e918acb589c488282a71166310258b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.331914 19021 tablet_service.cc:1511] Processing CreateTablet for tablet 6e918acb589c488282a71166310258b7 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:37.332371 19170 tablet_service.cc:1511] Processing CreateTablet for tablet 6e918acb589c488282a71166310258b7 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:37.333302 19021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e918acb589c488282a71166310258b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.333763 19170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e918acb589c488282a71166310258b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.335769 19099 tablet_service.cc:1511] Processing CreateTablet for tablet 029daf5884644353added74966bd7d14 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:37.336267 19020 tablet_service.cc:1511] Processing CreateTablet for tablet 029daf5884644353added74966bd7d14 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:37.336308 19025 tablet_service.cc:1511] Processing CreateTablet for tablet 021b8d711c2749db812941f3f2d5f929 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:37.337150 19099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029daf5884644353added74966bd7d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.337870 19020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029daf5884644353added74966bd7d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.338289 19171 tablet_service.cc:1511] Processing CreateTablet for tablet 029daf5884644353added74966bd7d14 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:37.339594 19171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029daf5884644353added74966bd7d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.339809 19025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021b8d711c2749db812941f3f2d5f929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.358243 19098 tablet_service.cc:1511] Processing CreateTablet for tablet 021b8d711c2749db812941f3f2d5f929 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:37.359709 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021b8d711c2749db812941f3f2d5f929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.363724 19022 tablet_service.cc:1511] Processing CreateTablet for tablet 4968ba898eb3417b80307e2a42900a5d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:37.365113 19022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4968ba898eb3417b80307e2a42900a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.366061 19175 tablet_service.cc:1511] Processing CreateTablet for tablet 021b8d711c2749db812941f3f2d5f929 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:37.367357 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021b8d711c2749db812941f3f2d5f929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.371662 19094 tablet_service.cc:1511] Processing CreateTablet for tablet 4968ba898eb3417b80307e2a42900a5d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:37.373049 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4968ba898eb3417b80307e2a42900a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.377261 19174 tablet_service.cc:1511] Processing CreateTablet for tablet 4968ba898eb3417b80307e2a42900a5d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:37.378842 19174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4968ba898eb3417b80307e2a42900a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.383152 19026 tablet_service.cc:1511] Processing CreateTablet for tablet 89509444255047439b32c2e05ac58aed (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:37.384660 19026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89509444255047439b32c2e05ac58aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.394886 19097 tablet_service.cc:1511] Processing CreateTablet for tablet 89509444255047439b32c2e05ac58aed (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:37.397006 19097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89509444255047439b32c2e05ac58aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.401530 19172 tablet_service.cc:1511] Processing CreateTablet for tablet 89509444255047439b32c2e05ac58aed (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:37.403296 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89509444255047439b32c2e05ac58aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.429850 19025 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ef2ec66c34228a038ae41a288979d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:37.436017 19324 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.437209 19025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ef2ec66c34228a038ae41a288979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.437870 19099 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ef2ec66c34228a038ae41a288979d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:37.439435 19099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ef2ec66c34228a038ae41a288979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.440857 19326 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.448853 19022 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:37.450322 19022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.461824 19170 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:37.462636 19175 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ef2ec66c34228a038ae41a288979d (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:37.463416 19170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.464146 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ef2ec66c34228a038ae41a288979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.465591 19098 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061 (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:37.466995 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe3ea2a5e04e0eb3c6e65ef4907061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.469545 19326 tablet_bootstrap.cc:654] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.470808 19325 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.469388 19324 tablet_bootstrap.cc:654] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.478387 19018 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8af1f56bed48c089512b176aa5b97b (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:37.479835 19018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8af1f56bed48c089512b176aa5b97b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:37.483165 18982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:37.484974 19094 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8af1f56bed48c089512b176aa5b97b (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:37.486418 19094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8af1f56bed48c089512b176aa5b97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.502084 19325 tablet_bootstrap.cc:654] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.510988 19170 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8af1f56bed48c089512b176aa5b97b (DEFAULT_TABLE table=soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:37.521042 19170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8af1f56bed48c089512b176aa5b97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.551124 19324 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.551779 19324 ts_tablet_manager.cc:1403] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.025s
I20260709 12:26:37.554339 19326 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.554939 19326 ts_tablet_manager.cc:1403] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.027s
I20260709 12:26:37.559216 19325 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.559795 19325 ts_tablet_manager.cc:1403] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.000s
I20260709 12:26:37.559705 19324 raft_consensus.cc:359] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.560727 19324 raft_consensus.cc:385] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.561091 19324 raft_consensus.cc:740] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.561977 19324 consensus_queue.cc:260] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.563223 19325 raft_consensus.cc:359] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.564029 19325 raft_consensus.cc:385] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.564318 19325 raft_consensus.cc:740] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.564915 19326 raft_consensus.cc:359] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.567544 19326 raft_consensus.cc:385] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.567975 19326 raft_consensus.cc:740] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.568984 19326 consensus_queue.cc:260] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.569872 19324 ts_tablet_manager.cc:1434] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:26:37.570890 19324 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.573436 19326 ts_tablet_manager.cc:1434] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 12:26:37.574556 19326 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.578151 19324 tablet_bootstrap.cc:654] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.565121 19325 consensus_queue.cc:260] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.582288 19326 tablet_bootstrap.cc:654] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.587397 19325 ts_tablet_manager.cc:1434] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 12:26:37.591782 19325 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.598412 19325 tablet_bootstrap.cc:654] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.601635 19326 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.602329 19326 ts_tablet_manager.cc:1403] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 12:26:37.604730 19324 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.605123 19325 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.605311 19324 ts_tablet_manager.cc:1403] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.012s
I20260709 12:26:37.605775 19325 ts_tablet_manager.cc:1403] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:26:37.605157 19326 raft_consensus.cc:359] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.606212 19326 raft_consensus.cc:385] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.606482 19326 raft_consensus.cc:740] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.607191 19326 consensus_queue.cc:260] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.608739 19324 raft_consensus.cc:359] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.609280 19326 ts_tablet_manager.cc:1434] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:37.609020 19325 raft_consensus.cc:359] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.609575 19324 raft_consensus.cc:385] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.609771 19325 raft_consensus.cc:385] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.609941 19324 raft_consensus.cc:740] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.610105 19325 raft_consensus.cc:740] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.610383 19326 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.610802 19324 consensus_queue.cc:260] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.611109 19325 consensus_queue.cc:260] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.613364 19324 ts_tablet_manager.cc:1434] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:37.613458 19325 ts_tablet_manager.cc:1434] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:37.614372 19325 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.614382 19324 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.621934 19325 tablet_bootstrap.cc:654] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.621937 19324 tablet_bootstrap.cc:654] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.629112 19326 tablet_bootstrap.cc:654] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.640280 19324 tablet_bootstrap.cc:492] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.640857 19325 tablet_bootstrap.cc:492] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.640857 19324 ts_tablet_manager.cc:1403] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 12:26:37.641671 19325 ts_tablet_manager.cc:1403] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:26:37.641958 19326 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.642545 19326 ts_tablet_manager.cc:1403] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.005s
I20260709 12:26:37.644613 19313 raft_consensus.cc:493] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.644389 19324 raft_consensus.cc:359] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.644914 19325 raft_consensus.cc:359] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.645241 19324 raft_consensus.cc:385] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.645701 19325 raft_consensus.cc:385] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.645246 19313 raft_consensus.cc:515] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.645803 19324 raft_consensus.cc:740] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.646071 19325 raft_consensus.cc:740] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.646806 19324 consensus_queue.cc:260] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.662480 19325 consensus_queue.cc:260] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.666154 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:37.670198 19111 raft_consensus.cc:2468] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 0.
I20260709 12:26:37.671725 19150 leader_election.cc:304] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:37.648986 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:37.676873 19252 raft_consensus.cc:493] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:37.678838 19148 leader_election.cc:343] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:37.678632 19252 raft_consensus.cc:515] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.669482 19313 leader_election.cc:290] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:37.681722 19313 raft_consensus.cc:2804] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:37.682154 19313 raft_consensus.cc:493] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.682505 19313 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.663533 19326 raft_consensus.cc:359] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.686520 19326 raft_consensus.cc:385] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.686854 19326 raft_consensus.cc:740] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.689248 19252 leader_election.cc:290] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:37.689015 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:37.690933 19034 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:37.692301 19074 leader_election.cc:304] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:37.693226 19252 raft_consensus.cc:2804] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:37.693652 19252 raft_consensus.cc:493] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.694005 19252 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.697691 19326 consensus_queue.cc:260] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.709537 19326 ts_tablet_manager.cc:1434] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:26:37.710668 19326 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Bootstrap starting.
W20260709 12:26:37.716095 19150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.182.130:43605, user_credentials={real_user=slave}} blocked reactor thread for 44472.5us
I20260709 12:26:37.717615 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:37.718255 19183 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:37.720067 19252 raft_consensus.cc:515] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.723904 19313 raft_consensus.cc:515] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.727121 19324 ts_tablet_manager.cc:1434] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.086s	user 0.021s	sys 0.062s
I20260709 12:26:37.728437 19326 tablet_bootstrap.cc:654] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.728796 19324 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.738516 19324 tablet_bootstrap.cc:654] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.740284 19326 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.740991 19326 ts_tablet_manager.cc:1403] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 12:26:37.744360 19326 raft_consensus.cc:359] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.745152 19326 raft_consensus.cc:385] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.745465 19326 raft_consensus.cc:740] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.746630 19326 consensus_queue.cc:260] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.748307 19325 ts_tablet_manager.cc:1434] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.106s	user 0.035s	sys 0.060s
I20260709 12:26:37.749910 19325 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.756011 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:37.756243 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:37.756709 19034 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.756916 19182 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.762796 19325 tablet_bootstrap.cc:654] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.765053 19182 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:37.767125 19036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:37.769871 19324 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.773870 19324 ts_tablet_manager.cc:1403] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
W20260709 12:26:37.774358 19148 leader_election.cc:343] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:37.769447 19034 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:37.768683 19313 leader_election.cc:290] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:37.769925 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:37.775442 19111 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.776037 19074 leader_election.cc:304] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:37.777036 19336 raft_consensus.cc:2804] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.777581 19336 raft_consensus.cc:697] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:37.778560 19326 ts_tablet_manager.cc:1434] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:26:37.778476 19336 consensus_queue.cc:237] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.771697 19252 leader_election.cc:290] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:37.786759 19325 tablet_bootstrap.cc:492] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.787338 19325 ts_tablet_manager.cc:1403] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.014s
I20260709 12:26:37.787863 19326 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.786939 19324 raft_consensus.cc:359] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.788538 19111 raft_consensus.cc:2468] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 1.
I20260709 12:26:37.790134 19150 leader_election.cc:304] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: d1c90202bd65484886d7280434e09778
I20260709 12:26:37.791302 19313 raft_consensus.cc:2804] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.791781 19313 raft_consensus.cc:697] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:37.792161 19325 raft_consensus.cc:359] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.792961 19325 raft_consensus.cc:385] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.792655 19313 consensus_queue.cc:237] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.793251 19325 raft_consensus.cc:740] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.794124 19325 consensus_queue.cc:260] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.795423 19324 raft_consensus.cc:385] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.795739 19324 raft_consensus.cc:740] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.797204 19337 raft_consensus.cc:493] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.799036 19324 consensus_queue.cc:260] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.799114 19337 raft_consensus.cc:515] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.800546 19326 tablet_bootstrap.cc:654] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.801597 19324 ts_tablet_manager.cc:1434] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 12:26:37.803417 19337 leader_election.cc:290] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:37.803546 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:37.803640 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:37.803804 19324 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.804765 19034 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 0.
I20260709 12:26:37.807132 19148 leader_election.cc:304] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:37.808578 19337 raft_consensus.cc:2804] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:37.809171 19337 raft_consensus.cc:493] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.809639 19337 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.805275 19111 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 0.
I20260709 12:26:37.811751 18934 catalog_manager.cc:5697] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.815061 19325 ts_tablet_manager.cc:1434] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 12:26:37.820552 19325 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.821139 19324 tablet_bootstrap.cc:654] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.827960 19325 tablet_bootstrap.cc:654] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.827414 18933 catalog_manager.cc:5697] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.839866 19324 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.840453 19324 ts_tablet_manager.cc:1403] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.007s
I20260709 12:26:37.844251 19324 raft_consensus.cc:359] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.845088 19324 raft_consensus.cc:385] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.845541 19324 raft_consensus.cc:740] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.845407 19337 raft_consensus.cc:515] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.846663 19324 consensus_queue.cc:260] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.847931 19337 leader_election.cc:290] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:37.848670 19326 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.849099 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:37.849733 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:37.850013 19034 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.850082 19326 ts_tablet_manager.cc:1403] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.005s
I20260709 12:26:37.850533 19325 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.850394 19111 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.851172 19325 ts_tablet_manager.cc:1403] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 12:26:37.860176 19111 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 1.
I20260709 12:26:37.865477 19325 raft_consensus.cc:359] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.862576 19324 ts_tablet_manager.cc:1434] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:26:37.863221 19034 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 1.
I20260709 12:26:37.863549 19326 raft_consensus.cc:359] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.867906 19324 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.871295 19326 raft_consensus.cc:385] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.871709 19326 raft_consensus.cc:740] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.866593 19325 raft_consensus.cc:385] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.872416 19326 consensus_queue.cc:260] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.872831 19325 raft_consensus.cc:740] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.873880 19325 consensus_queue.cc:260] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.875385 19326 ts_tablet_manager.cc:1434] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 12:26:37.876575 19326 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.876772 19325 ts_tablet_manager.cc:1434] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.002s
I20260709 12:26:37.877592 19324 tablet_bootstrap.cc:654] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.877910 19325 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.885071 19326 tablet_bootstrap.cc:654] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.868875 19150 leader_election.cc:304] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:37.890015 19337 raft_consensus.cc:2804] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.890698 19337 raft_consensus.cc:697] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:37.891832 19337 consensus_queue.cc:237] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.897432 19325 tablet_bootstrap.cc:654] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.905675 19336 raft_consensus.cc:493] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.906533 19336 raft_consensus.cc:515] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.909963 19336 leader_election.cc:290] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:37.912483 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:37.913157 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:37.913501 19182 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:37.914202 19034 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:37.915521 19074 leader_election.cc:304] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:37.916685 19252 raft_consensus.cc:2804] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:37.917141 19252 raft_consensus.cc:493] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.917588 19252 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.923075 19325 tablet_bootstrap.cc:492] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:37.924031 19325 ts_tablet_manager.cc:1403] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.003s
I20260709 12:26:37.928131 19325 raft_consensus.cc:359] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.936231 19325 raft_consensus.cc:385] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.936759 19325 raft_consensus.cc:740] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.939821 19252 raft_consensus.cc:515] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.942615 19325 consensus_queue.cc:260] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.944877 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:37.945640 19034 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.946985 19325 ts_tablet_manager.cc:1434] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.006s
I20260709 12:26:37.946709 18931 catalog_manager.cc:5697] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.948683 19325 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:37.955683 19034 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:37.957949 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:37.958890 19182 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.960698 19325 tablet_bootstrap.cc:654] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.962028 19281 raft_consensus.cc:493] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.962818 19281 raft_consensus.cc:515] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.966442 19182 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:37.968101 19252 leader_election.cc:290] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:37.968365 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:37.969522 19111 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:37.970996 19001 leader_election.cc:304] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:37.972309 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:37.972504 19326 tablet_bootstrap.cc:492] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:37.973284 19182 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:37.973409 19326 ts_tablet_manager.cc:1403] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.097s	user 0.053s	sys 0.035s
I20260709 12:26:37.974208 19281 leader_election.cc:290] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:37.975587 19324 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:37.976063 19324 ts_tablet_manager.cc:1403] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.108s	user 0.032s	sys 0.028s
I20260709 12:26:37.972693 19074 leader_election.cc:304] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:37.977039 19252 raft_consensus.cc:2804] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.978258 19252 raft_consensus.cc:697] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:37.978194 19326 raft_consensus.cc:359] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.979354 19326 raft_consensus.cc:385] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.979147 19324 raft_consensus.cc:359] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.979388 19252 consensus_queue.cc:237] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.980844 19324 raft_consensus.cc:385] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.981309 19324 raft_consensus.cc:740] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.982242 19324 consensus_queue.cc:260] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.979980 19357 raft_consensus.cc:2804] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:37.980000 19326 raft_consensus.cc:740] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.983587 19357 raft_consensus.cc:493] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.984035 19357 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.984200 19326 consensus_queue.cc:260] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:37.986287 19324 ts_tablet_manager.cc:1434] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:26:37.987197 19326 ts_tablet_manager.cc:1434] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:37.987922 19324 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:37.988425 19326 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:37.996433 19324 tablet_bootstrap.cc:654] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.997922 19326 tablet_bootstrap.cc:654] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.997633 19357 raft_consensus.cc:515] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.000641 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.001240 19111 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.013099 19111 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:38.012490 18931 catalog_manager.cc:5697] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.015611 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.016278 19182 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.016992 19324 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:38.017848 19324 ts_tablet_manager.cc:1403] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 12:26:38.014894 19001 leader_election.cc:304] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.016296 19325 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:38.021255 19356 raft_consensus.cc:2804] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.021832 19325 ts_tablet_manager.cc:1403] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.000s
I20260709 12:26:38.022156 19356 raft_consensus.cc:697] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.023581 19356 consensus_queue.cc:237] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.025503 19325 raft_consensus.cc:359] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.026335 19325 raft_consensus.cc:385] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.026664 19325 raft_consensus.cc:740] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.027467 19325 consensus_queue.cc:260] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.028396 19357 leader_election.cc:290] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.030952 19325 ts_tablet_manager.cc:1434] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:38.032047 19325 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:38.040570 19325 tablet_bootstrap.cc:654] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.028929 19182 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:38.047401 19325 tablet_bootstrap.cc:492] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:38.047964 19325 ts_tablet_manager.cc:1403] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:26:38.032065 19324 raft_consensus.cc:359] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.049907 19324 raft_consensus.cc:385] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.050333 19324 raft_consensus.cc:740] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.050729 19325 raft_consensus.cc:359] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.051662 19325 raft_consensus.cc:385] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.051936 19325 raft_consensus.cc:740] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.052649 19325 consensus_queue.cc:260] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.052835 19324 consensus_queue.cc:260] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.054562 19326 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:38.055836 19324 ts_tablet_manager.cc:1434] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 12:26:38.057094 19324 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:38.056382 18931 catalog_manager.cc:5697] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.058571 19326 ts_tablet_manager.cc:1403] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.070s	user 0.037s	sys 0.019s
I20260709 12:26:38.061681 19356 raft_consensus.cc:493] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.062147 19356 raft_consensus.cc:515] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.062398 19326 raft_consensus.cc:359] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.063481 19326 raft_consensus.cc:385] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.063865 19326 raft_consensus.cc:740] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.065241 19324 tablet_bootstrap.cc:654] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.064911 19326 consensus_queue.cc:260] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.056439 19325 ts_tablet_manager.cc:1434] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:38.067037 19325 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: Bootstrap starting.
I20260709 12:26:38.068029 19326 ts_tablet_manager.cc:1434] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:26:38.069689 19326 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:38.072739 19325 tablet_bootstrap.cc:654] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.079401 19326 tablet_bootstrap.cc:654] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.090583 19356 leader_election.cc:290] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.091492 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:38.092319 19111 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:38.092684 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.093330 19182 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:38.093845 19001 leader_election.cc:304] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.095824 19356 raft_consensus.cc:2804] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.096364 19356 raft_consensus.cc:493] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.096901 19356 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.105669 19252 raft_consensus.cc:493] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.106294 19324 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:38.106238 19252 raft_consensus.cc:515] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.106909 19324 ts_tablet_manager.cc:1403] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.012s
I20260709 12:26:38.108456 19252 leader_election.cc:290] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.110227 19324 raft_consensus.cc:359] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.110931 19324 raft_consensus.cc:385] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.111213 19324 raft_consensus.cc:740] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.112464 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.113168 19182 raft_consensus.cc:2468] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:38.114722 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:38.114974 19324 consensus_queue.cc:260] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.116242 19074 leader_election.cc:304] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
W20260709 12:26:38.117233 19074 leader_election.cc:343] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.118161 19336 raft_consensus.cc:2804] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.118628 19336 raft_consensus.cc:493] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.119035 19336 raft_consensus.cc:3060] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.119311 19356 raft_consensus.cc:515] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.123292 19356 leader_election.cc:290] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.124888 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.125571 19111 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.126368 19325 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: No bootstrap required, opened a new log
I20260709 12:26:38.126369 19326 tablet_bootstrap.cc:492] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:38.126709 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.127010 19325 ts_tablet_manager.cc:1403] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.035s
I20260709 12:26:38.127431 19182 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.127513 19326 ts_tablet_manager.cc:1403] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.021s
I20260709 12:26:38.130020 19325 raft_consensus.cc:359] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.130664 19325 raft_consensus.cc:385] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.131016 19325 raft_consensus.cc:740] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.131677 19325 consensus_queue.cc:260] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.132161 19326 raft_consensus.cc:359] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.133088 19326 raft_consensus.cc:385] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.133445 19326 raft_consensus.cc:740] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.133834 19111 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:38.134476 19326 consensus_queue.cc:260] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.135324 19001 leader_election.cc:304] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.136272 19325 ts_tablet_manager.cc:1434] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:38.137305 19356 raft_consensus.cc:2804] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.137456 19336 raft_consensus.cc:515] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.137980 19356 raft_consensus.cc:697] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.138986 19356 consensus_queue.cc:237] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.140542 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:38.141875 19324 ts_tablet_manager.cc:1434] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
W20260709 12:26:38.142167 19074 leader_election.cc:343] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.142266 19182 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:38.142918 19324 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: Bootstrap starting.
I20260709 12:26:38.144534 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.145432 19336 leader_election.cc:290] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.145107 19182 raft_consensus.cc:3060] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.145726 19357 raft_consensus.cc:493] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.146345 19357 raft_consensus.cc:515] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.148360 19326 ts_tablet_manager.cc:1434] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:38.148866 19324 tablet_bootstrap.cc:654] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.149674 19326 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: Bootstrap starting.
I20260709 12:26:38.150002 19183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.150697 19183 raft_consensus.cc:2468] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 0.
I20260709 12:26:38.152101 18999 leader_election.cc:304] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.153280 19281 raft_consensus.cc:2804] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.153784 19281 raft_consensus.cc:493] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.154206 19281 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.158047 19326 tablet_bootstrap.cc:654] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.148408 19357 leader_election.cc:290] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.162276 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
W20260709 12:26:38.164772 19001 leader_election.cc:343] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.177349 19281 raft_consensus.cc:515] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.180317 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.180995 19182 raft_consensus.cc:2468] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
W20260709 12:26:38.181803 19001 leader_election.cc:343] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.182533 19074 leader_election.cc:304] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: d1c90202bd65484886d7280434e09778
I20260709 12:26:38.183699 19336 raft_consensus.cc:2804] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.184218 19336 raft_consensus.cc:697] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:38.184507 19324 tablet_bootstrap.cc:492] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: No bootstrap required, opened a new log
I20260709 12:26:38.183923 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.185256 19182 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.185089 19336 consensus_queue.cc:237] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.187652 19326 tablet_bootstrap.cc:492] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: No bootstrap required, opened a new log
I20260709 12:26:38.188275 19326 ts_tablet_manager.cc:1403] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
I20260709 12:26:38.192109 19182 raft_consensus.cc:2468] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 1.
I20260709 12:26:38.193482 19281 leader_election.cc:290] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.193565 18999 leader_election.cc:304] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:38.185134 19324 ts_tablet_manager.cc:1403] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.008s
I20260709 12:26:38.195024 19326 raft_consensus.cc:359] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.195706 19326 raft_consensus.cc:385] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.195966 19326 raft_consensus.cc:740] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.196693 19326 consensus_queue.cc:260] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.197840 19324 raft_consensus.cc:359] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.198678 19324 raft_consensus.cc:385] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.198958 19326 ts_tablet_manager.cc:1434] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:38.199229 19281 raft_consensus.cc:2804] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.199028 19324 raft_consensus.cc:740] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.200280 19281 raft_consensus.cc:697] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.200721 19324 consensus_queue.cc:260] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.201555 19281 consensus_queue.cc:237] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.201200 18934 catalog_manager.cc:5697] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.203217 19324 ts_tablet_manager.cc:1434] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:38.211084 18931 catalog_manager.cc:5697] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.220929 18934 catalog_manager.cc:5697] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.244539 19336 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.248202 19281 raft_consensus.cc:493] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.248893 19281 raft_consensus.cc:515] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.250761 19281 leader_election.cc:290] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.251463 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:38.252377 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89509444255047439b32c2e05ac58aed" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.253285 19182 raft_consensus.cc:2393] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1c90202bd65484886d7280434e09778 in current term 1: Already voted for candidate bc7db1d10d934fe78d833139b8501fa2 in this term.
I20260709 12:26:38.254652 18999 leader_election.cc:304] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:38.256055 19281 raft_consensus.cc:3060] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.258430 19336 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.263890 19281 raft_consensus.cc:2749] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.312763 19281 raft_consensus.cc:493] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.313208 19281 raft_consensus.cc:515] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.314882 19281 leader_election.cc:290] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.315712 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc7db1d10d934fe78d833139b8501fa2" is_pre_election: true
I20260709 12:26:38.315955 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.316574 19111 raft_consensus.cc:2393] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1c90202bd65484886d7280434e09778 in current term 1: Already voted for candidate b970a14f55ef43f79c3eccd96a59e1d0 in this term.
I20260709 12:26:38.317567 19001 leader_election.cc:304] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1c90202bd65484886d7280434e09778; no voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:38.318248 19281 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.323992 19281 raft_consensus.cc:2749] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.369488 19336 raft_consensus.cc:493] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.370044 19336 raft_consensus.cc:515] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.371732 19336 leader_election.cc:290] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.372772 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:38.372942 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.373543 19034 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:38.373574 19182 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 0.
I20260709 12:26:38.374737 19074 leader_election.cc:304] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.375382 19336 raft_consensus.cc:2804] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.375741 19336 raft_consensus.cc:493] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.376044 19336 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.381811 19336 raft_consensus.cc:515] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.383855 19336 leader_election.cc:290] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.385236 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.385782 19182 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.385438 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:38.386241 19034 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.386812 19337 consensus_queue.cc:1048] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.392683 19182 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:38.393944 19034 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 1.
I20260709 12:26:38.394397 19337 consensus_queue.cc:1048] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.395313 19074 leader_election.cc:304] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:38.397979 19336 raft_consensus.cc:2804] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.399305 19336 raft_consensus.cc:697] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:38.401324 19379 consensus_queue.cc:1048] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.409446 19336 consensus_queue.cc:237] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.414063 19252 consensus_queue.cc:1048] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.416837 19382 consensus_queue.cc:1048] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.430610 19252 consensus_queue.cc:1048] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.450098 18931 catalog_manager.cc:5697] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.497159 19281 consensus_queue.cc:1048] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.510560 19281 consensus_queue.cc:1048] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.606696 19252 raft_consensus.cc:493] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.607468 19252 raft_consensus.cc:515] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.609493 19252 leader_election.cc:290] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.612210 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c90202bd65484886d7280434e09778" is_pre_election: true
I20260709 12:26:38.612303 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" is_pre_election: true
I20260709 12:26:38.614205 19182 raft_consensus.cc:2393] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc7db1d10d934fe78d833139b8501fa2 in current term 1: Already voted for candidate d1c90202bd65484886d7280434e09778 in this term.
I20260709 12:26:38.615729 19074 leader_election.cc:304] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2; no voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778
I20260709 12:26:38.616734 19336 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.618111 19341 consensus_queue.cc:1048] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.629369 19336 raft_consensus.cc:2749] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.639103 19392 consensus_queue.cc:1048] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.655581 19281 consensus_queue.cc:1048] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.671576 19281 consensus_queue.cc:1048] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.687438 19357 consensus_queue.cc:1048] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:38.721484 19281 consensus_queue.cc:1048] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.760108 19183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df680f08a2aa469c928b848030d5029d"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:55216
I20260709 12:26:38.760977 19183 raft_consensus.cc:606] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:38.769021 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e918acb589c488282a71166310258b7"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:38.769753 19110 raft_consensus.cc:606] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:38.776278 19110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "029daf5884644353added74966bd7d14"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:33968
I20260709 12:26:38.776928 19110 raft_consensus.cc:606] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:38.783730 19183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
mode: GRACEFUL
new_leader_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:55216
I20260709 12:26:38.784344 19183 raft_consensus.cc:606] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Received request to transfer leadership to TS d1c90202bd65484886d7280434e09778
I20260709 12:26:38.790439 19034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:26:38.791229 19034 raft_consensus.cc:606] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Received request to transfer leadership to TS bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:38.800783 19034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:26:38.801302 19034 raft_consensus.cc:606] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Received request to transfer leadership to TS bc7db1d10d934fe78d833139b8501fa2
I20260709 12:26:38.811396 19034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:26:38.812119 19034 raft_consensus.cc:606] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:38.814427 19341 raft_consensus.cc:993] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.815028 19341 raft_consensus.cc:1081] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.816951 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "029daf5884644353added74966bd7d14"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:38.817587 19034 raft_consensus.cc:493] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:38.818010 19034 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.820168 19341 consensus_queue.cc:1048] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.829051 19034 raft_consensus.cc:515] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.835392 19034 leader_election.cc:290] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.835587 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.836463 19110 raft_consensus.cc:3055] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.836899 19110 raft_consensus.cc:740] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:38.838186 19110 consensus_queue.cc:260] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.839324 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029daf5884644353added74966bd7d14" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.840337 19182 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.840549 19110 raft_consensus.cc:3060] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.848917 19336 consensus_queue.cc:1048] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:38.851541 19252 raft_consensus.cc:993] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.852176 19252 raft_consensus.cc:1081] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.854636 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e918acb589c488282a71166310258b7"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58470
I20260709 12:26:38.855271 19034 raft_consensus.cc:493] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:38.855718 19034 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.861971 19182 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.862051 19110 raft_consensus.cc:2468] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.863611 18999 leader_election.cc:304] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.864945 19368 raft_consensus.cc:2804] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:38.865480 19368 raft_consensus.cc:697] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.866742 19368 consensus_queue.cc:237] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.869107 19034 raft_consensus.cc:515] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.871500 19034 leader_election.cc:290] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.873312 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.874140 19110 raft_consensus.cc:3055] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.874167 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.874645 19110 raft_consensus.cc:740] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:38.874938 19182 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.875705 19110 consensus_queue.cc:260] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.877359 19110 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.879349 18931 catalog_manager.cc:5697] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.883983 19182 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.885677 18999 leader_election.cc:304] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.886072 19110 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.886955 19368 raft_consensus.cc:2804] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:38.887619 19368 raft_consensus.cc:697] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.888842 19368 consensus_queue.cc:237] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.899322 18931 catalog_manager.cc:5697] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.973644 19402 raft_consensus.cc:993] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.974179 19402 raft_consensus.cc:1081] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:38.975739 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58478
I20260709 12:26:38.976217 19034 raft_consensus.cc:493] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:38.976517 19034 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.981920 19034 raft_consensus.cc:515] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.983470 19034 leader_election.cc:290] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:38.984498 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:38.984710 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021b8d711c2749db812941f3f2d5f929" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:38.985186 19110 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.985251 19182 raft_consensus.cc:3055] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.985653 19182 raft_consensus.cc:740] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:38.986557 19182 consensus_queue.cc:260] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:38.988006 19182 raft_consensus.cc:3060] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.993059 19110 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.994562 19001 leader_election.cc:304] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:38.994874 19182 raft_consensus.cc:2468] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:38.995420 19368 raft_consensus.cc:2804] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:38.996003 19368 raft_consensus.cc:697] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:38.997090 19368 consensus_queue.cc:237] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.004384 18931 catalog_manager.cc:5697] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.010799 19403 raft_consensus.cc:993] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: : Instructing follower d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:39.011458 19402 raft_consensus.cc:1081] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Signalling peer d1c90202bd65484886d7280434e09778 to start an election
I20260709 12:26:39.013404 19034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df680f08a2aa469c928b848030d5029d"
dest_uuid: "d1c90202bd65484886d7280434e09778"
 from {username='slave'} at 127.0.0.1:58478
I20260709 12:26:39.013996 19034 raft_consensus.cc:493] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.014361 19034 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.020761 19034 raft_consensus.cc:515] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.022535 19034 leader_election.cc:290] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Requested vote from peers bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:39.023329 19110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:39.023658 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df680f08a2aa469c928b848030d5029d" candidate_uuid: "d1c90202bd65484886d7280434e09778" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:39.024010 19110 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.024331 19182 raft_consensus.cc:3055] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.024741 19182 raft_consensus.cc:740] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:39.025494 19182 consensus_queue.cc:260] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.026568 19182 raft_consensus.cc:3060] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.030652 19110 raft_consensus.cc:2468] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:39.031726 19182 raft_consensus.cc:2468] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c90202bd65484886d7280434e09778 in term 2.
I20260709 12:26:39.032100 19001 leader_election.cc:304] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc7db1d10d934fe78d833139b8501fa2, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:39.033183 19368 raft_consensus.cc:2804] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.033721 19368 raft_consensus.cc:697] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Leader. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:39.034724 19368 consensus_queue.cc:237] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.043334 18932 catalog_manager.cc:5697] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 reported cstate change: term changed from 1 to 2, leader changed from b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131) to d1c90202bd65484886d7280434e09778 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "d1c90202bd65484886d7280434e09778" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.081283 19357 raft_consensus.cc:993] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: : Instructing follower bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:39.081871 19368 raft_consensus.cc:1081] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Signalling peer bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:39.083670 19110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:33940
I20260709 12:26:39.084242 19110 raft_consensus.cc:493] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.084614 19110 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.091774 19110 raft_consensus.cc:515] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.093809 19110 leader_election.cc:290] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:39.094326 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:39.094996 19034 raft_consensus.cc:3055] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.094750 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4968ba898eb3417b80307e2a42900a5d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:39.095376 19034 raft_consensus.cc:740] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:39.095623 19182 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.096244 19034 consensus_queue.cc:260] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.097469 19034 raft_consensus.cc:3060] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.100811 19182 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:39.102123 19074 leader_election.cc:304] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:39.102876 19252 raft_consensus.cc:2804] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.102936 19034 raft_consensus.cc:2468] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:39.103358 19252 raft_consensus.cc:697] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:39.104403 19252 consensus_queue.cc:237] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.111948 18932 catalog_manager.cc:5697] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 1 to 2, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.171299 19368 raft_consensus.cc:993] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: : Instructing follower bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:39.171828 19357 raft_consensus.cc:1081] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Signalling peer bc7db1d10d934fe78d833139b8501fa2 to start an election
I20260709 12:26:39.173379 19111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
 from {username='slave'} at 127.0.0.1:33940
I20260709 12:26:39.173897 19111 raft_consensus.cc:493] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.174201 19111 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.179875 19111 raft_consensus.cc:515] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.181463 19111 leader_election.cc:290] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741)
I20260709 12:26:39.182301 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:39.182637 19182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ef2ec66c34228a038ae41a288979d" candidate_uuid: "bc7db1d10d934fe78d833139b8501fa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
I20260709 12:26:39.182991 19034 raft_consensus.cc:3055] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.183218 19182 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.183336 19034 raft_consensus.cc:740] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:39.184216 19034 consensus_queue.cc:260] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.185465 19034 raft_consensus.cc:3060] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.190372 19182 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:39.191540 19074 leader_election.cc:304] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:39.192152 19034 raft_consensus.cc:2468] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc7db1d10d934fe78d833139b8501fa2 in term 2.
I20260709 12:26:39.192319 19252 raft_consensus.cc:2804] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.193041 19252 raft_consensus.cc:697] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Becoming Leader. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:39.193832 19252 consensus_queue.cc:237] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.200448 18932 catalog_manager.cc:5697] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 reported cstate change: term changed from 1 to 2, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "bc7db1d10d934fe78d833139b8501fa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.230180 19368 raft_consensus.cc:993] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:39.230832 19357 raft_consensus.cc:1081] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:39.232748 19182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37888
I20260709 12:26:39.233356 19182 raft_consensus.cc:493] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:39.233747 19182 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.241159 19182 raft_consensus.cc:515] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.243237 19182 leader_election.cc:290] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:39.244230 19034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:39.245651 19034 raft_consensus.cc:3055] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.246018 19034 raft_consensus.cc:740] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:39.246523 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8af1f56bed48c089512b176aa5b97b" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:39.247205 19111 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.247298 19034 consensus_queue.cc:260] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.248530 19034 raft_consensus.cc:3060] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.253333 19111 raft_consensus.cc:2468] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:39.253593 19034 raft_consensus.cc:2468] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:39.254706 19150 leader_election.cc:304] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:39.255508 19403 raft_consensus.cc:2804] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.256075 19403 raft_consensus.cc:697] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:39.257146 19403 consensus_queue.cc:237] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:39.266659 18932 catalog_manager.cc:5697] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 1 to 2, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.304172 19111 raft_consensus.cc:1275] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.305531 19368 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.315042 19182 raft_consensus.cc:1275] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.316684 19357 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.406963 19111 raft_consensus.cc:1275] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.408242 19357 consensus_queue.cc:1048] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.418301 19183 raft_consensus.cc:1275] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.420107 19357 consensus_queue.cc:1048] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.423962 19111 raft_consensus.cc:1275] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.425339 19356 consensus_queue.cc:1048] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:39.431700 19183 raft_consensus.cc:1275] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.433635 19368 consensus_queue.cc:1048] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.494464 19110 raft_consensus.cc:1275] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.496052 19356 consensus_queue.cc:1048] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.507879 19183 raft_consensus.cc:1275] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer d1c90202bd65484886d7280434e09778: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.508800 19034 raft_consensus.cc:1275] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.510977 19252 consensus_queue.cc:1048] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.509724 19356 consensus_queue.cc:1048] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:26:39.523928 19183 raft_consensus.cc:1275] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.529847 19336 consensus_queue.cc:1048] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.789650 19034 raft_consensus.cc:1275] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.790877 19252 consensus_queue.cc:1048] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.800208 19183 raft_consensus.cc:1275] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Refusing update from remote peer bc7db1d10d934fe78d833139b8501fa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.801988 19336 consensus_queue.cc:1048] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.862113 19110 raft_consensus.cc:1275] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.863402 19403 consensus_queue.cc:1048] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.876540 19034 raft_consensus.cc:1275] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:39.879602 19415 consensus_queue.cc:1048] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.817404 18931 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34010:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:41.841988 18931 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34010:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:41.900027  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:26:42.103312 19450 log.cc:927] Time spent T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 12:26:42.092000 19462 tablet.cc:1724] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:42.139957 19001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:43605, user_credentials={real_user=slave}} blocked reactor thread for 60991.2us
I20260709 12:26:42.187733 19476 tablet.cc:1724] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:42.248164 19467 log.cc:927] Time spent T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:26:42.248858 19137 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:df680f08a2aa469c928b848030d5029d)
W20260709 12:26:42.251703 18999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:46741, user_credentials={real_user=slave}} blocked reactor thread for 126462us
W20260709 12:26:42.261265 19137 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:df680f08a2aa469c928b848030d5029d)
W20260709 12:26:42.268694 19137 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:df680f08a2aa469c928b848030d5029d)
W20260709 12:26:42.270227 19001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.130:43605, user_credentials={real_user=slave}} blocked reactor thread for 86535.7us
I20260709 12:26:42.286926 19479 tablet.cc:1724] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.289805 19482 tablet.cc:1724] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.298267 19481 tablet.cc:1724] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.312208 19035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e918acb589c488282a71166310258b7"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:26:42.314008 19035 raft_consensus.cc:606] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
W20260709 12:26:42.318751 19074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:46741, user_credentials={real_user=slave}} blocked reactor thread for 56190.6us
I20260709 12:26:42.344048 19486 tablet.cc:1724] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.324004 19488 tablet.cc:1724] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.371773 19487 tablet.cc:1724] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.374205 19462 tablet.cc:1724] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.449559 19482 tablet.cc:1724] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.465493 19111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:36788
I20260709 12:26:42.466248 19111 raft_consensus.cc:606] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:42.471133 19481 tablet.cc:1724] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.473093  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:26:42.473865  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.472733 19460 raft_consensus.cc:993] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:42.478333 19460 raft_consensus.cc:1081] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:42.479985 19479 tablet.cc:1724] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.489686 19494 tablet.cc:1724] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.490090 19492 tablet.cc:1724] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.491418 19487 tablet.cc:1724] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.497164 19493 tablet.cc:1724] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.497736 19033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac"
dest_uuid: "d1c90202bd65484886d7280434e09778"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:26:42.500808 19185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e918acb589c488282a71166310258b7"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37888
I20260709 12:26:42.501156 19033 raft_consensus.cc:606] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:42.501583 19185 raft_consensus.cc:493] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:42.502179 19185 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.506793 19111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d"
dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
mode: GRACEFUL
new_leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:36788
I20260709 12:26:42.507543 19111 raft_consensus.cc:606] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Received request to transfer leadership to TS b970a14f55ef43f79c3eccd96a59e1d0
I20260709 12:26:42.509296  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:42.510077  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:42.514875 19496 tablet.cc:1724] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.499689 19476 tablet.cc:1724] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.504710 19488 tablet.cc:1724] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.528770 19185 raft_consensus.cc:515] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:42.528657 19486 tablet.cc:1724] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.530251 19181 raft_consensus.cc:1240] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Rejecting Update request from peer d1c90202bd65484886d7280434e09778 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:42.522608 19482 tablet.cc:1724] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.532135 19185 leader_election.cc:290] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 3 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:42.532287 19033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:42.533638 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e918acb589c488282a71166310258b7" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:42.543107 19111 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.544402 19033 raft_consensus.cc:3055] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:42.544929 19033 raft_consensus.cc:740] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:42.544979 19422 consensus_queue.cc:1059] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:42.549762 19033 consensus_queue.cc:260] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:42.547816 19479 tablet.cc:1724] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.552565 19111 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 3.
I20260709 12:26:42.555467 19033 raft_consensus.cc:3060] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.559162 19150 leader_election.cc:304] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, bc7db1d10d934fe78d833139b8501fa2; no voters: 
I20260709 12:26:42.560556 19484 raft_consensus.cc:2804] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:42.561152 19484 raft_consensus.cc:697] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:42.562091 19484 consensus_queue.cc:237] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:42.575100 19494 tablet.cc:1724] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.578263 19492 tablet.cc:1724] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.579646 19496 tablet.cc:1724] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.583101 18932 catalog_manager.cc:5697] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 2 to 3, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:42.594134 18932 catalog_manager.cc:5789] TS b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131:46741) does not have the latest schema for tablet 6e918acb589c488282a71166310258b7 (table soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88]). Expected version 1 got 0
I20260709 12:26:42.596800 19493 tablet.cc:1724] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:42.614868 19033 raft_consensus.cc:2468] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 3.
W20260709 12:26:42.616695 19422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:26:42.644407 18931 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: soft_deleted_table [id=14639eef2ac2474896b6fa3e0a557a88] alter complete (version 1)
I20260709 12:26:42.857841 19468 raft_consensus.cc:993] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:42.858404 19468 raft_consensus.cc:1081] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:42.861105 19181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37878
I20260709 12:26:42.861732 19181 raft_consensus.cc:493] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:42.862118 19181 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.875490 19181 raft_consensus.cc:515] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:42.878890 19035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:42.879638 19111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7bd92848534ce6bcf9bdfdb96e3c4d" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:42.879933 19035 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.880299 19111 raft_consensus.cc:3055] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:42.880709 19111 raft_consensus.cc:740] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:42.881628 19111 consensus_queue.cc:260] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:42.882697 19111 raft_consensus.cc:3060] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.878518 19181 leader_election.cc:290] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:42.890210 19035 raft_consensus.cc:2468] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:42.890959 19111 raft_consensus.cc:2468] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:42.892180 19148 leader_election.cc:304] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:42.893342 19471 raft_consensus.cc:2804] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:42.893985 19471 raft_consensus.cc:697] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:42.895176 19471 consensus_queue.cc:237] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.057782 19033 raft_consensus.cc:1275] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:43.101667 19484 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:43.119453 19494 tablet.cc:1724] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.135452 19110 raft_consensus.cc:1275] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:43.137257 19484 consensus_queue.cc:1048] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:43.139106 19460 raft_consensus.cc:993] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:43.139859 19460 raft_consensus.cc:1081] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:43.143520 19182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37888
I20260709 12:26:43.144220 19182 raft_consensus.cc:493] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.144753 19182 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.152107 19445 raft_consensus.cc:993] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: : Instructing follower b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:43.152722 19445 raft_consensus.cc:1081] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Signalling peer b970a14f55ef43f79c3eccd96a59e1d0 to start an election
I20260709 12:26:43.160612 19184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061"
dest_uuid: "b970a14f55ef43f79c3eccd96a59e1d0"
 from {username='slave'} at 127.0.0.1:37878
I20260709 12:26:43.161293 19184 raft_consensus.cc:493] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.161724 19184 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.166172 19182 raft_consensus.cc:515] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.169346 19494 tablet.cc:1719] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:26:43.170636 19036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:43.171375 19036 raft_consensus.cc:3055] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:43.171757 19036 raft_consensus.cc:740] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1c90202bd65484886d7280434e09778, State: Running, Role: LEADER
I20260709 12:26:43.171916 19184 raft_consensus.cc:515] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.172761 19036 consensus_queue.cc:260] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.174182 19036 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.175336 19184 leader_election.cc:290] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:43.175627 19108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:43.176452 19108 raft_consensus.cc:3055] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:43.176863 19108 raft_consensus.cc:740] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc7db1d10d934fe78d833139b8501fa2, State: Running, Role: LEADER
I20260709 12:26:43.178032 19108 consensus_queue.cc:260] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.179625 19108 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.179925 19504 tablet.cc:1719] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:26:43.183272 19036 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 3.
I20260709 12:26:43.185099 19035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fe3ea2a5e04e0eb3c6e65ef4907061" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d1c90202bd65484886d7280434e09778"
I20260709 12:26:43.185814 19035 raft_consensus.cc:3060] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:43.186518 19148 leader_election.cc:304] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:43.187753 19471 raft_consensus.cc:2804] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.188370 19471 raft_consensus.cc:697] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:43.189985 19471 consensus_queue.cc:237] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.192073 18932 catalog_manager.cc:5697] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.194635 19035 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:43.196986 19182 leader_election.cc:290] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 3 election: Requested vote from peers d1c90202bd65484886d7280434e09778 (127.6.182.129:39559), bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605)
I20260709 12:26:43.198571 19109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8716512dd5a1460e9865680c5a01d1ac" candidate_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc7db1d10d934fe78d833139b8501fa2"
I20260709 12:26:43.199395 19109 raft_consensus.cc:3060] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.199071 19148 leader_election.cc:304] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b970a14f55ef43f79c3eccd96a59e1d0, d1c90202bd65484886d7280434e09778; no voters: 
I20260709 12:26:43.200526 19484 raft_consensus.cc:2804] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:43.201130 19108 raft_consensus.cc:2468] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 2.
I20260709 12:26:43.217679 19109 raft_consensus.cc:2468] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b970a14f55ef43f79c3eccd96a59e1d0 in term 3.
I20260709 12:26:43.219921 19484 raft_consensus.cc:697] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Becoming Leader. State: Replica: b970a14f55ef43f79c3eccd96a59e1d0, State: Running, Role: LEADER
I20260709 12:26:43.220999 19484 consensus_queue.cc:237] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } }
I20260709 12:26:43.237483 19511 tablet.cc:1719] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:26:43.241825 18932 catalog_manager.cc:5697] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 1 to 2, leader changed from bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.243480 18932 catalog_manager.cc:5697] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 reported cstate change: term changed from 2 to 3, leader changed from d1c90202bd65484886d7280434e09778 (127.6.182.129) to b970a14f55ef43f79c3eccd96a59e1d0 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b970a14f55ef43f79c3eccd96a59e1d0" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 46741 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.325917 19035 raft_consensus.cc:1275] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.327332 19471 consensus_queue.cc:1048] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.337203 19109 raft_consensus.cc:1275] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:43.342545 19508 consensus_queue.cc:1048] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:43.525050  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:43.530877  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:43.531332  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.536103  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:43.536568  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.689913 19035 raft_consensus.cc:1275] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:43.691435 19508 consensus_queue.cc:1048] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.701681 19109 raft_consensus.cc:1275] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:43.703104 19508 consensus_queue.cc:1048] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.706496 19035 raft_consensus.cc:1275] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.709898 19508 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c90202bd65484886d7280434e09778" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:43.722688 19108 raft_consensus.cc:1275] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Refusing update from remote peer b970a14f55ef43f79c3eccd96a59e1d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:43.724452 19507 consensus_queue.cc:1048] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc7db1d10d934fe78d833139b8501fa2" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:44.008949 18965 debug-util.cc:398] Leaking SignalData structure 0x7b0800065c00 after lost signal to thread 6877
W20260709 12:26:44.010027 18965 debug-util.cc:398] Leaking SignalData structure 0x7b08000af920 after lost signal to thread 18968
W20260709 12:26:44.011385 18965 debug-util.cc:398] Leaking SignalData structure 0x7b0800172c80 after lost signal to thread 19060
W20260709 12:26:44.012403 18965 debug-util.cc:398] Leaking SignalData structure 0x7b08002cdfc0 after lost signal to thread 19135
W20260709 12:26:44.013676 18965 debug-util.cc:398] Leaking SignalData structure 0x7b08002c16a0 after lost signal to thread 19209
I20260709 12:26:44.537712  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:44.543752  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:44.544251  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.550496  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:44.550951  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:45.551997  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:45.557559  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:45.558007  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.563016  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:45.563464  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.564810  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:46.570091  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:46.570591  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.575474  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:46.575889  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:47.577190  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:47.586156  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:47.586798  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.594901  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:47.595484  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:48.609889  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:48.622799  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:48.623291  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.632786  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:48.633256  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:49.634550  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:49.640466  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:49.640987  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.646433  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:49.646903  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:50.647936  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:50.654773  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:50.655248  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.662948  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:50.663589  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:51.664929  6874 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:51.671833  6874 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:51.672431  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:51.678283  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:51.678779  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:52.745749  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:26:52.768023 19148 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:26:52.776793 19148 consensus_peers.cc:597] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.789975 19074 consensus_peers.cc:597] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.792128 19074 consensus_peers.cc:597] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.799773  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:52.800916  6874 tablet_replica.cc:333] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.802547  6874 raft_consensus.cc:2243] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.803855  6874 raft_consensus.cc:2272] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.808215  6874 tablet_replica.cc:333] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.808938  6874 raft_consensus.cc:2243] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.809576  6874 raft_consensus.cc:2272] T 4d8af1f56bed48c089512b176aa5b97b P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.812706  6874 tablet_replica.cc:333] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.813606  6874 raft_consensus.cc:2243] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.814363  6874 raft_consensus.cc:2272] T 89509444255047439b32c2e05ac58aed P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.816545 19074 consensus_peers.cc:597] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.817873  6874 tablet_replica.cc:333] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.818636  6874 raft_consensus.cc:2243] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.819566  6874 raft_consensus.cc:2272] T df680f08a2aa469c928b848030d5029d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.822228  6874 tablet_replica.cc:333] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.822863  6874 raft_consensus.cc:2243] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.823535  6874 raft_consensus.cc:2272] T 4968ba898eb3417b80307e2a42900a5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.826519  6874 tablet_replica.cc:333] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.827260  6874 raft_consensus.cc:2243] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.827782  6874 raft_consensus.cc:2272] T c58ca828778f47f7aff3dbdd982bfeff P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.830341  6874 tablet_replica.cc:333] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.830907  6874 raft_consensus.cc:2243] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.831696  6874 raft_consensus.cc:2272] T 6e918acb589c488282a71166310258b7 P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.834286  6874 tablet_replica.cc:333] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.834844  6874 raft_consensus.cc:2243] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.835892  6874 raft_consensus.cc:2272] T 029daf5884644353added74966bd7d14 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.838601  6874 tablet_replica.cc:333] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.839306  6874 raft_consensus.cc:2243] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.839900  6874 raft_consensus.cc:2272] T 9d2ce722544245dfabfd354155e2e37c P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.842319  6874 tablet_replica.cc:333] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.842922  6874 raft_consensus.cc:2243] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.843538  6874 raft_consensus.cc:2272] T bfd127126b6741ceb829596fc15c2608 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.845940  6874 tablet_replica.cc:333] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.846578  6874 raft_consensus.cc:2243] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.847467  6874 raft_consensus.cc:2272] T 021b8d711c2749db812941f3f2d5f929 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.850391  6874 tablet_replica.cc:333] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.851099  6874 raft_consensus.cc:2243] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.852187  6874 raft_consensus.cc:2272] T 2a7e9528f07a423f867a4b37f70f393a P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.855012  6874 tablet_replica.cc:333] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.855691  6874 raft_consensus.cc:2243] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.856719  6874 raft_consensus.cc:2272] T bc50e64f9ea84679bbf186590aa95b5d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.859488  6874 tablet_replica.cc:333] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.860060  6874 raft_consensus.cc:2243] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.860605  6874 raft_consensus.cc:2272] T 0ee7a7625e5d4a34aa9e149add99c8bc P d1c90202bd65484886d7280434e09778 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.863407  6874 tablet_replica.cc:333] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.864020  6874 raft_consensus.cc:2243] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.864542  6874 raft_consensus.cc:2272] T 8716512dd5a1460e9865680c5a01d1ac P d1c90202bd65484886d7280434e09778 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.867353  6874 tablet_replica.cc:333] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.867987  6874 raft_consensus.cc:2243] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.869153  6874 raft_consensus.cc:2272] T 3df35678fd6c405d968fc783932e2c31 P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.872427  6874 tablet_replica.cc:333] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.873106  6874 raft_consensus.cc:2243] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:52.873826 19148 consensus_peers.cc:597] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.873927  6874 raft_consensus.cc:2272] T 1d2ef2ec66c34228a038ae41a288979d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.876858  6874 tablet_replica.cc:333] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778: stopping tablet replica
I20260709 12:26:52.877338  6874 raft_consensus.cc:2243] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.877817  6874 raft_consensus.cc:2272] T cf7bd92848534ce6bcf9bdfdb96e3c4d P d1c90202bd65484886d7280434e09778 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.926959  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
W20260709 12:26:52.946810 19148 consensus_peers.cc:597] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.950198 19074 consensus_peers.cc:597] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.979393  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:26:53.000062 19150 consensus_peers.cc:597] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Couldn't send request to peer bc7db1d10d934fe78d833139b8501fa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.019215  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:53.020180  6874 tablet_replica.cc:333] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.021205  6874 raft_consensus.cc:2243] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.021872  6874 raft_consensus.cc:2272] T 4d8af1f56bed48c089512b176aa5b97b P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.024539  6874 tablet_replica.cc:333] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.025249  6874 raft_consensus.cc:2243] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.025807  6874 raft_consensus.cc:2272] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.028321  6874 tablet_replica.cc:333] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.029069  6874 raft_consensus.cc:2243] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.030053  6874 raft_consensus.cc:2272] T 4968ba898eb3417b80307e2a42900a5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.032570  6874 tablet_replica.cc:333] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.033720  6874 raft_consensus.cc:2243] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.034456  6874 raft_consensus.cc:2272] T 029daf5884644353added74966bd7d14 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:53.037771 19150 consensus_peers.cc:597] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Couldn't send request to peer bc7db1d10d934fe78d833139b8501fa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.038369  6874 tablet_replica.cc:333] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.039207  6874 raft_consensus.cc:2243] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.040230  6874 raft_consensus.cc:2272] T c58ca828778f47f7aff3dbdd982bfeff P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.042757  6874 tablet_replica.cc:333] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.043408  6874 raft_consensus.cc:2243] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.044083  6874 raft_consensus.cc:2272] T 6e918acb589c488282a71166310258b7 P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.046833  6874 tablet_replica.cc:333] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.047474  6874 raft_consensus.cc:2243] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.048449  6874 raft_consensus.cc:2272] T 89509444255047439b32c2e05ac58aed P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.051123  6874 tablet_replica.cc:333] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.051918  6874 raft_consensus.cc:2243] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.052685  6874 raft_consensus.cc:2272] T df680f08a2aa469c928b848030d5029d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.056301  6874 tablet_replica.cc:333] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
W20260709 12:26:53.056592 19150 consensus_peers.cc:597] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Couldn't send request to peer bc7db1d10d934fe78d833139b8501fa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.057029  6874 raft_consensus.cc:2243] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.058128  6874 raft_consensus.cc:2272] T bfd127126b6741ceb829596fc15c2608 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.061031  6874 tablet_replica.cc:333] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.061945  6874 raft_consensus.cc:2243] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.062594  6874 raft_consensus.cc:2272] T bc50e64f9ea84679bbf186590aa95b5d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.066242  6874 tablet_replica.cc:333] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
W20260709 12:26:53.066402 19148 consensus_peers.cc:597] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.067003  6874 raft_consensus.cc:2243] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.068080  6874 raft_consensus.cc:2272] T 0ee7a7625e5d4a34aa9e149add99c8bc P bc7db1d10d934fe78d833139b8501fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.070634  6874 tablet_replica.cc:333] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.071347  6874 raft_consensus.cc:2243] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.071952  6874 raft_consensus.cc:2272] T 3df35678fd6c405d968fc783932e2c31 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.074636  6874 tablet_replica.cc:333] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.075304  6874 raft_consensus.cc:2243] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.076216  6874 raft_consensus.cc:2272] T 1d2ef2ec66c34228a038ae41a288979d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.078593  6874 tablet_replica.cc:333] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.079177  6874 raft_consensus.cc:2243] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.079715  6874 raft_consensus.cc:2272] T cf7bd92848534ce6bcf9bdfdb96e3c4d P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.082151  6874 tablet_replica.cc:333] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.082760  6874 raft_consensus.cc:2243] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.083333  6874 raft_consensus.cc:2272] T 9d2ce722544245dfabfd354155e2e37c P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.085892  6874 tablet_replica.cc:333] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.086439  6874 raft_consensus.cc:2243] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.087024  6874 raft_consensus.cc:2272] T 021b8d711c2749db812941f3f2d5f929 P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.089532  6874 tablet_replica.cc:333] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.090091  6874 raft_consensus.cc:2243] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.090642  6874 raft_consensus.cc:2272] T 2a7e9528f07a423f867a4b37f70f393a P bc7db1d10d934fe78d833139b8501fa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.093046  6874 tablet_replica.cc:333] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2: stopping tablet replica
I20260709 12:26:53.093578  6874 raft_consensus.cc:2243] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.094136  6874 raft_consensus.cc:2272] T 8716512dd5a1460e9865680c5a01d1ac P bc7db1d10d934fe78d833139b8501fa2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:53.124786 19148 consensus_peers.cc:597] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer d1c90202bd65484886d7280434e09778 (127.6.182.129:39559): Couldn't send request to peer d1c90202bd65484886d7280434e09778. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.142377  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
I20260709 12:26:53.188455  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:26:53.196532 19150 consensus_peers.cc:597] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 -> Peer bc7db1d10d934fe78d833139b8501fa2 (127.6.182.130:43605): Couldn't send request to peer bc7db1d10d934fe78d833139b8501fa2. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:43605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.221856  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:53.222702  6874 tablet_replica.cc:333] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.223482  6874 raft_consensus.cc:2243] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.224447  6874 raft_consensus.cc:2272] T 4d8af1f56bed48c089512b176aa5b97b P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.226962  6874 tablet_replica.cc:333] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.227556  6874 raft_consensus.cc:2243] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.228454  6874 raft_consensus.cc:2272] T 82fe3ea2a5e04e0eb3c6e65ef4907061 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.230784  6874 tablet_replica.cc:333] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.231346  6874 raft_consensus.cc:2243] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.231822  6874 raft_consensus.cc:2272] T 4968ba898eb3417b80307e2a42900a5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.234299  6874 tablet_replica.cc:333] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.234907  6874 raft_consensus.cc:2243] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.235488  6874 raft_consensus.cc:2272] T 89509444255047439b32c2e05ac58aed P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.238947  6874 tablet_replica.cc:333] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.239719  6874 raft_consensus.cc:2243] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.240371  6874 raft_consensus.cc:2272] T df680f08a2aa469c928b848030d5029d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.243242  6874 tablet_replica.cc:333] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.243835  6874 raft_consensus.cc:2243] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.244344  6874 raft_consensus.cc:2272] T 029daf5884644353added74966bd7d14 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.246680  6874 tablet_replica.cc:333] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.247215  6874 raft_consensus.cc:2243] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.248138  6874 raft_consensus.cc:2272] T 9d2ce722544245dfabfd354155e2e37c P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.250504  6874 tablet_replica.cc:333] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.251113  6874 raft_consensus.cc:2243] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.251623  6874 raft_consensus.cc:2272] T bfd127126b6741ceb829596fc15c2608 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.253968  6874 tablet_replica.cc:333] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.254530  6874 raft_consensus.cc:2243] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.255074  6874 raft_consensus.cc:2272] T 0ee7a7625e5d4a34aa9e149add99c8bc P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.257503  6874 tablet_replica.cc:333] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.258054  6874 raft_consensus.cc:2243] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.258925  6874 raft_consensus.cc:2272] T 6e918acb589c488282a71166310258b7 P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.261183  6874 tablet_replica.cc:333] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.261731  6874 raft_consensus.cc:2243] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.262212  6874 raft_consensus.cc:2272] T c58ca828778f47f7aff3dbdd982bfeff P b970a14f55ef43f79c3eccd96a59e1d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.264477  6874 tablet_replica.cc:333] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.265057  6874 raft_consensus.cc:2243] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.265890  6874 raft_consensus.cc:2272] T 8716512dd5a1460e9865680c5a01d1ac P b970a14f55ef43f79c3eccd96a59e1d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.268105  6874 tablet_replica.cc:333] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.268682  6874 raft_consensus.cc:2243] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.269258  6874 raft_consensus.cc:2272] T bc50e64f9ea84679bbf186590aa95b5d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.271488  6874 tablet_replica.cc:333] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.272082  6874 raft_consensus.cc:2243] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.272603  6874 raft_consensus.cc:2272] T 1d2ef2ec66c34228a038ae41a288979d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.274700  6874 tablet_replica.cc:333] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.275277  6874 raft_consensus.cc:2243] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.276192  6874 raft_consensus.cc:2272] T cf7bd92848534ce6bcf9bdfdb96e3c4d P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.278456  6874 tablet_replica.cc:333] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.278980  6874 raft_consensus.cc:2243] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.279467  6874 raft_consensus.cc:2272] T 3df35678fd6c405d968fc783932e2c31 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.281577  6874 tablet_replica.cc:333] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.282073  6874 raft_consensus.cc:2243] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.282600  6874 raft_consensus.cc:2272] T 021b8d711c2749db812941f3f2d5f929 P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.284818  6874 tablet_replica.cc:333] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0: stopping tablet replica
I20260709 12:26:53.285283  6874 raft_consensus.cc:2243] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:53.285713  6874 raft_consensus.cc:2272] T 2a7e9528f07a423f867a4b37f70f393a P b970a14f55ef43f79c3eccd96a59e1d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.330307  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:26:53.372738  6874 master.cc:562] Master@127.6.182.190:38101 shutting down...
I20260709 12:26:53.400132  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:53.400872  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:53.401193  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P 08b2e9a7180c4656afb76a7942afc51b: stopping tablet replica
I20260709 12:26:53.449851  6874 master.cc:584] Master@127.6.182.190:38101 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21202 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:26:53.510795  6874 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.182.190:35095
I20260709 12:26:53.512080  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:53.518738 19552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.518983 19551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.519964 19554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.520925  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:53.521869  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:53.522089  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:53.522224  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783600013522212 us; error 0 us; skew 500 ppm
I20260709 12:26:53.522681  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:53.525298  6874 webserver.cc:533] Webserver started at http://127.6.182.190:43963/ using document root <none> and password file <none>
I20260709 12:26:53.525749  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:53.525902  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:53.526115  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:53.527227  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/master-0-root/instance:
uuid: "00a597457e0940fdb32c5bee55716d9f"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.531634  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:53.535241 19559 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.536139  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:26:53.536489  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/master-0-root
uuid: "00a597457e0940fdb32c5bee55716d9f"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.536867  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:53.554823  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:53.556178  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:53.599252  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.190:35095
I20260709 12:26:53.599382 19610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.190:35095 every 8 connection(s)
I20260709 12:26:53.603588 19611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.616726 19611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: Bootstrap starting.
I20260709 12:26:53.622835 19611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.627653 19611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: No bootstrap required, opened a new log
I20260709 12:26:53.630103 19611 raft_consensus.cc:359] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER }
I20260709 12:26:53.630551 19611 raft_consensus.cc:385] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.630734 19611 raft_consensus.cc:740] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a597457e0940fdb32c5bee55716d9f, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.631359 19611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER }
I20260709 12:26:53.631803 19611 raft_consensus.cc:399] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:53.632009 19611 raft_consensus.cc:493] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:53.632241 19611 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.637529 19611 raft_consensus.cc:515] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER }
I20260709 12:26:53.638042 19611 leader_election.cc:304] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00a597457e0940fdb32c5bee55716d9f; no voters: 
I20260709 12:26:53.639403 19611 leader_election.cc:290] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:53.639842 19614 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.641326 19614 raft_consensus.cc:697] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 1 LEADER]: Becoming Leader. State: Replica: 00a597457e0940fdb32c5bee55716d9f, State: Running, Role: LEADER
I20260709 12:26:53.642010 19614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER }
I20260709 12:26:53.642616 19611 sys_catalog.cc:565] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:53.647307 19616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00a597457e0940fdb32c5bee55716d9f. Latest consensus state: current_term: 1 leader_uuid: "00a597457e0940fdb32c5bee55716d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER } }
I20260709 12:26:53.647261 19615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00a597457e0940fdb32c5bee55716d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a597457e0940fdb32c5bee55716d9f" member_type: VOTER } }
I20260709 12:26:53.648092 19616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:53.648182 19615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:53.652770 19621 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:53.659391 19621 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:53.661599  6874 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:53.669139 19621 catalog_manager.cc:1383] Generated new cluster ID: 7dbb1af3b88d4fbaae9f0ff1b4238966
I20260709 12:26:53.669479 19621 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:53.695422 19621 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:53.696841 19621 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:53.721513 19621 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: Generated new TSK 0
I20260709 12:26:53.722157 19621 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:53.728063  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:53.734201 19632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.735397 19633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.736469 19635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.737278  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:53.738663  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:53.738955  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:53.739130  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783600013739112 us; error 0 us; skew 500 ppm
I20260709 12:26:53.739710  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:53.742058  6874 webserver.cc:533] Webserver started at http://127.6.182.129:35589/ using document root <none> and password file <none>
I20260709 12:26:53.742486  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:53.742636  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:53.742843  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:53.743908  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-0-root/instance:
uuid: "314718fb758643bfb8488f2d3d5b28c9"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.748477  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:53.751768 19640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.752532  6874 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:53.752847  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-0-root
uuid: "314718fb758643bfb8488f2d3d5b28c9"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.753085  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:53.763762  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:53.764971  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:53.766328  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:53.768540  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:53.768801  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.769050  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:53.769223  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.811254  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.129:39989
I20260709 12:26:53.811442 19702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.129:39989 every 8 connection(s)
I20260709 12:26:53.816726  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:53.824744 19707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.825238 19708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.830080 19710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.830390  6874 server_base.cc:1061] running on GCE node
I20260709 12:26:53.831856  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:53.832099  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:53.832300  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783600013832284 us; error 0 us; skew 500 ppm
I20260709 12:26:53.832913  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:53.835582 19703 heartbeater.cc:344] Connected to a master server at 127.6.182.190:35095
I20260709 12:26:53.836035 19703 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:53.836194  6874 webserver.cc:533] Webserver started at http://127.6.182.130:44123/ using document root <none> and password file <none>
I20260709 12:26:53.836863  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:53.837076  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:53.836980 19703 heartbeater.cc:507] Master 127.6.182.190:35095 requested a full tablet report, sending...
I20260709 12:26:53.837677  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:53.839066  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-1-root/instance:
uuid: "8feef7fb24c44570bb36c3db8b063617"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.839910 19576 ts_manager.cc:194] Registered new tserver with Master: 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989)
I20260709 12:26:53.842097 19576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52940
I20260709 12:26:53.844430  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:53.848431 19715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.849417  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:53.849776  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-1-root
uuid: "8feef7fb24c44570bb36c3db8b063617"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.850134  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:53.878432  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:53.879892  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:53.881589  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:53.884145  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:53.884416  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.884725  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:53.884938  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.930516  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.130:46635
I20260709 12:26:53.930619 19777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.130:46635 every 8 connection(s)
I20260709 12:26:53.936213  6874 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:53.944897 19781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.947006 19782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.950697  6874 server_base.cc:1061] running on GCE node
W20260709 12:26:53.951646 19784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.951773 19778 heartbeater.cc:344] Connected to a master server at 127.6.182.190:35095
I20260709 12:26:53.952389 19778 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:53.952965  6874 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:53.953315 19778 heartbeater.cc:507] Master 127.6.182.190:35095 requested a full tablet report, sending...
W20260709 12:26:53.953344  6874 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:53.953809  6874 hybrid_clock.cc:648] HybridClock initialized: now 1783600013953781 us; error 0 us; skew 500 ppm
I20260709 12:26:53.954674  6874 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:53.955920 19576 ts_manager.cc:194] Registered new tserver with Master: 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:53.958060  6874 webserver.cc:533] Webserver started at http://127.6.182.131:45723/ using document root <none> and password file <none>
I20260709 12:26:53.958304 19576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52948
I20260709 12:26:53.958828  6874 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:53.959138  6874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:53.959489  6874 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:53.961349  6874 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-2-root/instance:
uuid: "a7167e508b864cc1abbeaa1b03df8422"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.966198  6874 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:53.970129 19789 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.971057  6874 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:53.971426  6874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-2-root
uuid: "a7167e508b864cc1abbeaa1b03df8422"
format_stamp: "Formatted at 2026-07-09 12:26:53 on dist-test-slave-lgtn"
I20260709 12:26:53.971699  6874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taski0tdJl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599585808757-6874-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:54.011914  6874 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:54.013366  6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:54.015110  6874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:54.017835  6874 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:54.018113  6874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:54.018399  6874 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:54.018606  6874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:54.065964  6874 rpc_server.cc:307] RPC server started. Bound to: 127.6.182.131:37621
I20260709 12:26:54.066103 19851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.182.131:37621 every 8 connection(s)
I20260709 12:26:54.081857 19852 heartbeater.cc:344] Connected to a master server at 127.6.182.190:35095
I20260709 12:26:54.082355 19852 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:54.083175 19852 heartbeater.cc:507] Master 127.6.182.190:35095 requested a full tablet report, sending...
I20260709 12:26:54.085258 19576 ts_manager.cc:194] Registered new tserver with Master: a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.086138  6874 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016357467s
I20260709 12:26:54.086951 19576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52958
I20260709 12:26:54.113282 19576 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52964:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:54.116395 19576 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:54.203262 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:54.204077 19742 tablet_service.cc:1511] Processing CreateTablet for tablet b17d64896ea4448a9c6cf54843ab6f93 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:54.204845 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.205654 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17d64896ea4448a9c6cf54843ab6f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.214726 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 2da016cad1ae409aaf3cff5069b9dd7b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:54.216373 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da016cad1ae409aaf3cff5069b9dd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.217772 19816 tablet_service.cc:1511] Processing CreateTablet for tablet b17d64896ea4448a9c6cf54843ab6f93 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:54.218288 19815 tablet_service.cc:1511] Processing CreateTablet for tablet 2da016cad1ae409aaf3cff5069b9dd7b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:54.219527 19816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17d64896ea4448a9c6cf54843ab6f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.220741 19815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da016cad1ae409aaf3cff5069b9dd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.221509 19817 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:54.223064 19817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.217864 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 7545bfae73df483783f774ac0ce2e016 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:54.225682 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 7545bfae73df483783f774ac0ce2e016 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:54.226365 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7545bfae73df483783f774ac0ce2e016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.227232 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7545bfae73df483783f774ac0ce2e016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.233255 19668 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:54.233687 19667 tablet_service.cc:1511] Processing CreateTablet for tablet b17d64896ea4448a9c6cf54843ab6f93 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:54.234764 19668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdaf68f5b6b4edea5062c4dd3bd3243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.236478 19666 tablet_service.cc:1511] Processing CreateTablet for tablet 2da016cad1ae409aaf3cff5069b9dd7b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:54.237953 19666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da016cad1ae409aaf3cff5069b9dd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.239128 19667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17d64896ea4448a9c6cf54843ab6f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.246351 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 7545bfae73df483783f774ac0ce2e016 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:54.247047 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 982dbd7784f547fba30d2ac46b213e8f (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:54.247874 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7545bfae73df483783f774ac0ce2e016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.248667 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982dbd7784f547fba30d2ac46b213e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.255172 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 982dbd7784f547fba30d2ac46b213e8f (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:54.256867 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982dbd7784f547fba30d2ac46b213e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.271828 19867 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.282505 19867 tablet_bootstrap.cc:654] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.284150 19868 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.284529 19813 tablet_service.cc:1511] Processing CreateTablet for tablet 982dbd7784f547fba30d2ac46b213e8f (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:54.285868 19663 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0b50d72b84baf9d7f34e95b0ca742 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:54.286783 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982dbd7784f547fba30d2ac46b213e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.287623 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0b50d72b84baf9d7f34e95b0ca742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.297153 19870 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.307727 19867 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.308344 19867 ts_tablet_manager.cc:1403] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.000s
I20260709 12:26:54.311422 19867 raft_consensus.cc:359] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.313122 19867 raft_consensus.cc:385] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.313427 19867 raft_consensus.cc:740] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.314239 19867 consensus_queue.cc:260] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.307801 19870 tablet_bootstrap.cc:654] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.327520 19665 tablet_service.cc:1511] Processing CreateTablet for tablet f5716ede7b3045d598c7eb0d4117a09b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:54.329306 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5716ede7b3045d598c7eb0d4117a09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.334722 19742 tablet_service.cc:1511] Processing CreateTablet for tablet f5716ede7b3045d598c7eb0d4117a09b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:54.336814 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5716ede7b3045d598c7eb0d4117a09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.336216 19813 tablet_service.cc:1511] Processing CreateTablet for tablet f5716ede7b3045d598c7eb0d4117a09b (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:54.316465 19740 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0b50d72b84baf9d7f34e95b0ca742 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:54.340528 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0b50d72b84baf9d7f34e95b0ca742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.343819 19778 heartbeater.cc:499] Master 127.6.182.190:35095 was elected leader, sending a full tablet report...
I20260709 12:26:54.325103 19816 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0b50d72b84baf9d7f34e95b0ca742 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:54.346258 19663 tablet_service.cc:1511] Processing CreateTablet for tablet cf38e1dc317d44b3a5ad6c5c59ef1338 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:54.347786 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf38e1dc317d44b3a5ad6c5c59ef1338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.351895 19739 tablet_service.cc:1511] Processing CreateTablet for tablet cf38e1dc317d44b3a5ad6c5c59ef1338 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:54.353442 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf38e1dc317d44b3a5ad6c5c59ef1338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.353539 19817 tablet_service.cc:1511] Processing CreateTablet for tablet cf38e1dc317d44b3a5ad6c5c59ef1338 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:54.359025 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 982df37c6aac46d4873e3f6fa52a9705 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:54.360656 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982df37c6aac46d4873e3f6fa52a9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.316701 19868 tablet_bootstrap.cc:654] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.368382 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5716ede7b3045d598c7eb0d4117a09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.372987 19817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf38e1dc317d44b3a5ad6c5c59ef1338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.373605 19867 ts_tablet_manager.cc:1434] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 12:26:54.377688 19867 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.383649 19816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0b50d72b84baf9d7f34e95b0ca742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.386096 19870 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.386708 19870 ts_tablet_manager.cc:1403] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.004s
I20260709 12:26:54.389598 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 982df37c6aac46d4873e3f6fa52a9705 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:54.390122 19870 raft_consensus.cc:359] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.391212 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982df37c6aac46d4873e3f6fa52a9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.390287 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 982df37c6aac46d4873e3f6fa52a9705 (DEFAULT_TABLE table=test-workload [id=5c22b5fb76b14216a82ab80906c8f128]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:54.398303 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982df37c6aac46d4873e3f6fa52a9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:54.391088 19870 raft_consensus.cc:385] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.400774 19870 raft_consensus.cc:740] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.401882 19870 consensus_queue.cc:260] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.407680 19867 tablet_bootstrap.cc:654] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.418411 19852 heartbeater.cc:499] Master 127.6.182.190:35095 was elected leader, sending a full tablet report...
I20260709 12:26:54.423110 19870 ts_tablet_manager.cc:1434] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:26:54.424422 19870 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.431066 19868 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.431829 19868 ts_tablet_manager.cc:1403] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.000s
I20260709 12:26:54.432579 19870 tablet_bootstrap.cc:654] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:54.435353 19779 tablet.cc:2406] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:54.435722 19868 raft_consensus.cc:359] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.443686 19868 raft_consensus.cc:385] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.444094 19868 raft_consensus.cc:740] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.445271 19868 consensus_queue.cc:260] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.447407 19867 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.448287 19867 ts_tablet_manager.cc:1403] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.019s
I20260709 12:26:54.452674 19703 heartbeater.cc:499] Master 127.6.182.190:35095 was elected leader, sending a full tablet report...
I20260709 12:26:54.453413 19868 ts_tablet_manager.cc:1434] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 12:26:54.454684 19868 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.459355 19867 raft_consensus.cc:359] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.460742 19867 raft_consensus.cc:385] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.461202 19867 raft_consensus.cc:740] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.462811 19868 tablet_bootstrap.cc:654] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.463132 19867 consensus_queue.cc:260] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.465448 19870 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.465895 19867 ts_tablet_manager.cc:1434] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 12:26:54.466112 19870 ts_tablet_manager.cc:1403] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.013s
I20260709 12:26:54.467109 19867 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.470847 19870 raft_consensus.cc:359] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.471763 19870 raft_consensus.cc:385] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.472137 19870 raft_consensus.cc:740] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.473035 19870 consensus_queue.cc:260] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.475554 19870 ts_tablet_manager.cc:1434] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:26:54.475721 19867 tablet_bootstrap.cc:654] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.476723 19870 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.487371 19870 tablet_bootstrap.cc:654] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.493072 19868 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.493820 19868 ts_tablet_manager.cc:1403] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.004s
I20260709 12:26:54.497265 19868 raft_consensus.cc:359] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.498294 19868 raft_consensus.cc:385] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.498700 19868 raft_consensus.cc:740] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.499711 19868 consensus_queue.cc:260] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.502241 19868 ts_tablet_manager.cc:1434] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:54.503479 19868 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.512243 19868 tablet_bootstrap.cc:654] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.512440 19870 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.513248 19870 ts_tablet_manager.cc:1403] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.015s
I20260709 12:26:54.515630 19867 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.516306 19867 ts_tablet_manager.cc:1403] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.030s
I20260709 12:26:54.516770 19870 raft_consensus.cc:359] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.517860 19870 raft_consensus.cc:385] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.518208 19870 raft_consensus.cc:740] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.518379 19868 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.519080 19868 ts_tablet_manager.cc:1403] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:26:54.519184 19870 consensus_queue.cc:260] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.520058 19867 raft_consensus.cc:359] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.520952 19867 raft_consensus.cc:385] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.521288 19867 raft_consensus.cc:740] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.522008 19870 ts_tablet_manager.cc:1434] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:54.522315 19867 consensus_queue.cc:260] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.523305 19870 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.525132 19867 ts_tablet_manager.cc:1434] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:54.526441 19867 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.527813 19868 raft_consensus.cc:359] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.528518 19873 raft_consensus.cc:493] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.528898 19868 raft_consensus.cc:385] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.529273 19868 raft_consensus.cc:740] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.529119 19873 raft_consensus.cc:515] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.530426 19868 consensus_queue.cc:260] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.532055 19870 tablet_bootstrap.cc:654] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.533356 19868 ts_tablet_manager.cc:1434] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:26:54.534679 19868 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.535410 19867 tablet_bootstrap.cc:654] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.542308 19868 tablet_bootstrap.cc:654] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.551756 19873 leader_election.cc:290] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:54.557188 19867 tablet_bootstrap.cc:492] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.557679 19868 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.557898 19867 ts_tablet_manager.cc:1403] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.007s
I20260709 12:26:54.558208 19870 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.558393 19868 ts_tablet_manager.cc:1403] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.010s
I20260709 12:26:54.558945 19870 ts_tablet_manager.cc:1403] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.017s
I20260709 12:26:54.561983 19867 raft_consensus.cc:359] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.562358 19868 raft_consensus.cc:359] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.564075 19867 raft_consensus.cc:385] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.562642 19870 raft_consensus.cc:359] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.564620 19868 raft_consensus.cc:385] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.564759 19867 raft_consensus.cc:740] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.564915 19870 raft_consensus.cc:385] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.565124 19868 raft_consensus.cc:740] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.565492 19870 raft_consensus.cc:740] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.565940 19867 consensus_queue.cc:260] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.566217 19868 consensus_queue.cc:260] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.566762 19870 consensus_queue.cc:260] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.569096 19868 ts_tablet_manager.cc:1434] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:26:54.569792 19870 ts_tablet_manager.cc:1434] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:26:54.570364 19868 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.571059 19870 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.571882 19867 ts_tablet_manager.cc:1434] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:54.573172 19867 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.578594 19868 tablet_bootstrap.cc:654] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.580145 19870 tablet_bootstrap.cc:654] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.580485 19867 tablet_bootstrap.cc:654] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.591956 19871 raft_consensus.cc:493] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.593252 19867 tablet_bootstrap.cc:492] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.592940 19871 raft_consensus.cc:515] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.593981 19867 ts_tablet_manager.cc:1403] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 12:26:54.598165 19867 raft_consensus.cc:359] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.598651 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.599099 19867 raft_consensus.cc:385] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.599480 19867 raft_consensus.cc:740] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.600418 19867 consensus_queue.cc:260] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.603029 19873 raft_consensus.cc:493] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.603786 19873 raft_consensus.cc:515] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.606830 19873 leader_election.cc:290] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989)
I20260709 12:26:54.612072 19867 ts_tablet_manager.cc:1434] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:26:54.613489 19867 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.613956 19871 leader_election.cc:290] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.624989 19870 tablet_bootstrap.cc:492] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.625684 19870 ts_tablet_manager.cc:1403] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.005s
I20260709 12:26:54.625922 19876 raft_consensus.cc:493] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.626590 19876 raft_consensus.cc:515] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.628589 19867 tablet_bootstrap.cc:654] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.629854 19876 leader_election.cc:290] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.631300 19868 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.631906 19868 ts_tablet_manager.cc:1403] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.062s	user 0.032s	sys 0.021s
I20260709 12:26:54.635234 19868 raft_consensus.cc:359] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.635980 19868 raft_consensus.cc:385] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.636291 19868 raft_consensus.cc:740] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.636993 19868 consensus_queue.cc:260] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.639288 19868 ts_tablet_manager.cc:1434] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:54.640375 19871 raft_consensus.cc:493] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.640558 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.641021 19871 raft_consensus.cc:515] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.641323 19827 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.642912 19892 raft_consensus.cc:493] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.643052 19718 leader_election.cc:304] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.643291 19871 leader_election.cc:290] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.643587 19892 raft_consensus.cc:515] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.644224 19868 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.644744 19871 raft_consensus.cc:2804] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.645164 19871 raft_consensus.cc:493] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.645500 19871 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.646308 19892 leader_election.cc:290] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.651407 19868 tablet_bootstrap.cc:654] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.654098 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.654939 19827 raft_consensus.cc:2468] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
W20260709 12:26:54.658454 19624 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:54.659930 19870 raft_consensus.cc:359] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.660913 19870 raft_consensus.cc:385] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.661257 19870 raft_consensus.cc:740] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.663416 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.664251 19827 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.667213 19718 leader_election.cc:304] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.668069 19892 raft_consensus.cc:2804] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.668154 19718 leader_election.cc:304] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.668540 19892 raft_consensus.cc:493] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.669021 19892 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.669431 19870 consensus_queue.cc:260] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.671702 19870 ts_tablet_manager.cc:1434] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:26:54.678727 19892 raft_consensus.cc:515] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.679932 19871 raft_consensus.cc:515] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.685238 19895 raft_consensus.cc:2804] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.685871 19895 raft_consensus.cc:493] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.686338 19895 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.697844 19892 leader_election.cc:290] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.698879 19892 raft_consensus.cc:493] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:54.699666 19793 leader_election.cc:343] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.701333 19870 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.702291 19873 raft_consensus.cc:493] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.702952 19873 raft_consensus.cc:515] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.706020 19873 leader_election.cc:290] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:54.699447 19892 raft_consensus.cc:515] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.712579 19871 leader_election.cc:290] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.706568 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:54.713411 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:54.714444 19753 raft_consensus.cc:2393] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 8feef7fb24c44570bb36c3db8b063617 in this term.
I20260709 12:26:54.713430 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.713336 19871 raft_consensus.cc:493] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.715257 19827 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.714417 19868 tablet_bootstrap.cc:492] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.715498 19871 raft_consensus.cc:515] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.716355 19868 ts_tablet_manager.cc:1403] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.035s
I20260709 12:26:54.716298 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.717993 19792 leader_election.cc:304] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:54.718487 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:54.719271 19753 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:54.720264 19826 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.721051 19868 raft_consensus.cc:359] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.721980 19868 raft_consensus.cc:385] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.722939 19868 raft_consensus.cc:740] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.722983 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.723922 19825 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.724226 19868 consensus_queue.cc:260] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.725539 19718 leader_election.cc:304] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.726119 19870 tablet_bootstrap.cc:654] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.726711 19871 leader_election.cc:290] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.731580 19871 raft_consensus.cc:2804] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.728740 19792 leader_election.cc:304] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.732551 19871 raft_consensus.cc:493] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.733094 19871 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.719285 19895 raft_consensus.cc:515] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.735610 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982dbd7784f547fba30d2ac46b213e8f" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.736512 19825 raft_consensus.cc:2468] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.735445 19868 ts_tablet_manager.cc:1434] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:26:54.737932 19718 leader_election.cc:304] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.738432 19868 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.740162 19752 raft_consensus.cc:2393] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 8feef7fb24c44570bb36c3db8b063617 in this term.
I20260709 12:26:54.740829 19897 raft_consensus.cc:2804] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.741355 19897 raft_consensus.cc:493] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.741755 19897 raft_consensus.cc:3060] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.749709 19826 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.751541 19873 raft_consensus.cc:2749] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.755138 19873 raft_consensus.cc:2804] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.748661 19892 leader_election.cc:290] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.749665 19895 leader_election.cc:290] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.761355 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.762233 19678 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:54.762777 19867 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.758975 19718 leader_election.cc:304] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.763651 19867 ts_tablet_manager.cc:1403] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.150s	user 0.027s	sys 0.027s
I20260709 12:26:54.756798 19873 raft_consensus.cc:493] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.764937 19873 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.765368 19892 raft_consensus.cc:2804] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.765646 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.766034 19892 raft_consensus.cc:697] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:54.766489 19678 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:54.767060 19892 consensus_queue.cc:237] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.767831 19793 leader_election.cc:304] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:54.767822 19867 raft_consensus.cc:359] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.769049 19867 raft_consensus.cc:385] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.769459 19867 raft_consensus.cc:740] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.769670 19899 raft_consensus.cc:2804] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.770202 19899 raft_consensus.cc:493] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.770581 19899 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.770699 19867 consensus_queue.cc:260] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.773620 19867 ts_tablet_manager.cc:1434] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:26:54.774863 19867 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.776685 19827 raft_consensus.cc:2468] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.778190 19718 leader_election.cc:304] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.779211 19895 raft_consensus.cc:2804] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.779736 19895 raft_consensus.cc:697] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:54.781677 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.782325 19677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.782508 19678 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.784260 19677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.776736 19871 raft_consensus.cc:515] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.758962 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.785003 19677 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.784991 19895 consensus_queue.cc:237] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.786440 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.787143 19678 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.792871 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.793767 19871 leader_election.cc:290] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.793951 19873 raft_consensus.cc:515] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.795440 19827 raft_consensus.cc:2393] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8feef7fb24c44570bb36c3db8b063617 in current term 1: Already voted for candidate a7167e508b864cc1abbeaa1b03df8422 in this term.
I20260709 12:26:54.795279 19897 raft_consensus.cc:515] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.797775 19677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.764932 19868 tablet_bootstrap.cc:654] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.800776 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982dbd7784f547fba30d2ac46b213e8f" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.799620 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:54.804389 19676 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.804632 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.806617 19674 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.806926 19678 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.802987 19675 raft_consensus.cc:2468] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:54.811277 19867 tablet_bootstrap.cc:654] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.813357 19897 leader_election.cc:290] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.815510 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982dbd7784f547fba30d2ac46b213e8f" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.816468 19827 raft_consensus.cc:3060] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.828440 19873 leader_election.cc:290] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:54.832437 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.832823 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:54.833269 19675 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.833788 19752 raft_consensus.cc:2393] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 8feef7fb24c44570bb36c3db8b063617 in this term.
I20260709 12:26:54.834826 19674 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
W20260709 12:26:54.837690 19719 leader_election.cc:343] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.838160 19876 raft_consensus.cc:493] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.838749 19876 raft_consensus.cc:515] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
W20260709 12:26:54.839679 19719 leader_election.cc:343] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.841071 19876 leader_election.cc:290] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.844754 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.845577 19899 raft_consensus.cc:515] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.845961 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982dbd7784f547fba30d2ac46b213e8f" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.847030 19826 raft_consensus.cc:2393] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8feef7fb24c44570bb36c3db8b063617 in current term 1: Already voted for candidate a7167e508b864cc1abbeaa1b03df8422 in this term.
I20260709 12:26:54.848214 19899 leader_election.cc:290] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989)
I20260709 12:26:54.847054 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:54.861003 19674 raft_consensus.cc:3060] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:54.848801 19643 leader_election.cc:343] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.831887 19870 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.849619 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:54.831759 19868 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:54.851282 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:54.861716 19675 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.864673 19870 ts_tablet_manager.cc:1403] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.000s
I20260709 12:26:54.852182 19719 leader_election.cc:304] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:54.845846 19574 catalog_manager.cc:5697] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.848546 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:54.867259 19827 raft_consensus.cc:2468] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.866484 19752 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 0.
W20260709 12:26:54.868387 19643 leader_election.cc:343] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.874281 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
W20260709 12:26:54.874640 19643 leader_election.cc:343] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.874297 19718 leader_election.cc:304] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:54.875272 19675 raft_consensus.cc:2393] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 8feef7fb24c44570bb36c3db8b063617 in this term.
I20260709 12:26:54.875190 19643 leader_election.cc:304] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9; no voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:54.866871 19868 ts_tablet_manager.cc:1403] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.129s	user 0.006s	sys 0.018s
I20260709 12:26:54.871358 19676 raft_consensus.cc:2393] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 8feef7fb24c44570bb36c3db8b063617 in this term.
I20260709 12:26:54.871752 19867 tablet_bootstrap.cc:492] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.872383 19895 raft_consensus.cc:2804] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.878201 19793 leader_election.cc:304] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:54.876189 19892 raft_consensus.cc:2804] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.876735 19876 raft_consensus.cc:2749] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.881703 19899 raft_consensus.cc:2749] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.877290 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:54.872331 19870 raft_consensus.cc:359] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.882689 19892 raft_consensus.cc:697] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:54.883067 19870 raft_consensus.cc:385] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.880811 19867 ts_tablet_manager.cc:1403] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.016s
I20260709 12:26:54.884786 19870 raft_consensus.cc:740] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.882572 19895 raft_consensus.cc:697] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:54.886233 19719 leader_election.cc:304] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:54.883919 19892 consensus_queue.cc:237] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.886736 19895 consensus_queue.cc:237] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.891309 19897 raft_consensus.cc:2804] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.880316 19868 raft_consensus.cc:359] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.892277 19868 raft_consensus.cc:385] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.892266 19897 raft_consensus.cc:697] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:54.892531 19643 leader_election.cc:304] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:54.893286 19868 raft_consensus.cc:740] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.894999 19876 raft_consensus.cc:2804] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.894757 19868 consensus_queue.cc:260] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.895547 19876 raft_consensus.cc:493] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.894112 19897 consensus_queue.cc:237] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.896744 19876 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.902566 19867 raft_consensus.cc:359] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.903810 19867 raft_consensus.cc:385] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.910362 19792 leader_election.cc:304] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:54.912540 19899 raft_consensus.cc:2749] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.892716 19870 consensus_queue.cc:260] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.915872 19870 ts_tablet_manager.cc:1434] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:26:54.917186 19870 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.920428 19876 raft_consensus.cc:515] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.924047 19876 leader_election.cc:290] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:54.904217 19867 raft_consensus.cc:740] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.924950 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:54.925791 19753 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.925596 19867 consensus_queue.cc:260] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.934302 19674 raft_consensus.cc:2468] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:54.934306 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:54.925833 19870 tablet_bootstrap.cc:654] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:54.937943 19643 leader_election.cc:343] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.937129 19867 ts_tablet_manager.cc:1434] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 12:26:54.942113 19867 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:54.949687 19867 tablet_bootstrap.cc:654] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.952248 19870 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:54.953272 19870 ts_tablet_manager.cc:1403] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 12:26:54.955390 19868 ts_tablet_manager.cc:1434] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.011s
I20260709 12:26:54.957055 19753 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 1.
I20260709 12:26:54.959026 19643 leader_election.cc:304] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:54.958776 19870 raft_consensus.cc:359] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.960395 19870 raft_consensus.cc:385] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.961033 19870 raft_consensus.cc:740] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.962507 19870 consensus_queue.cc:260] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.961089 19876 raft_consensus.cc:2804] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.965945 19876 raft_consensus.cc:697] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:54.966518 19870 ts_tablet_manager.cc:1434] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:26:54.966956 19876 consensus_queue.cc:237] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:54.968422 19870 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:54.973402 19868 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:54.977628 19870 tablet_bootstrap.cc:654] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.989734 19868 tablet_bootstrap.cc:654] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.994866 19575 catalog_manager.cc:5697] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.997267 19867 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:54.997951 19867 ts_tablet_manager.cc:1403] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.010s
I20260709 12:26:54.998278 19575 catalog_manager.cc:5697] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.999476 19870 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:55.000123 19870 ts_tablet_manager.cc:1403] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.019s
I20260709 12:26:55.001240 19867 raft_consensus.cc:359] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.000519 19575 catalog_manager.cc:5697] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.002055 19867 raft_consensus.cc:385] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.002424 19867 raft_consensus.cc:740] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.003125 19870 raft_consensus.cc:359] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.003188 19867 consensus_queue.cc:260] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.004071 19870 raft_consensus.cc:385] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.004761 19870 raft_consensus.cc:740] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.003156 19575 catalog_manager.cc:5697] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.005796 19867 ts_tablet_manager.cc:1434] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:55.005676 19870 consensus_queue.cc:260] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.006942 19867 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:55.011116 19868 tablet_bootstrap.cc:492] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:55.011812 19868 ts_tablet_manager.cc:1403] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.007s
I20260709 12:26:55.014241 19867 tablet_bootstrap.cc:654] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.015318 19868 raft_consensus.cc:359] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.016207 19868 raft_consensus.cc:385] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.016569 19868 raft_consensus.cc:740] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.016801 19870 ts_tablet_manager.cc:1434] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.008s
I20260709 12:26:55.017920 19868 consensus_queue.cc:260] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.020597 19868 ts_tablet_manager.cc:1434] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:55.020664 19574 catalog_manager.cc:5697] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.021999 19868 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:55.029043 19870 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:55.029036 19868 tablet_bootstrap.cc:654] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.032430 19867 tablet_bootstrap.cc:492] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:55.033100 19867 ts_tablet_manager.cc:1403] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 12:26:55.035924 19870 tablet_bootstrap.cc:654] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.036139 19867 raft_consensus.cc:359] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.036955 19867 raft_consensus.cc:385] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.037271 19867 raft_consensus.cc:740] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.038211 19867 consensus_queue.cc:260] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.041308 19867 ts_tablet_manager.cc:1434] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:55.042482 19868 tablet_bootstrap.cc:492] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:55.043087 19868 ts_tablet_manager.cc:1403] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 12:26:55.044564 19870 tablet_bootstrap.cc:492] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:55.045238 19870 ts_tablet_manager.cc:1403] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:26:55.046252 19868 raft_consensus.cc:359] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.047091 19868 raft_consensus.cc:385] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.047381 19868 raft_consensus.cc:740] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.048172 19868 consensus_queue.cc:260] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.047465 19870 raft_consensus.cc:359] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.049247 19870 raft_consensus.cc:385] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.049540 19870 raft_consensus.cc:740] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.050268 19868 ts_tablet_manager.cc:1434] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:55.050268 19870 consensus_queue.cc:260] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.052919 19870 ts_tablet_manager.cc:1434] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:55.130631 19899 raft_consensus.cc:493] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.131313 19899 raft_consensus.cc:515] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.133713 19899 leader_election.cc:290] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:55.134696 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:55.134903 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:55.135375 19674 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:55.135636 19753 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:55.136438 19793 leader_election.cc:304] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.137346 19899 raft_consensus.cc:2804] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.137743 19899 raft_consensus.cc:493] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.138263 19899 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.144440 19899 raft_consensus.cc:515] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.146438 19899 leader_election.cc:290] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:55.147384 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.147972 19674 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.147615 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:55.148589 19753 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.153455 19674 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:55.154645 19793 leader_election.cc:304] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.154688 19753 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:55.155608 19899 raft_consensus.cc:2804] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.156240 19899 raft_consensus.cc:697] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:55.157064 19899 consensus_queue.cc:237] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.164235 19576 catalog_manager.cc:5697] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.166531 19674 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.174921 19897 consensus_queue.cc:1048] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.182776 19871 raft_consensus.cc:493] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.183352 19871 raft_consensus.cc:515] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.185904 19871 leader_election.cc:290] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.187125 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf38e1dc317d44b3a5ad6c5c59ef1338" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:55.188102 19676 raft_consensus.cc:2468] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:55.188889 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf38e1dc317d44b3a5ad6c5c59ef1338" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:55.189921 19827 raft_consensus.cc:2468] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:55.189937 19719 leader_election.cc:304] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:55.191372 19899 raft_consensus.cc:493] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.192145 19899 raft_consensus.cc:515] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.193449 19892 raft_consensus.cc:2804] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.194095 19892 raft_consensus.cc:493] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.194582 19892 raft_consensus.cc:3060] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.195555 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:55.199465 19899 leader_election.cc:290] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:55.202397 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:55.203567 19753 raft_consensus.cc:2393] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7167e508b864cc1abbeaa1b03df8422 in current term 1: Already voted for candidate 314718fb758643bfb8488f2d3d5b28c9 in this term.
I20260709 12:26:55.205013 19792 leader_election.cc:304] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:55.207562 19899 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.208696 19892 raft_consensus.cc:515] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.211349 19892 leader_election.cc:290] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.212352 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf38e1dc317d44b3a5ad6c5c59ef1338" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.213100 19674 raft_consensus.cc:3060] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.213660 19897 raft_consensus.cc:493] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.214242 19897 raft_consensus.cc:515] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.218895 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf38e1dc317d44b3a5ad6c5c59ef1338" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.218924 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:55.220172 19827 raft_consensus.cc:3060] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.220228 19825 raft_consensus.cc:2468] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:55.221006 19899 raft_consensus.cc:2749] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.222149 19718 leader_election.cc:304] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.223397 19896 raft_consensus.cc:2804] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.223779 19896 raft_consensus.cc:493] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.224109 19896 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.224694 19674 raft_consensus.cc:2468] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:55.219511 19897 leader_election.cc:290] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.228958 19871 consensus_queue.cc:1048] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.232769 19719 leader_election.cc:304] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:55.233024 19896 raft_consensus.cc:515] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.233929 19871 raft_consensus.cc:2804] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.234679 19827 raft_consensus.cc:2468] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:55.236229 19896 leader_election.cc:290] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.238500 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.239498 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.247195 19676 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.241955 19897 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:55.247309 19827 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.236277 19871 raft_consensus.cc:697] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.236465 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:55.250813 19871 consensus_queue.cc:237] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.256922 19676 raft_consensus.cc:2468] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:55.258692 19827 raft_consensus.cc:2468] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:55.260167 19719 leader_election.cc:304] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:55.261132 19897 raft_consensus.cc:2804] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.261678 19897 raft_consensus.cc:697] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.262729 19897 consensus_queue.cc:237] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.271076 19892 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.290973 19575 catalog_manager.cc:5697] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.303968 19871 consensus_queue.cc:1048] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.307420 19575 catalog_manager.cc:5697] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.315337 19897 consensus_queue.cc:1048] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.426163 19871 consensus_queue.cc:1048] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.426541 19897 consensus_queue.cc:1048] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.442589 19897 consensus_queue.cc:1048] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.444095 19876 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:55.450588 19892 consensus_queue.cc:1048] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.457083 19876 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.547241 19899 consensus_queue.cc:1048] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.561753 19873 consensus_queue.cc:1048] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.580960 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:55.581705 19753 raft_consensus.cc:606] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:55.587316 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:55.587893 19753 raft_consensus.cc:606] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:55.593600 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:55.594131 19753 raft_consensus.cc:606] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:55.599290 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:55.599812 19753 raft_consensus.cc:606] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:55.616864 19674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:56532
I20260709 12:26:55.617477 19674 raft_consensus.cc:606] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:55.632864 19827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:53008
I20260709 12:26:55.633556 19827 raft_consensus.cc:606] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:55.634416 19897 raft_consensus.cc:993] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.635002 19897 raft_consensus.cc:1081] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.636906 19674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58444
I20260709 12:26:55.637440 19674 raft_consensus.cc:493] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.637795 19674 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.643189 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:55.643894 19753 raft_consensus.cc:606] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:55.644820 19674 raft_consensus.cc:515] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.646762 19674 leader_election.cc:290] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.647567 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:55.648025 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da016cad1ae409aaf3cff5069b9dd7b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.648259 19753 raft_consensus.cc:3055] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.648708 19753 raft_consensus.cc:740] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.648792 19827 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.649492 19753 consensus_queue.cc:260] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.650525 19753 raft_consensus.cc:3060] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.656869 19753 raft_consensus.cc:2468] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.657433 19827 raft_consensus.cc:2468] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.658047 19643 leader_election.cc:304] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:55.659029 19909 raft_consensus.cc:2804] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:55.659550 19909 raft_consensus.cc:697] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:55.660470 19909 consensus_queue.cc:237] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.668465 19576 catalog_manager.cc:5697] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.720592 19892 raft_consensus.cc:993] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.721164 19897 raft_consensus.cc:1081] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.722968 19674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58444
I20260709 12:26:55.723582 19674 raft_consensus.cc:493] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.723963 19674 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.729542 19674 raft_consensus.cc:515] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.731232 19674 leader_election.cc:290] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.732189 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:55.732452 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.733052 19753 raft_consensus.cc:3055] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.733157 19827 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.733402 19753 raft_consensus.cc:740] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.734210 19753 consensus_queue.cc:260] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.735252 19753 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.739226 19827 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.740618 19643 leader_election.cc:304] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.741428 19909 raft_consensus.cc:2804] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:55.741808 19753 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.741978 19909 raft_consensus.cc:697] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:55.742905 19909 consensus_queue.cc:237] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.748445 19897 consensus_queue.cc:1048] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.750618 19576 catalog_manager.cc:5697] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.761157 19871 consensus_queue.cc:1048] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.768256 19897 raft_consensus.cc:993] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:26:55.768841 19871 raft_consensus.cc:1081] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:26:55.770512 19827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:35280
I20260709 12:26:55.771169 19827 raft_consensus.cc:493] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.771548 19827 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.777905 19827 raft_consensus.cc:515] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.780007 19827 leader_election.cc:290] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:55.781036 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.781244 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982df37c6aac46d4873e3f6fa52a9705" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:55.781916 19674 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.781977 19753 raft_consensus.cc:3055] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.782661 19753 raft_consensus.cc:740] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.783694 19753 consensus_queue.cc:260] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.785254 19753 raft_consensus.cc:3060] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.791301 19674 raft_consensus.cc:2468] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 2.
I20260709 12:26:55.792760 19793 leader_election.cc:304] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.793573 19873 raft_consensus.cc:2804] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:55.793645 19753 raft_consensus.cc:2468] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 2.
I20260709 12:26:55.794057 19873 raft_consensus.cc:697] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 2 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:55.795131 19873 consensus_queue.cc:237] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.802985 19574 catalog_manager.cc:5697] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.816998 19871 consensus_queue.cc:1048] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.828809 19897 consensus_queue.cc:1048] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.864580 19897 raft_consensus.cc:993] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.865183 19895 raft_consensus.cc:1081] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:55.866842 19674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58444
I20260709 12:26:55.867343 19674 raft_consensus.cc:493] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.867624 19674 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.875100 19674 raft_consensus.cc:515] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.876873 19674 leader_election.cc:290] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.877767 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:55.878144 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdaf68f5b6b4edea5062c4dd3bd3243" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.878396 19753 raft_consensus.cc:3055] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.878834 19753 raft_consensus.cc:740] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:55.878844 19827 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.879660 19753 consensus_queue.cc:260] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.880776 19753 raft_consensus.cc:3060] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.885051 19827 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.885999 19753 raft_consensus.cc:2468] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:55.886314 19643 leader_election.cc:304] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:55.887212 19909 raft_consensus.cc:2804] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:55.887701 19909 raft_consensus.cc:697] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:55.888366 19909 consensus_queue.cc:237] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.894876 19576 catalog_manager.cc:5697] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.978107 19876 raft_consensus.cc:993] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:26:55.978650 19909 raft_consensus.cc:1081] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:26:55.980801 19753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40932
I20260709 12:26:55.981472 19753 raft_consensus.cc:493] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.981906 19753 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.984620 19899 raft_consensus.cc:993] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:26:55.985256 19873 raft_consensus.cc:1081] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:26:55.986970 19752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40926
I20260709 12:26:55.987519 19752 raft_consensus.cc:493] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:55.987879 19752 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.989873 19753 raft_consensus.cc:515] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.991873 19753 leader_election.cc:290] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:55.993119 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.992992 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.993837 19827 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.993958 19674 raft_consensus.cc:3055] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.994375 19674 raft_consensus.cc:740] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:55.995205 19752 raft_consensus.cc:515] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.995231 19674 consensus_queue.cc:260] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:55.996784 19674 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.998404 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:55.998708 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5716ede7b3045d598c7eb0d4117a09b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:55.999171 19676 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.999351 19826 raft_consensus.cc:3055] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.999792 19826 raft_consensus.cc:740] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:56.000783 19826 consensus_queue.cc:260] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.001621 19827 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:26:56.002058 19826 raft_consensus.cc:3060] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.003018 19718 leader_election.cc:304] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:56.003902 19895 raft_consensus.cc:2804] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.004359 19895 raft_consensus.cc:697] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:56.004593 19674 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:26:56.005262 19895 consensus_queue.cc:237] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.008191 19676 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:26:56.009646 19719 leader_election.cc:304] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:56.010552 19752 leader_election.cc:290] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:56.010655 19895 raft_consensus.cc:2804] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.011899 19895 raft_consensus.cc:697] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:56.013134 19826 raft_consensus.cc:2468] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:26:56.012780 19576 catalog_manager.cc:5697] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.012883 19895 consensus_queue.cc:237] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.019906 19892 raft_consensus.cc:993] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:56.020378 19895 raft_consensus.cc:1081] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:26:56.022195 19676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58444
I20260709 12:26:56.022781 19676 raft_consensus.cc:493] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:56.023129 19676 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.028405 19576 catalog_manager.cc:5697] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.030368 19676 raft_consensus.cc:515] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.032591 19676 leader_election.cc:290] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:56.033536 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:56.033972 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7545bfae73df483783f774ac0ce2e016" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:56.034312 19752 raft_consensus.cc:3055] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:56.034658 19826 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.034694 19752 raft_consensus.cc:740] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:56.035786 19752 consensus_queue.cc:260] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.037235 19752 raft_consensus.cc:3060] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.043514 19827 raft_consensus.cc:1275] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.043761 19826 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:56.045236 19643 leader_election.cc:304] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:56.045130 19909 consensus_queue.cc:1048] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.046046 19876 raft_consensus.cc:2804] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.045825 19752 raft_consensus.cc:2468] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:26:56.048243 19876 raft_consensus.cc:697] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:56.049209 19876 consensus_queue.cc:237] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:56.054646 19752 raft_consensus.cc:1275] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.056305 19950 consensus_queue.cc:1048] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:56.058979 19574 catalog_manager.cc:5697] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.169361 19752 raft_consensus.cc:1275] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.170748 19951 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.178779 19826 raft_consensus.cc:1275] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.183666 19909 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.205884 19676 raft_consensus.cc:1275] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.207579 19873 consensus_queue.cc:1048] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.216655 19752 raft_consensus.cc:1275] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.218959 19899 consensus_queue.cc:1048] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.426389 19826 raft_consensus.cc:1275] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.427047 19676 raft_consensus.cc:1275] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.427979 19892 consensus_queue.cc:1048] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.428740 19895 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.433548 19752 raft_consensus.cc:1275] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.436098 19876 consensus_queue.cc:1048] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.440104 19826 raft_consensus.cc:1275] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.445235 19897 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.451366 19752 raft_consensus.cc:1275] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.457971 19674 raft_consensus.cc:1275] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.458156 19876 consensus_queue.cc:1048] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.459429 19827 raft_consensus.cc:1275] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.461479 19876 consensus_queue.cc:1048] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.463635 19892 consensus_queue.cc:1048] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.484112 19826 raft_consensus.cc:1275] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.485879 19951 consensus_queue.cc:1048] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.754789 19574 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55722:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:58.759035 19574 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:58.821170 19663 tablet_service.cc:1511] Processing CreateTablet for tablet fc0827c604b74032aabffa13f7f6b8ac (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:58.823669 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0827c604b74032aabffa13f7f6b8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.823794 19742 tablet_service.cc:1511] Processing CreateTablet for tablet fc0827c604b74032aabffa13f7f6b8ac (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:58.825937 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0827c604b74032aabffa13f7f6b8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.825753 19816 tablet_service.cc:1511] Processing CreateTablet for tablet fc0827c604b74032aabffa13f7f6b8ac (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:58.827883 19816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0827c604b74032aabffa13f7f6b8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.831503 19666 tablet_service.cc:1511] Processing CreateTablet for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:58.832518 19814 tablet_service.cc:1511] Processing CreateTablet for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:58.834395 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.834919 19739 tablet_service.cc:1511] Processing CreateTablet for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:58.836469 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.839015 19813 tablet_service.cc:1511] Processing CreateTablet for tablet dd007df25a9644c887c7dcac56e9866e (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:58.839031 19664 tablet_service.cc:1511] Processing CreateTablet for tablet dd007df25a9644c887c7dcac56e9866e (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:58.841149 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd007df25a9644c887c7dcac56e9866e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.845430 19817 tablet_service.cc:1511] Processing CreateTablet for tablet 2274af52b5bc446ba1a2a9692709789b (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:58.846012 19743 tablet_service.cc:1511] Processing CreateTablet for tablet dd007df25a9644c887c7dcac56e9866e (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:58.847299 19817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2274af52b5bc446ba1a2a9692709789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.848461 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 2274af52b5bc446ba1a2a9692709789b (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:58.851363 19815 tablet_service.cc:1511] Processing CreateTablet for tablet ef427f4a6e1c4f1f848cf886db908076 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:58.855883 19741 tablet_service.cc:1511] Processing CreateTablet for tablet ef427f4a6e1c4f1f848cf886db908076 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:58.857426 19812 tablet_service.cc:1511] Processing CreateTablet for tablet 51f2129291e648fcba9bd08945fbfecd (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:58.858989 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f2129291e648fcba9bd08945fbfecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.861397 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 51f2129291e648fcba9bd08945fbfecd (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:58.864091 19811 tablet_service.cc:1511] Processing CreateTablet for tablet 7e573ab1ff9649b49f6f39c01cd46b0d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:58.865674 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e573ab1ff9649b49f6f39c01cd46b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.869066 19810 tablet_service.cc:1511] Processing CreateTablet for tablet e0eaf8828fdc467aad70766b8721527c (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:58.870777 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 7e573ab1ff9649b49f6f39c01cd46b0d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:58.871035 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0eaf8828fdc467aad70766b8721527c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.873298 19736 tablet_service.cc:1511] Processing CreateTablet for tablet e0eaf8828fdc467aad70766b8721527c (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:58.874883 19665 tablet_service.cc:1511] Processing CreateTablet for tablet ef427f4a6e1c4f1f848cf886db908076 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:58.875810 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 7e573ab1ff9649b49f6f39c01cd46b0d (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:58.876588 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 889a2c4962504250a763d1a688a8adc6 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:58.877345 19666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29d404c6ede44e9ac5e49b7a8c5dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.878537 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889a2c4962504250a763d1a688a8adc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.879484 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2274af52b5bc446ba1a2a9692709789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.882225 19667 tablet_service.cc:1511] Processing CreateTablet for tablet 2274af52b5bc446ba1a2a9692709789b (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:58.877213 19815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef427f4a6e1c4f1f848cf886db908076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.884367 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd007df25a9644c887c7dcac56e9866e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.884796 19668 tablet_service.cc:1511] Processing CreateTablet for tablet 51f2129291e648fcba9bd08945fbfecd (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:58.886598 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e573ab1ff9649b49f6f39c01cd46b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.886677 19667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2274af52b5bc446ba1a2a9692709789b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.889585 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e573ab1ff9649b49f6f39c01cd46b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.888718 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0eaf8828fdc467aad70766b8721527c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.893173 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd007df25a9644c887c7dcac56e9866e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.896608 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef427f4a6e1c4f1f848cf886db908076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.898550 19668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f2129291e648fcba9bd08945fbfecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.900766 19661 tablet_service.cc:1511] Processing CreateTablet for tablet e0eaf8828fdc467aad70766b8721527c (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:58.909484 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0eaf8828fdc467aad70766b8721527c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.914846 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 889a2c4962504250a763d1a688a8adc6 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:58.916761 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889a2c4962504250a763d1a688a8adc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.893285 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef427f4a6e1c4f1f848cf886db908076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.921353 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f2129291e648fcba9bd08945fbfecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.931195 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 889a2c4962504250a763d1a688a8adc6 (DEFAULT_TABLE table=soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:58.932848 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889a2c4962504250a763d1a688a8adc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.961059 19971 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
W20260709 12:26:59.014052 19562 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.182.131:37621, user_credentials={real_user=slave}} blocked reactor thread for 49868.4us
I20260709 12:26:59.051178 19971 tablet_bootstrap.cc:654] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.073542 19972 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.128520 19972 tablet_bootstrap.cc:654] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:59.128890 19719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.129:39989, user_credentials={real_user=slave}} blocked reactor thread for 63970.8us
I20260709 12:26:59.142201 19971 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.142792 19971 ts_tablet_manager.cc:1403] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.008s
I20260709 12:26:59.145418 19974 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.146013 19971 raft_consensus.cc:359] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.147090 19971 raft_consensus.cc:385] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.147419 19971 raft_consensus.cc:740] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.148221 19971 consensus_queue.cc:260] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.151911 19971 ts_tablet_manager.cc:1434] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 12:26:59.152971 19971 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.153726 19974 tablet_bootstrap.cc:654] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.157780 19972 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.158339 19972 ts_tablet_manager.cc:1403] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.004s
I20260709 12:26:59.160661 19971 tablet_bootstrap.cc:654] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.161955 19972 raft_consensus.cc:359] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.162845 19972 raft_consensus.cc:385] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.163167 19972 raft_consensus.cc:740] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.164048 19972 consensus_queue.cc:260] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.167163 19972 ts_tablet_manager.cc:1434] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:59.168227 19972 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.171734 19971 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.172369 19971 ts_tablet_manager.cc:1403] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:26:59.175087 19972 tablet_bootstrap.cc:654] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.175554 19971 raft_consensus.cc:359] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.176334 19971 raft_consensus.cc:385] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.176648 19971 raft_consensus.cc:740] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.177439 19971 consensus_queue.cc:260] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.179688 19974 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.180255 19974 ts_tablet_manager.cc:1403] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.010s
I20260709 12:26:59.183492 19974 raft_consensus.cc:359] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.184229 19974 raft_consensus.cc:385] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.184509 19974 raft_consensus.cc:740] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.185380 19974 consensus_queue.cc:260] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.187415 19971 ts_tablet_manager.cc:1434] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:59.188176 19974 ts_tablet_manager.cc:1434] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:26:59.189337 19974 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.191308 19972 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.192050 19972 ts_tablet_manager.cc:1403] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 12:26:59.193797 19971 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.195649 19972 raft_consensus.cc:359] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.196683 19972 raft_consensus.cc:385] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.197119 19972 raft_consensus.cc:740] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.198130 19972 consensus_queue.cc:260] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.200946 19972 ts_tablet_manager.cc:1434] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:59.201458 19971 tablet_bootstrap.cc:654] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.202270 19972 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.208125 19974 tablet_bootstrap.cc:654] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.211030 19972 tablet_bootstrap.cc:654] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.212141 19971 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.212913 19971 ts_tablet_manager.cc:1403] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:26:59.224503 19971 raft_consensus.cc:359] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.225620 19971 raft_consensus.cc:385] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.225971 19971 raft_consensus.cc:740] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.227246 19971 consensus_queue.cc:260] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.231833 19971 ts_tablet_manager.cc:1434] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:26:59.232963 19971 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.234588 19974 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.235217 19974 ts_tablet_manager.cc:1403] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.012s
I20260709 12:26:59.236282 19972 tablet_bootstrap.cc:492] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.237004 19972 ts_tablet_manager.cc:1403] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.011s
I20260709 12:26:59.238617 19974 raft_consensus.cc:359] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.239527 19974 raft_consensus.cc:385] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.239823 19974 raft_consensus.cc:740] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.240581 19974 consensus_queue.cc:260] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.243943 19974 ts_tablet_manager.cc:1434] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:26:59.240671 19972 raft_consensus.cc:359] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.245148 19972 raft_consensus.cc:385] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.245476 19974 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.245605 19972 raft_consensus.cc:740] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.246722 19972 consensus_queue.cc:260] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.251505 19972 ts_tablet_manager.cc:1434] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:59.253057 19972 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.259016 19971 tablet_bootstrap.cc:654] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.261463 19972 tablet_bootstrap.cc:654] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.264739 19974 tablet_bootstrap.cc:654] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.267014 19971 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.267776 19971 ts_tablet_manager.cc:1403] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:26:59.272109 19971 raft_consensus.cc:359] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.273205 19971 raft_consensus.cc:385] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.273608 19971 raft_consensus.cc:740] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.274593 19974 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.275358 19974 ts_tablet_manager.cc:1403] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.030s	user 0.003s	sys 0.014s
I20260709 12:26:59.274648 19971 consensus_queue.cc:260] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.277633 19972 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.278103 19971 ts_tablet_manager.cc:1434] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:26:59.278229 19972 ts_tablet_manager.cc:1403] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 12:26:59.279299 19971 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.279214 19974 raft_consensus.cc:359] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.280224 19974 raft_consensus.cc:385] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.280602 19974 raft_consensus.cc:740] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.281467 19974 consensus_queue.cc:260] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.281579 19972 raft_consensus.cc:359] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.282447 19972 raft_consensus.cc:385] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.283120 19972 raft_consensus.cc:740] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.284317 19974 ts_tablet_manager.cc:1434] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 12:26:59.285712 19974 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.283998 19972 consensus_queue.cc:260] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.287878 19971 tablet_bootstrap.cc:654] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.289222 19972 ts_tablet_manager.cc:1434] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:26:59.290474 19972 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.293020 19974 tablet_bootstrap.cc:654] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.299853 19972 tablet_bootstrap.cc:654] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.313776 19972 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.314489 19972 ts_tablet_manager.cc:1403] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 12:26:59.318732 19972 raft_consensus.cc:359] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.319726 19972 raft_consensus.cc:385] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.320099 19972 raft_consensus.cc:740] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.321235 19972 consensus_queue.cc:260] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.328306 19960 raft_consensus.cc:493] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.328822 19972 ts_tablet_manager.cc:1434] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:26:59.329274 19960 raft_consensus.cc:515] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.330399 19972 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.333834 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.335461 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
W20260709 12:26:59.338367 19643 leader_election.cc:343] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.339454 19643 leader_election.cc:343] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.340708 19972 tablet_bootstrap.cc:654] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.340860 19960 leader_election.cc:290] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.340039 19643 leader_election.cc:304] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9; no voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:59.342886 19960 raft_consensus.cc:2749] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.355437 19974 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.355412 19972 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.356343 19972 ts_tablet_manager.cc:1403] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:26:59.356407 19971 tablet_bootstrap.cc:492] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.356346 19974 ts_tablet_manager.cc:1403] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.037s
I20260709 12:26:59.357189 19971 ts_tablet_manager.cc:1403] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.078s	user 0.028s	sys 0.039s
I20260709 12:26:59.359859 19972 raft_consensus.cc:359] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.360000 19974 raft_consensus.cc:359] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.360811 19972 raft_consensus.cc:385] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.360730 19971 raft_consensus.cc:359] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.361526 19972 raft_consensus.cc:740] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.361756 19971 raft_consensus.cc:385] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.362185 19971 raft_consensus.cc:740] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.362350 19972 consensus_queue.cc:260] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.363046 19971 consensus_queue.cc:260] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.364880 19972 ts_tablet_manager.cc:1434] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:59.365890 19972 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.368978 19971 ts_tablet_manager.cc:1434] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:26:59.370146 19971 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.360947 19974 raft_consensus.cc:385] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.372355 19974 raft_consensus.cc:740] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.373144 19974 consensus_queue.cc:260] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.375589 19974 ts_tablet_manager.cc:1434] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:59.376678 19974 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.381139 19971 tablet_bootstrap.cc:654] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.382875 19974 tablet_bootstrap.cc:654] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.385156 19972 tablet_bootstrap.cc:654] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.398926 19899 raft_consensus.cc:493] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.399817 19899 raft_consensus.cc:515] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.404793 19899 leader_election.cc:290] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.405546 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.406505 19972 tablet_bootstrap.cc:492] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.406715 19753 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.407428 19972 ts_tablet_manager.cc:1403] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 12:26:59.408768 19792 leader_election.cc:304] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.410406 19899 raft_consensus.cc:2804] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.411104 19899 raft_consensus.cc:493] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.411712 19899 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.414520 19971 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.415405 19971 ts_tablet_manager.cc:1403] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.046s	user 0.003s	sys 0.010s
I20260709 12:26:59.420063 19971 raft_consensus.cc:359] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.420801 19972 raft_consensus.cc:359] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.423116 19972 raft_consensus.cc:385] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.423442 19972 raft_consensus.cc:740] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.422381 19971 raft_consensus.cc:385] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.424346 19974 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.424643 19971 raft_consensus.cc:740] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.425092 19974 ts_tablet_manager.cc:1403] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.025s
I20260709 12:26:59.425544 19971 consensus_queue.cc:260] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.425900 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.426817 19674 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.428279 19971 ts_tablet_manager.cc:1434] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:26:59.427971 19899 raft_consensus.cc:515] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.428681 19974 raft_consensus.cc:359] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.429484 19974 raft_consensus.cc:385] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.429606 19971 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.429831 19974 raft_consensus.cc:740] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.430720 19974 consensus_queue.cc:260] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.424343 19972 consensus_queue.cc:260] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.431592 19899 leader_election.cc:290] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.432381 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.433259 19753 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.435503 19974 ts_tablet_manager.cc:1434] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:59.439714 19971 tablet_bootstrap.cc:654] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.439772 19974 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.448819 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.449807 19674 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.448715 19960 raft_consensus.cc:493] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.452435 19960 raft_consensus.cc:515] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.454946 19960 leader_election.cc:290] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.459118 19753 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.460814 19792 leader_election.cc:304] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.461951 19899 raft_consensus.cc:2804] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.451066 19972 ts_tablet_manager.cc:1434] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.011s
I20260709 12:26:59.462530 19899 raft_consensus.cc:697] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:59.462255 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.463892 19972 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.464099 19752 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 0.
I20260709 12:26:59.463024 19960 raft_consensus.cc:493] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.462530 19974 tablet_bootstrap.cc:654] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.465152 19960 raft_consensus.cc:515] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.467448 19960 leader_election.cc:290] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.468281 19971 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.468979 19971 ts_tablet_manager.cc:1403] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.009s
I20260709 12:26:59.468546 19899 consensus_queue.cc:237] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.471894 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:59.472106 19643 leader_election.cc:304] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:59.472775 19826 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 0.
I20260709 12:26:59.474417 19994 raft_consensus.cc:2804] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.474817 19994 raft_consensus.cc:493] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.474906 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd007df25a9644c887c7dcac56e9866e" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:59.475208 19994 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.475410 19972 tablet_bootstrap.cc:654] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.475685 19826 raft_consensus.cc:2468] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 0.
I20260709 12:26:59.477660 19674 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.478463 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd007df25a9644c887c7dcac56e9866e" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.479918 19643 leader_election.cc:304] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.480862 19971 raft_consensus.cc:359] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.481926 19971 raft_consensus.cc:385] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.482343 19971 raft_consensus.cc:740] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.483417 19971 consensus_queue.cc:260] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.484863 19974 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
W20260709 12:26:59.485103 19643 leader_election.cc:343] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.485651 19974 ts_tablet_manager.cc:1403] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.001s
I20260709 12:26:59.486436 19960 raft_consensus.cc:2804] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.486899 19960 raft_consensus.cc:493] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.487249 19960 raft_consensus.cc:3060] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.489748 19974 raft_consensus.cc:359] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.490589 19974 raft_consensus.cc:385] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.490916 19974 raft_consensus.cc:740] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.491791 19974 consensus_queue.cc:260] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.492537 19994 raft_consensus.cc:515] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.495623 19972 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.496428 19972 ts_tablet_manager.cc:1403] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.008s
I20260709 12:26:59.499795 19971 ts_tablet_manager.cc:1434] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 12:26:59.503449 19974 ts_tablet_manager.cc:1434] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:59.508203 19971 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.508147 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.508865 19752 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.513108 19995 raft_consensus.cc:493] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.513654 19994 leader_election.cc:290] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.514621 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:59.515317 19826 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.517613 19752 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 1.
I20260709 12:26:59.517545 19960 raft_consensus.cc:515] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.519025 19643 leader_election.cc:304] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:59.520079 19960 leader_election.cc:290] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.520747 19960 raft_consensus.cc:2804] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.513698 19995 raft_consensus.cc:515] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.521507 19960 raft_consensus.cc:697] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:59.521850 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd007df25a9644c887c7dcac56e9866e" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:59.522612 19827 raft_consensus.cc:3060] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.522645 19960 consensus_queue.cc:237] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.523478 19995 leader_election.cc:290] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.525292 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.526005 19753 raft_consensus.cc:2468] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.526919 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.527407 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd007df25a9644c887c7dcac56e9866e" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.528932 19974 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.506199 19972 raft_consensus.cc:359] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.529951 19972 raft_consensus.cc:385] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.529366 19792 leader_election.cc:304] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.530233 19972 raft_consensus.cc:740] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.530970 19995 raft_consensus.cc:2804] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.531411 19995 raft_consensus.cc:493] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.531141 19972 consensus_queue.cc:260] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
W20260709 12:26:59.531435 19643 leader_election.cc:343] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.532055 19793 leader_election.cc:343] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.531909 19995 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.534255 19971 tablet_bootstrap.cc:654] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.539219 19972 ts_tablet_manager.cc:1434] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:26:59.540416 19972 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: Bootstrap starting.
I20260709 12:26:59.541152 19826 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 1.
I20260709 12:26:59.543035 19827 raft_consensus.cc:2468] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 1.
I20260709 12:26:59.545181 19643 leader_election.cc:304] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.546356 19974 tablet_bootstrap.cc:654] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.546574 19994 raft_consensus.cc:2804] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.547200 19994 raft_consensus.cc:697] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:59.548015 19994 consensus_queue.cc:237] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.563313 19995 raft_consensus.cc:515] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.567054 19995 leader_election.cc:290] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.569536 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.570538 19752 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.574596 19973 raft_consensus.cc:493] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.575281 19973 raft_consensus.cc:515] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.577585 19973 leader_election.cc:290] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.574000 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.570796 19572 catalog_manager.cc:5697] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.579152 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:59.579964 19827 raft_consensus.cc:2468] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:59.582195 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.584009 19718 leader_election.cc:304] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
W20260709 12:26:59.581843 19793 leader_election.cc:343] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.573554 19575 catalog_manager.cc:5697] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.586928 19975 raft_consensus.cc:2804] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:59.586716 19719 leader_election.cc:343] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.587781 19972 tablet_bootstrap.cc:654] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.588063 19975 raft_consensus.cc:493] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.589721 19975 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.595063 19974 tablet_bootstrap.cc:492] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.596006 19974 ts_tablet_manager.cc:1403] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.022s
I20260709 12:26:59.597342 19971 tablet_bootstrap.cc:492] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.600425 19971 ts_tablet_manager.cc:1403] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.023s
I20260709 12:26:59.601181 19974 raft_consensus.cc:359] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.599527 19752 raft_consensus.cc:2468] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.602197 19974 raft_consensus.cc:385] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.602545 19975 raft_consensus.cc:515] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.602643 19974 raft_consensus.cc:740] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.603504 19792 leader_election.cc:304] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:59.605096 20002 raft_consensus.cc:2804] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.604982 19974 consensus_queue.cc:260] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.605571 19971 raft_consensus.cc:359] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.606386 19971 raft_consensus.cc:385] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.605752 20002 raft_consensus.cc:697] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:59.607592 20002 consensus_queue.cc:237] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.609543 19974 ts_tablet_manager.cc:1434] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.006s
I20260709 12:26:59.611049 19974 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.606698 19971 raft_consensus.cc:740] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.612805 19994 raft_consensus.cc:493] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.612607 19971 consensus_queue.cc:260] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.613343 19994 raft_consensus.cc:515] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.614938 19971 ts_tablet_manager.cc:1434] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:26:59.616086 19971 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: Bootstrap starting.
I20260709 12:26:59.617774 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:59.618602 19827 raft_consensus.cc:2468] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 0.
I20260709 12:26:59.619095 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.619820 19674 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.620100 19643 leader_election.cc:304] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.621129 19960 raft_consensus.cc:2804] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.621559 19960 raft_consensus.cc:493] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.621954 19960 raft_consensus.cc:3060] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.623059 19974 tablet_bootstrap.cc:654] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.629226 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
W20260709 12:26:59.631117 19643 leader_election.cc:343] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.632932 19971 tablet_bootstrap.cc:654] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.634184 19995 raft_consensus.cc:493] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.634794 19995 raft_consensus.cc:515] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.638610 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.638936 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.639452 19676 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.639613 19751 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.637814 19995 leader_election.cc:290] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.641034 19793 leader_election.cc:304] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.641956 19994 leader_election.cc:290] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.643425 20002 raft_consensus.cc:2804] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.644095 20002 raft_consensus.cc:493] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.644614 20002 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.643108 19960 raft_consensus.cc:515] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.650097 19973 raft_consensus.cc:493] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.650807 19973 raft_consensus.cc:515] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.651130 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.652711 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:59.653379 19674 raft_consensus.cc:2468] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:59.653434 19827 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.655763 19973 leader_election.cc:290] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.654007 19975 leader_election.cc:290] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.654371 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
W20260709 12:26:59.654395 19643 leader_election.cc:343] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.654862 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.659027 19676 raft_consensus.cc:2468] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 0.
I20260709 12:26:59.659516 19719 leader_election.cc:304] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
W20260709 12:26:59.661296 19718 leader_election.cc:343] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.662060 19973 raft_consensus.cc:2804] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.663357 19973 raft_consensus.cc:697] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:59.664795 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:59.665534 19825 raft_consensus.cc:3060] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.666285 19974 tablet_bootstrap.cc:492] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.666883 19974 ts_tablet_manager.cc:1403] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.013s
I20260709 12:26:59.666103 19973 consensus_queue.cc:237] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.663527 19960 leader_election.cc:290] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.670215 19974 raft_consensus.cc:359] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.671007 19974 raft_consensus.cc:385] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.671360 19974 raft_consensus.cc:740] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.671847 19719 leader_election.cc:304] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:59.672183 19974 consensus_queue.cc:260] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.674196 19975 raft_consensus.cc:2804] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.674623 19975 raft_consensus.cc:493] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.675009 19975 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.677453 19972 tablet_bootstrap.cc:492] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: No bootstrap required, opened a new log
I20260709 12:26:59.678107 19972 ts_tablet_manager.cc:1403] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.014s
I20260709 12:26:59.680011 19971 tablet_bootstrap.cc:492] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: No bootstrap required, opened a new log
I20260709 12:26:59.688499 19971 ts_tablet_manager.cc:1403] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.004s
I20260709 12:26:59.684294 19574 catalog_manager.cc:5697] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.686599 19975 raft_consensus.cc:515] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.692282 19676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.692975 19676 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.693578 19975 leader_election.cc:290] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.686996 19972 raft_consensus.cc:359] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.694341 19972 raft_consensus.cc:385] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.694669 19972 raft_consensus.cc:740] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.695524 19972 consensus_queue.cc:260] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.697125 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:26:59.697336 19827 raft_consensus.cc:2468] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:59.697935 19826 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.698407 19972 ts_tablet_manager.cc:1434] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:26:59.699594 19995 raft_consensus.cc:493] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.700172 19995 raft_consensus.cc:515] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.702553 19995 leader_election.cc:290] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.703313 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.703915 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:26:59.704027 19674 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.704782 19752 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 0.
I20260709 12:26:59.705439 19793 leader_election.cc:304] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.706564 19995 raft_consensus.cc:2804] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.706971 19995 raft_consensus.cc:493] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.707340 19995 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.682334 19825 raft_consensus.cc:2468] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 1.
I20260709 12:26:59.709504 19643 leader_election.cc:304] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.711295 19960 raft_consensus.cc:2804] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.711874 19960 raft_consensus.cc:697] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:26:59.712867 19960 consensus_queue.cc:237] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.704694 20002 raft_consensus.cc:515] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.720008 20002 leader_election.cc:290] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.717904 19995 raft_consensus.cc:515] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.721192 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.721910 19674 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.724313 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:26:59.724584 19971 raft_consensus.cc:359] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.725169 19675 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.725404 19971 raft_consensus.cc:385] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.725696 19971 raft_consensus.cc:740] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.727674 19974 ts_tablet_manager.cc:1434] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.060s	user 0.013s	sys 0.001s
I20260709 12:26:59.728790 19974 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: Bootstrap starting.
I20260709 12:26:59.729811 19676 raft_consensus.cc:2468] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:59.731122 19826 raft_consensus.cc:2468] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 1.
I20260709 12:26:59.732331 19719 leader_election.cc:304] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:26:59.733500 19971 consensus_queue.cc:260] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.736616 19971 ts_tablet_manager.cc:1434] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:26:59.737082 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.737739 19752 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:59.740959 19624 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:59.744321 19995 leader_election.cc:290] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:26:59.744911 19675 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.745539 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:26:59.735560 19572 catalog_manager.cc:5697] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.746209 19751 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.747077 19572 catalog_manager.cc:5697] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 1 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.748973 19793 leader_election.cc:304] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.753310 19995 raft_consensus.cc:2804] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.753873 19995 raft_consensus.cc:697] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:59.754825 19995 consensus_queue.cc:237] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.755877 19752 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.757189 19751 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.759362 20014 raft_consensus.cc:2804] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.759779 19674 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 1.
I20260709 12:26:59.760277 20014 raft_consensus.cc:697] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:26:59.761088 19974 tablet_bootstrap.cc:654] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.762187 19792 leader_election.cc:304] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:26:59.762163 20014 consensus_queue.cc:237] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.766814 19995 raft_consensus.cc:2804] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.767551 19995 raft_consensus.cc:697] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:26:59.767915 19574 catalog_manager.cc:5697] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.768447 19995 consensus_queue.cc:237] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.785187 19576 catalog_manager.cc:5697] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 1 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.811008 19974 tablet_bootstrap.cc:492] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: No bootstrap required, opened a new log
I20260709 12:26:59.811801 19974 ts_tablet_manager.cc:1403] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.022s
I20260709 12:26:59.814357 19974 raft_consensus.cc:359] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.814873 19974 raft_consensus.cc:385] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.815199 19974 raft_consensus.cc:740] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.814682 19575 catalog_manager.cc:5697] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.815824 19974 consensus_queue.cc:260] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.816136 19575 catalog_manager.cc:5697] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 1 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.817862 19974 ts_tablet_manager.cc:1434] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:26:59.858444 19995 consensus_queue.cc:1048] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.869920 20014 raft_consensus.cc:493] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.870467 20014 raft_consensus.cc:515] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:26:59.872535 20014 leader_election.cc:290] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:26:59.873914 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314718fb758643bfb8488f2d3d5b28c9" is_pre_election: true
I20260709 12:26:59.874478 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0827c604b74032aabffa13f7f6b8ac" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:26:59.875327 19826 raft_consensus.cc:2393] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8feef7fb24c44570bb36c3db8b063617 in current term 1: Already voted for candidate 314718fb758643bfb8488f2d3d5b28c9 in this term.
I20260709 12:26:59.876533 19718 leader_election.cc:304] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617; no voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:59.877331 20014 raft_consensus.cc:3060] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.882143 20002 consensus_queue.cc:1048] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.884984 20014 raft_consensus.cc:2749] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.924752 19960 consensus_queue.cc:1048] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.928944 19826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:53008
I20260709 12:26:59.929728 19826 raft_consensus.cc:606] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:59.936681 19994 consensus_queue.cc:1048] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.945711 19751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:59.946331 19751 raft_consensus.cc:606] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:26:59.954988 19826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:53008
I20260709 12:26:59.955704 19826 raft_consensus.cc:606] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.960947 19826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:53008
I20260709 12:26:59.961458 19826 raft_consensus.cc:606] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.966073 19826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:53008
I20260709 12:26:59.966563 19826 raft_consensus.cc:606] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.972153 19674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
mode: GRACEFUL
new_leader_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:56532
I20260709 12:26:59.972822 19674 raft_consensus.cc:606] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Received request to transfer leadership to TS 8feef7fb24c44570bb36c3db8b063617
I20260709 12:26:59.975334 19960 consensus_queue.cc:1048] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.979488 19751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:48422
I20260709 12:26:59.980029 19751 raft_consensus.cc:606] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Received request to transfer leadership to TS a7167e508b864cc1abbeaa1b03df8422
I20260709 12:26:59.985726 19751 raft_consensus.cc:3060] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.994889 19960 consensus_queue.cc:1048] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.041960 19960 raft_consensus.cc:493] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.042546 19960 raft_consensus.cc:515] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.044814 19960 leader_election.cc:290] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.045644 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8feef7fb24c44570bb36c3db8b063617" is_pre_election: true
I20260709 12:27:00.045835 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7167e508b864cc1abbeaa1b03df8422" is_pre_election: true
I20260709 12:27:00.046468 19752 raft_consensus.cc:2393] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 314718fb758643bfb8488f2d3d5b28c9 in current term 1: Already voted for candidate a7167e508b864cc1abbeaa1b03df8422 in this term.
I20260709 12:27:00.047467 19643 leader_election.cc:304] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9; no voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422
I20260709 12:27:00.048069 19960 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.053701 19960 raft_consensus.cc:2749] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.080183 19975 consensus_queue.cc:1048] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.087193 20014 raft_consensus.cc:993] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:27:00.087920 20012 raft_consensus.cc:1081] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:27:00.092104 19675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58444
I20260709 12:27:00.093892 20002 consensus_queue.cc:1048] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.095404 19675 raft_consensus.cc:493] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.095944 19675 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.096189 20012 consensus_queue.cc:1048] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.103001 20002 consensus_queue.cc:1048] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.104446 19675 raft_consensus.cc:515] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.113395 19675 leader_election.cc:290] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.118772 19826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.120682 19899 raft_consensus.cc:993] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.120532 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2274af52b5bc446ba1a2a9692709789b" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:27:00.121449 19751 raft_consensus.cc:3055] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.121835 19751 raft_consensus.cc:740] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.122416 19960 consensus_queue.cc:1048] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.122695 20002 raft_consensus.cc:1081] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.122807 19751 consensus_queue.cc:260] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.124450 19751 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.132687 19753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40926
I20260709 12:27:00.133481 19753 raft_consensus.cc:493] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.133917 19753 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.136150 19751 raft_consensus.cc:2468] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:27:00.144680 19643 leader_election.cc:304] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: a7167e508b864cc1abbeaa1b03df8422
I20260709 12:27:00.147202 20012 consensus_queue.cc:1048] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.148764 19753 raft_consensus.cc:515] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.151741 19960 raft_consensus.cc:2804] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.152434 19960 raft_consensus.cc:697] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:27:00.153455 19960 consensus_queue.cc:237] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.159952 19753 leader_election.cc:290] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.165241 20000 consensus_queue.cc:1048] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.161113 19825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.163811 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f2129291e648fcba9bd08945fbfecd" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:00.166749 19674 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.171308 19825 raft_consensus.cc:3055] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.172118 20014 raft_consensus.cc:993] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:00.172740 20014 raft_consensus.cc:1081] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Signalling peer a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:00.171761 19825 raft_consensus.cc:740] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:00.175314 19825 consensus_queue.cc:260] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.176774 19824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:35280
I20260709 12:27:00.177000 19825 raft_consensus.cc:3060] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.177558 19824 raft_consensus.cc:493] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.177798 19674 raft_consensus.cc:2468] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.177984 19824 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.179212 19973 consensus_queue.cc:1048] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.179672 19719 leader_election.cc:304] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:27:00.180608 20014 raft_consensus.cc:2804] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.181154 20014 raft_consensus.cc:697] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.182037 20014 consensus_queue.cc:237] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.167524 19574 catalog_manager.cc:5697] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.189463 19824 raft_consensus.cc:515] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.192145 19825 raft_consensus.cc:2468] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.192377 19826 raft_consensus.cc:1240] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Rejecting Update request from peer 8feef7fb24c44570bb36c3db8b063617 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.194464 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:27:00.196053 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889a2c4962504250a763d1a688a8adc6" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:00.195122 19753 raft_consensus.cc:3055] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.197225 19753 raft_consensus.cc:740] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.197170 20014 consensus_queue.cc:1059] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.200305 19753 consensus_queue.cc:260] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.201370 19753 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.197328 19824 leader_election.cc:290] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:27:00.211452 19753 raft_consensus.cc:2468] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 2.
W20260709 12:27:00.211966 20014 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:00.214044 19792 leader_election.cc:304] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 314718fb758643bfb8488f2d3d5b28c9
I20260709 12:27:00.215025 19899 raft_consensus.cc:2804] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.215502 19899 raft_consensus.cc:697] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:00.216317 19899 consensus_queue.cc:237] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.222505 19574 catalog_manager.cc:5697] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.231189 19575 catalog_manager.cc:5697] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 1 to 2, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 2 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.248836 19899 consensus_queue.cc:1048] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.259749 20002 consensus_queue.cc:1048] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.271803 19995 raft_consensus.cc:993] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.272339 20002 raft_consensus.cc:1081] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.274252 19753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40926
I20260709 12:27:00.274894 19753 raft_consensus.cc:493] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.275295 19753 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.280584 19753 raft_consensus.cc:515] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.282507 19753 leader_election.cc:290] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.283432 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:00.284124 19674 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.284224 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e573ab1ff9649b49f6f39c01cd46b0d" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.285023 19824 raft_consensus.cc:3055] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.285384 19824 raft_consensus.cc:740] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:00.286175 19824 consensus_queue.cc:260] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.287192 19824 raft_consensus.cc:3060] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.290858 19674 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.292093 19719 leader_election.cc:304] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:27:00.292958 20014 raft_consensus.cc:2804] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.293478 20014 raft_consensus.cc:697] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.293661 19824 raft_consensus.cc:2468] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.294404 20014 consensus_queue.cc:237] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.301702 19574 catalog_manager.cc:5697] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.323318 20002 consensus_queue.cc:1048] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.338248 20036 raft_consensus.cc:993] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: : Instructing follower 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:27:00.338174 19899 consensus_queue.cc:1048] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.338881 20036 raft_consensus.cc:1081] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Signalling peer 314718fb758643bfb8488f2d3d5b28c9 to start an election
I20260709 12:27:00.341948 19674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
 from {username='slave'} at 127.0.0.1:58438
I20260709 12:27:00.342555 19674 raft_consensus.cc:493] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.342934 19674 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.350162 20002 raft_consensus.cc:993] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.350824 20036 raft_consensus.cc:1081] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.352692 19752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40926
I20260709 12:27:00.353443 19752 raft_consensus.cc:493] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.353825 19752 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.354714 19674 raft_consensus.cc:515] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.357165 19674 leader_election.cc:290] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Requested vote from peers 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.357679 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:27:00.358304 19753 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.358294 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29d404c6ede44e9ac5e49b7a8c5dd2d" candidate_uuid: "314718fb758643bfb8488f2d3d5b28c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.359175 19824 raft_consensus.cc:3055] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.359483 19824 raft_consensus.cc:740] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:00.360321 19824 consensus_queue.cc:260] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.361486 19824 raft_consensus.cc:3060] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.361955 19752 raft_consensus.cc:515] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.364151 19752 leader_election.cc:290] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.365224 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:00.365830 19674 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.365903 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef427f4a6e1c4f1f848cf886db908076" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.366655 19827 raft_consensus.cc:3055] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.366971 19827 raft_consensus.cc:740] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:00.367441 19753 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:27:00.367913 19827 consensus_queue.cc:260] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.368568 19643 leader_election.cc:304] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:27:00.369450 20000 raft_consensus.cc:2804] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.369503 19827 raft_consensus.cc:3060] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.370102 20000 raft_consensus.cc:697] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Leader. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:27:00.371040 20000 consensus_queue.cc:237] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.372251 19824 raft_consensus.cc:2468] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314718fb758643bfb8488f2d3d5b28c9 in term 2.
I20260709 12:27:00.375303 19674 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.376564 19719 leader_election.cc:304] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, 8feef7fb24c44570bb36c3db8b063617; no voters: 
I20260709 12:27:00.377430 20014 raft_consensus.cc:2804] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.377967 20014 raft_consensus.cc:697] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.378851 20014 consensus_queue.cc:237] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.379664 19827 raft_consensus.cc:2468] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.380342 19574 catalog_manager.cc:5697] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 reported cstate change: term changed from 1 to 2, leader changed from a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131) to 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129). New cstate: current_term: 2 leader_uuid: "314718fb758643bfb8488f2d3d5b28c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.387478 19575 catalog_manager.cc:5697] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.447227 19994 raft_consensus.cc:993] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: : Instructing follower 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.447759 19960 raft_consensus.cc:1081] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Signalling peer 8feef7fb24c44570bb36c3db8b063617 to start an election
I20260709 12:27:00.449482 19753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
 from {username='slave'} at 127.0.0.1:40932
I20260709 12:27:00.449965 19753 raft_consensus.cc:493] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:00.450246 19753 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.455221 19753 raft_consensus.cc:515] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.456885 19753 leader_election.cc:290] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131:37621)
I20260709 12:27:00.457993 19827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
I20260709 12:27:00.458117 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0eaf8828fdc467aad70766b8721527c" candidate_uuid: "8feef7fb24c44570bb36c3db8b063617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:00.458618 19827 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.458752 19674 raft_consensus.cc:3055] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.459138 19674 raft_consensus.cc:740] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:27:00.459823 19674 consensus_queue.cc:260] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.460882 19674 raft_consensus.cc:3060] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.464391 19827 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.465725 19718 leader_election.cc:304] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:27:00.466585 20014 raft_consensus.cc:2804] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:00.467115 20014 raft_consensus.cc:697] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Leader. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:00.467164 19674 raft_consensus.cc:2468] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8feef7fb24c44570bb36c3db8b063617 in term 2.
I20260709 12:27:00.468042 20014 consensus_queue.cc:237] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:00.475332 19575 catalog_manager.cc:5697] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 reported cstate change: term changed from 1 to 2, leader changed from 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129) to 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130). New cstate: current_term: 2 leader_uuid: "8feef7fb24c44570bb36c3db8b063617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.540905 19827 raft_consensus.cc:3060] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.546327 19827 raft_consensus.cc:1275] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.547664 19960 consensus_queue.cc:1048] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.559736 19753 raft_consensus.cc:1275] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.562114 20000 consensus_queue.cc:1048] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.585506 19674 raft_consensus.cc:1275] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.586949 20014 consensus_queue.cc:1048] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.596613 19827 raft_consensus.cc:1275] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.598820 20014 consensus_queue.cc:1048] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.686657 19674 raft_consensus.cc:3060] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.694706 19674 raft_consensus.cc:1275] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.696095 20036 consensus_queue.cc:1048] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.703930 19753 raft_consensus.cc:1275] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.706434 19899 consensus_queue.cc:1048] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.855122 19753 raft_consensus.cc:1275] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.856475 19960 consensus_queue.cc:1048] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.865231 19827 raft_consensus.cc:1275] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 314718fb758643bfb8488f2d3d5b28c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.867591 19994 consensus_queue.cc:1048] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.868324 19827 raft_consensus.cc:1275] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.869902 20012 consensus_queue.cc:1048] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.879556 19827 raft_consensus.cc:1275] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.881366 20012 consensus_queue.cc:1048] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.882211 19674 raft_consensus.cc:1275] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.886327 20012 consensus_queue.cc:1048] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.892856 19674 raft_consensus.cc:1275] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.901616 20046 consensus_queue.cc:1048] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:27:00.907584 19674 raft_consensus.cc:1275] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.910959 20046 consensus_queue.cc:1048] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.919261 19827 raft_consensus.cc:1275] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Refusing update from remote peer 8feef7fb24c44570bb36c3db8b063617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.922494 20014 consensus_queue.cc:1048] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:02.983819 19574 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55722:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:03.005295 19574 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55722:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:03.180980  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.209818 20090 tablet.cc:1724] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.220032 20088 tablet.cc:1724] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:03.220744 20085 log.cc:927] Time spent T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Append to log took a long time: real 0.084s	user 0.003s	sys 0.002s
I20260709 12:27:03.338421 20103 tablet.cc:1724] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.359319 20111 tablet.cc:1724] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:03.356539 19643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.182.131:37621, user_credentials={real_user=slave}} blocked reactor thread for 84713.7us
I20260709 12:27:03.375236 20115 tablet.cc:1724] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.400086 20118 tablet.cc:1724] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.405846 20117 tablet.cc:1724] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.417351 20103 tablet.cc:1724] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.385109 20090 tablet.cc:1724] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.445309 20111 tablet.cc:1724] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.447141 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742"
dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
mode: GRACEFUL
new_leader_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:48430
I20260709 12:27:03.447762 20088 tablet.cc:1724] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.454547 19753 raft_consensus.cc:606] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Received request to transfer leadership to TS a7167e508b864cc1abbeaa1b03df8422
I20260709 12:27:03.409574 20120 tablet.cc:1724] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.459226 20119 tablet.cc:1724] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.400032 20114 tablet.cc:1724] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.472468 20113 tablet.cc:1724] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.475024 20116 tablet.cc:1724] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.490736 20118 tablet.cc:1724] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.502928 20118 tablet.cc:1724] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.521270 20117 tablet.cc:1724] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.519953 20090 tablet.cc:1724] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.531592 20111 tablet.cc:1724] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.523610 20120 tablet.cc:1724] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.521297 20119 tablet.cc:1724] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.527940 20103 tablet.cc:1724] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.553901 20114 tablet.cc:1724] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.563905 20119 tablet.cc:1724] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.572772 20113 tablet.cc:1724] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:03.577966 19678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93"
dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
mode: GRACEFUL
new_leader_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:56542
I20260709 12:27:03.578809 19678 raft_consensus.cc:606] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Received request to transfer leadership to TS a7167e508b864cc1abbeaa1b03df8422
I20260709 12:27:03.582325  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:03.583039  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:03.596277 19574 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: soft_deleted_table [id=0a601f4e6b1d45c08836795ee61d6152] alter complete (version 1)
I20260709 12:27:03.770799 20099 raft_consensus.cc:993] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: : Instructing follower a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:03.771442 20092 raft_consensus.cc:1081] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Signalling peer a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:03.773283 19824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:35280
I20260709 12:27:03.773824 19824 raft_consensus.cc:493] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.774237 19824 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.780746 19824 raft_consensus.cc:515] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.782616 19824 leader_election.cc:290] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 3 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:27:03.783799 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:27:03.783380 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0b50d72b84baf9d7f34e95b0ca742" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:03.784431 19753 raft_consensus.cc:3055] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.784794 19753 raft_consensus.cc:740] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8feef7fb24c44570bb36c3db8b063617, State: Running, Role: LEADER
I20260709 12:27:03.784816 19678 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.785772 19753 consensus_queue.cc:260] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.787026 19753 raft_consensus.cc:3060] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.792711 19678 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 3.
I20260709 12:27:03.794124 19793 leader_election.cc:304] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314718fb758643bfb8488f2d3d5b28c9, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:27:03.794153 19753 raft_consensus.cc:2468] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 3.
I20260709 12:27:03.795132 20084 raft_consensus.cc:2804] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.795640 20084 raft_consensus.cc:697] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 3 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:03.796494 20084 consensus_queue.cc:237] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.805516 19574 catalog_manager.cc:5697] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 2 to 3, leader changed from 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130) to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.883450 20095 raft_consensus.cc:993] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: : Instructing follower a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:03.884112 19994 raft_consensus.cc:1081] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Signalling peer a7167e508b864cc1abbeaa1b03df8422 to start an election
I20260709 12:27:03.885720 19824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93"
dest_uuid: "a7167e508b864cc1abbeaa1b03df8422"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:27:03.886270 19824 raft_consensus.cc:493] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.886536 19824 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.892506 19824 raft_consensus.cc:515] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.894819 19824 leader_election.cc:290] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 3 election: Requested vote from peers 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989), 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635)
I20260709 12:27:03.895481 19678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "314718fb758643bfb8488f2d3d5b28c9"
I20260709 12:27:03.895872 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17d64896ea4448a9c6cf54843ab6f93" candidate_uuid: "a7167e508b864cc1abbeaa1b03df8422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8feef7fb24c44570bb36c3db8b063617"
I20260709 12:27:03.896270 19678 raft_consensus.cc:3055] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.896543 19753 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.896749 19678 raft_consensus.cc:740] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 314718fb758643bfb8488f2d3d5b28c9, State: Running, Role: LEADER
I20260709 12:27:03.897771 19678 consensus_queue.cc:260] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.899242 19678 raft_consensus.cc:3060] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.904418 19753 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 3.
I20260709 12:27:03.905912 19792 leader_election.cc:304] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8feef7fb24c44570bb36c3db8b063617, a7167e508b864cc1abbeaa1b03df8422; no voters: 
I20260709 12:27:03.906702 19678 raft_consensus.cc:2468] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7167e508b864cc1abbeaa1b03df8422 in term 3.
I20260709 12:27:03.906746 20084 raft_consensus.cc:2804] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.907518 20084 raft_consensus.cc:697] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 3 LEADER]: Becoming Leader. State: Replica: a7167e508b864cc1abbeaa1b03df8422, State: Running, Role: LEADER
I20260709 12:27:03.908468 20084 consensus_queue.cc:237] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } }
I20260709 12:27:03.917023 19574 catalog_manager.cc:5697] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 reported cstate change: term changed from 2 to 3, leader changed from 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129) to a7167e508b864cc1abbeaa1b03df8422 (127.6.182.131). New cstate: current_term: 3 leader_uuid: "a7167e508b864cc1abbeaa1b03df8422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7167e508b864cc1abbeaa1b03df8422" member_type: VOTER last_known_addr { host: "127.6.182.131" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.341447 19753 raft_consensus.cc:1275] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.342700 20084 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.363247 19678 raft_consensus.cc:1275] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.364825 20084 consensus_queue.cc:1048] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.382234 19674 raft_consensus.cc:1275] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.385241 20084 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314718fb758643bfb8488f2d3d5b28c9" member_type: VOTER last_known_addr { host: "127.6.182.129" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.396461 19753 raft_consensus.cc:1275] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Refusing update from remote peer a7167e508b864cc1abbeaa1b03df8422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.398562 20134 consensus_queue.cc:1048] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8feef7fb24c44570bb36c3db8b063617" member_type: VOTER last_known_addr { host: "127.6.182.130" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.584390  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:04.591215  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:04.591645  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.592881  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.599018  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:05.599591  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.600726  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.606689  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:06.607326  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:07.608484  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:07.613873  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:07.614346  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:08.615504  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:08.621405  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:08.621974  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:09.623344  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.629498  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:09.630021  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:10.631304  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.638490  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:10.638965  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:11.640142  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:11.646034  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:11.646560  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:12.647526  6874 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.652971  6874 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:12.653453  6874 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:13.720335  6874 tablet_server.cc:179] TabletServer@127.6.182.129:0 shutting down...
W20260709 12:27:13.746232 19719 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 12:27:13.757197 19719 consensus_peers.cc:597] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.770988 19719 consensus_peers.cc:597] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.776595  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:13.777774  6874 tablet_replica.cc:333] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.779160  6874 raft_consensus.cc:2243] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.779917  6874 raft_consensus.cc:2272] T 51f2129291e648fcba9bd08945fbfecd P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.782888  6874 tablet_replica.cc:333] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.783674  6874 raft_consensus.cc:2243] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.784282  6874 raft_consensus.cc:2272] T 7e573ab1ff9649b49f6f39c01cd46b0d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.788450  6874 tablet_replica.cc:333] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.789629  6874 raft_consensus.cc:2243] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.790630  6874 raft_consensus.cc:2272] T dd007df25a9644c887c7dcac56e9866e P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.793637  6874 tablet_replica.cc:333] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.794265  6874 raft_consensus.cc:2243] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.795327  6874 raft_consensus.cc:2272] T 889a2c4962504250a763d1a688a8adc6 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.799427  6874 tablet_replica.cc:333] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.800043  6874 raft_consensus.cc:2243] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.800611  6874 raft_consensus.cc:2272] T ef427f4a6e1c4f1f848cf886db908076 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.803264  6874 tablet_replica.cc:333] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.803879  6874 raft_consensus.cc:2243] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.804852  6874 raft_consensus.cc:2272] T fc0827c604b74032aabffa13f7f6b8ac P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.807561  6874 tablet_replica.cc:333] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.808149  6874 raft_consensus.cc:2243] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.808686  6874 raft_consensus.cc:2272] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.811120  6874 tablet_replica.cc:333] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.812189  6874 raft_consensus.cc:2243] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.812940  6874 raft_consensus.cc:2272] T a4f0b50d72b84baf9d7f34e95b0ca742 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.817191  6874 tablet_replica.cc:333] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.818019  6874 raft_consensus.cc:2243] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.819417  6874 raft_consensus.cc:2272] T 2da016cad1ae409aaf3cff5069b9dd7b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.822610  6874 tablet_replica.cc:333] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.823217  6874 raft_consensus.cc:2243] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.823807  6874 raft_consensus.cc:2272] T e0eaf8828fdc467aad70766b8721527c P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.826480  6874 tablet_replica.cc:333] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.827010  6874 raft_consensus.cc:2243] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.828239  6874 raft_consensus.cc:2272] T 7545bfae73df483783f774ac0ce2e016 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.831722  6874 tablet_replica.cc:333] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.832425  6874 raft_consensus.cc:2243] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.833448  6874 raft_consensus.cc:2272] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.836099  6874 tablet_replica.cc:333] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.836826  6874 raft_consensus.cc:2243] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.837656  6874 raft_consensus.cc:2272] T 982df37c6aac46d4873e3f6fa52a9705 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.840958  6874 tablet_replica.cc:333] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.841555  6874 raft_consensus.cc:2243] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.842123  6874 raft_consensus.cc:2272] T b17d64896ea4448a9c6cf54843ab6f93 P 314718fb758643bfb8488f2d3d5b28c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.845661  6874 tablet_replica.cc:333] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.846441  6874 raft_consensus.cc:2243] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.847095  6874 raft_consensus.cc:2272] T f5716ede7b3045d598c7eb0d4117a09b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.850449  6874 tablet_replica.cc:333] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.851016  6874 raft_consensus.cc:2243] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.851504  6874 raft_consensus.cc:2272] T 982dbd7784f547fba30d2ac46b213e8f P 314718fb758643bfb8488f2d3d5b28c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.855057  6874 tablet_replica.cc:333] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.855819  6874 raft_consensus.cc:2243] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:13.856366 19719 consensus_peers.cc:597] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.857062  6874 raft_consensus.cc:2272] T 2274af52b5bc446ba1a2a9692709789b P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.859745  6874 tablet_replica.cc:333] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9: stopping tablet replica
I20260709 12:27:13.860306  6874 raft_consensus.cc:2243] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.861361  6874 raft_consensus.cc:2272] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 314718fb758643bfb8488f2d3d5b28c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.883206 19719 consensus_peers.cc:597] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.913733  6874 tablet_server.cc:196] TabletServer@127.6.182.129:0 shutdown complete.
I20260709 12:27:13.961687  6874 tablet_server.cc:179] TabletServer@127.6.182.130:0 shutting down...
W20260709 12:27:13.983469 19719 consensus_peers.cc:597] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.999666  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:14.000661  6874 tablet_replica.cc:333] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.001998  6874 raft_consensus.cc:2243] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.003298  6874 raft_consensus.cc:2272] T 7e573ab1ff9649b49f6f39c01cd46b0d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.006265  6874 tablet_replica.cc:333] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.007077  6874 raft_consensus.cc:2243] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.007671  6874 raft_consensus.cc:2272] T dd007df25a9644c887c7dcac56e9866e P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.010439  6874 tablet_replica.cc:333] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.011096  6874 raft_consensus.cc:2243] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.012105  6874 raft_consensus.cc:2272] T 51f2129291e648fcba9bd08945fbfecd P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.014529  6874 tablet_replica.cc:333] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.015105  6874 raft_consensus.cc:2243] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.015673  6874 raft_consensus.cc:2272] T 889a2c4962504250a763d1a688a8adc6 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.018226  6874 tablet_replica.cc:333] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.018868  6874 raft_consensus.cc:2243] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.019434  6874 raft_consensus.cc:2272] T fc0827c604b74032aabffa13f7f6b8ac P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.021853  6874 tablet_replica.cc:333] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.022513  6874 raft_consensus.cc:2243] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.023535  6874 raft_consensus.cc:2272] T ef427f4a6e1c4f1f848cf886db908076 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.026055  6874 tablet_replica.cc:333] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.026650  6874 raft_consensus.cc:2243] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.027549  6874 raft_consensus.cc:2272] T e0eaf8828fdc467aad70766b8721527c P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.029954  6874 tablet_replica.cc:333] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.030543  6874 raft_consensus.cc:2243] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.030995  6874 raft_consensus.cc:2272] T 7545bfae73df483783f774ac0ce2e016 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.033417  6874 tablet_replica.cc:333] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.033972  6874 raft_consensus.cc:2243] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.034636  6874 raft_consensus.cc:2272] T b29d404c6ede44e9ac5e49b7a8c5dd2d P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.038394  6874 tablet_replica.cc:333] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.039448  6874 raft_consensus.cc:2243] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.040189  6874 raft_consensus.cc:2272] T 982df37c6aac46d4873e3f6fa52a9705 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:14.041688 19793 consensus_peers.cc:597] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.043352  6874 tablet_replica.cc:333] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.044019  6874 raft_consensus.cc:2243] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.044584  6874 raft_consensus.cc:2272] T 2da016cad1ae409aaf3cff5069b9dd7b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.047003  6874 tablet_replica.cc:333] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.047539  6874 raft_consensus.cc:2243] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.047976  6874 raft_consensus.cc:2272] T a4f0b50d72b84baf9d7f34e95b0ca742 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.050527  6874 tablet_replica.cc:333] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.051091  6874 raft_consensus.cc:2243] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.052047  6874 raft_consensus.cc:2272] T cf38e1dc317d44b3a5ad6c5c59ef1338 P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.054608  6874 tablet_replica.cc:333] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.055215  6874 raft_consensus.cc:2243] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.055809  6874 raft_consensus.cc:2272] T 2274af52b5bc446ba1a2a9692709789b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.058310  6874 tablet_replica.cc:333] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.058852  6874 raft_consensus.cc:2243] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.059373  6874 raft_consensus.cc:2272] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.061738  6874 tablet_replica.cc:333] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.062330  6874 raft_consensus.cc:2243] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.063292  6874 raft_consensus.cc:2272] T 982dbd7784f547fba30d2ac46b213e8f P 8feef7fb24c44570bb36c3db8b063617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.065812  6874 tablet_replica.cc:333] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.066385  6874 raft_consensus.cc:2243] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.067296  6874 raft_consensus.cc:2272] T f5716ede7b3045d598c7eb0d4117a09b P 8feef7fb24c44570bb36c3db8b063617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.069763  6874 tablet_replica.cc:333] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617: stopping tablet replica
I20260709 12:27:14.070233  6874 raft_consensus.cc:2243] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.070709  6874 raft_consensus.cc:2272] T b17d64896ea4448a9c6cf54843ab6f93 P 8feef7fb24c44570bb36c3db8b063617 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.116077  6874 tablet_server.cc:196] TabletServer@127.6.182.130:0 shutdown complete.
W20260709 12:27:14.136655 19793 consensus_peers.cc:597] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.159917  6874 tablet_server.cc:179] TabletServer@127.6.182.131:0 shutting down...
W20260709 12:27:14.178632 19792 consensus_peers.cc:597] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Couldn't send request to peer 8feef7fb24c44570bb36c3db8b063617. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:46635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:14.199255 19792 consensus_peers.cc:597] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 8feef7fb24c44570bb36c3db8b063617 (127.6.182.130:46635): Couldn't send request to peer 8feef7fb24c44570bb36c3db8b063617. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.130:46635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:14.203686 19793 consensus_peers.cc:597] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.203984  6874 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:14.204829  6874 tablet_replica.cc:333] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.205674  6874 raft_consensus.cc:2243] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.206664  6874 raft_consensus.cc:2272] T 889a2c4962504250a763d1a688a8adc6 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.209241  6874 tablet_replica.cc:333] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.209874  6874 raft_consensus.cc:2243] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.210440  6874 raft_consensus.cc:2272] T 7e573ab1ff9649b49f6f39c01cd46b0d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.212802  6874 tablet_replica.cc:333] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.213456  6874 raft_consensus.cc:2243] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.213996  6874 raft_consensus.cc:2272] T fc0827c604b74032aabffa13f7f6b8ac P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.216374  6874 tablet_replica.cc:333] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.217032  6874 raft_consensus.cc:2243] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.217595  6874 raft_consensus.cc:2272] T ef427f4a6e1c4f1f848cf886db908076 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.220212  6874 tablet_replica.cc:333] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.221047  6874 raft_consensus.cc:2243] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.221848  6874 raft_consensus.cc:2272] T 51f2129291e648fcba9bd08945fbfecd P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:14.224784 19793 consensus_peers.cc:597] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 -> Peer 314718fb758643bfb8488f2d3d5b28c9 (127.6.182.129:39989): Couldn't send request to peer 314718fb758643bfb8488f2d3d5b28c9. Status: Network error: Client connection negotiation failed: client connection to 127.6.182.129:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.224946  6874 tablet_replica.cc:333] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.225756  6874 raft_consensus.cc:2243] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.226373  6874 raft_consensus.cc:2272] T dd007df25a9644c887c7dcac56e9866e P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.228773  6874 tablet_replica.cc:333] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.229305  6874 raft_consensus.cc:2243] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.229765  6874 raft_consensus.cc:2272] T 2da016cad1ae409aaf3cff5069b9dd7b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.232172  6874 tablet_replica.cc:333] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.232851  6874 raft_consensus.cc:2243] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.233295  6874 raft_consensus.cc:2272] T cf38e1dc317d44b3a5ad6c5c59ef1338 P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.235589  6874 tablet_replica.cc:333] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.236145  6874 raft_consensus.cc:2243] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.237073  6874 raft_consensus.cc:2272] T a4f0b50d72b84baf9d7f34e95b0ca742 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.239743  6874 tablet_replica.cc:333] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.240350  6874 raft_consensus.cc:2243] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.241271  6874 raft_consensus.cc:2272] T 982df37c6aac46d4873e3f6fa52a9705 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.243505  6874 tablet_replica.cc:333] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.244191  6874 raft_consensus.cc:2243] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.245169  6874 raft_consensus.cc:2272] T b17d64896ea4448a9c6cf54843ab6f93 P a7167e508b864cc1abbeaa1b03df8422 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.247465  6874 tablet_replica.cc:333] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.248006  6874 raft_consensus.cc:2243] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.248449  6874 raft_consensus.cc:2272] T f5716ede7b3045d598c7eb0d4117a09b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.250658  6874 tablet_replica.cc:333] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.251195  6874 raft_consensus.cc:2243] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.251610  6874 raft_consensus.cc:2272] T 982dbd7784f547fba30d2ac46b213e8f P a7167e508b864cc1abbeaa1b03df8422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.253958  6874 tablet_replica.cc:333] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.254464  6874 raft_consensus.cc:2243] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.254948  6874 raft_consensus.cc:2272] T 2274af52b5bc446ba1a2a9692709789b P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.257403  6874 tablet_replica.cc:333] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.257941  6874 raft_consensus.cc:2243] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.258391  6874 raft_consensus.cc:2272] T 2bdaf68f5b6b4edea5062c4dd3bd3243 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.260537  6874 tablet_replica.cc:333] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.261385  6874 raft_consensus.cc:2243] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.261873  6874 raft_consensus.cc:2272] T e0eaf8828fdc467aad70766b8721527c P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.264040  6874 tablet_replica.cc:333] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.264530  6874 raft_consensus.cc:2243] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.265091  6874 raft_consensus.cc:2272] T b29d404c6ede44e9ac5e49b7a8c5dd2d P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.267213  6874 tablet_replica.cc:333] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422: stopping tablet replica
I20260709 12:27:14.268164  6874 raft_consensus.cc:2243] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.268728  6874 raft_consensus.cc:2272] T 7545bfae73df483783f774ac0ce2e016 P a7167e508b864cc1abbeaa1b03df8422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.315580  6874 tablet_server.cc:196] TabletServer@127.6.182.131:0 shutdown complete.
I20260709 12:27:14.356326  6874 master.cc:562] Master@127.6.182.190:35095 shutting down...
I20260709 12:27:14.381050  6874 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.381753  6874 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.382162  6874 tablet_replica.cc:333] T 00000000000000000000000000000000 P 00a597457e0940fdb32c5bee55716d9f: stopping tablet replica
I20260709 12:27:14.403137  6874 master.cc:584] Master@127.6.182.190:35095 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20949 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42152 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (448480 ms total)
[  PASSED  ] 6 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] LeaderRebalancerTest.RestartTserver

 2 FAILED TESTS
I20260709 12:27:14.463092  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2214 messages since previous log ~32 seconds ago
I20260709 12:27:14.463308  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2214 messages since previous log ~32 seconds ago
I20260709 12:27:14.463461  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2210 messages since previous log ~32 seconds ago
I20260709 12:27:14.463629  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:27:14.463783  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:27:14.463950  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~233 seconds ago
I20260709 12:27:14.464154  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:27:14.464432  6874 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
